| > 2) Make it possible to specify a delay between page
> requests, since at this moment it just goes as fast as it
> can, which is not good for spidering online sites since it
> bogs down the server.
Would the "Max connections/seconds" option in the Limits
section help? It lets you limit the number of connections
made to the server per second. | |