HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: cookie and delay suggestions
Author: Travis E.
Date: 12/22/2004 07:54
 
> 2) Make it possible to specify a delay between page
> requests, since at this moment it just goes as fast as it
> can, which is not good for spidering online sites since it
> bogs down the server.

Would the "Max connections/seconds" option in the Limits
section help? It lets you limit the number of connections
made to the server per second.
 
Reply Create subthread


All articles

Subject Author Date
cookie and delay suggestions

12/22/2004 00:43
Re: cookie and delay suggestions

12/22/2004 07:54
Re: cookie and delay suggestions

12/22/2004 21:14
Re: cookie and delay suggestions

12/28/2004 10:16




8

Created with FORUM 2.0.11