HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: how to have maximum performance and not hammer URL
Author: Xavier Roche
Date: 01/08/2005 11:08
 
> I need to download  e.g. 500 URLs
> I do not want to hammer them. Can I slow down spider with 
> some sleep (10 min.)
> 10 min. is time for access the URL

1 link per 1 minute == 1 link per 600 seconds == 1/600 
links per second == 0.0017 links per second

Hence, go in
Set Options / Limits / Max connections per seconds

and type in "0.0017" (without the quotes)

Note: Use at least 3.33-RC5 (previous releases did not 
handle correctly floating number of connection)
 
Reply Create subthread


All articles

Subject Author Date
how to have maximum performance and not hammer URL

01/05/2005 01:27
Re: how to have maximum performance and not hammer URL

01/08/2005 11:08
Re: how to have maximum performance and not hammer URL

01/14/2005 16:47




a

Created with FORUM 2.0.11