HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: how to have maximum performance and not hammer URL
Author: Xavier Roche
Date: 01/08/2005 11:08
 
> I need to download  e.g. 500 URLs
> I do not want to hammer them. Can I slow down spider with 
> some sleep (10 min.)
> 10 min. is time for access the URL

1 link per 1 minute == 1 link per 600 seconds == 1/600 
links per second == 0.0017 links per second

Hence, go in
Set Options / Limits / Max connections per seconds

and type in "0.0017" (without the quotes)

Note: Use at least 3.33-RC5 (previous releases did not 
handle correctly floating number of connection)
 
Reply Create subthread


All articles

Subject Author Date
how to have maximum performance and not hammer URL

Jim Zaba

01/05/2005 01:27
Re: how to have maximum performance and not hammer URL

Xavier Roche

01/08/2005 11:08
Re: how to have maximum performance and not hammer URL

Jim Zaba

01/14/2005 16:47




a

Created with FORUM 2.0.11