HTTrack Website Copier
Free software offline browser - FORUM
Subject: How to control hits / minute?
Author: Alan
Date: 11/19/2001 21:53
 
I am trying to mirror a site that does not allow 
crawling at faster than 8 hits / minute (average).  I 
have tried various settings, even setting the 
simultaneous connections to 1, but still get errors on 
my mirror indicating that I am crawling too fast.

This is there requirement:
Current crawling limitations per host (IP address): 
hits/hour:300, hits/minute (averaged):8, simultaneous 
open connections:10

Is there a way to force httrack to follow these 
paramters?
Any help would be great appreciated.

Thanks,
-alan
 
Reply


All articles

Subject Author Date
How to control hits / minute?

11/19/2001 21:53
Re: How to control hits / minute?

11/20/2001 19:56




a

Created with FORUM 2.0.11