HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Randomnize Behavior Pattern
Author: Leto
Date: 05/14/2002 01:44
 
> I run into a website that uses some sort of anti-
> robotic software that analyze your browsing behavior 
> and ban your IP accordingly.

Have you looked at the error log?  That may say something about robots.txt
blocking certain files.  If this is the case, you could tell HTTrack to ignore
robots.txt (just use this respectfully.)

Alternatively, have you checked what "browser ID" HTTrack is using? You can
set this in the options.  Try something common like:

Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)
 
Reply Create subthread


All articles

Subject Author Date
Randomnize Behavior Pattern

05/13/2002 23:38
Re: Randomnize Behavior Pattern

05/14/2002 01:44
Re: Randomnize Behavior Pattern

05/14/2002 03:15
Re: Randomnize Behavior Pattern

05/14/2002 08:06




c

Created with FORUM 2.0.11