HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Can website defeat HTTrack?
Author: Xavier Roche
Date: 07/05/2001 21:41
 
> Trying to download a website using HTTrack 3.02, it 
> used to work well.  But when I try it again 
recently, 
> it trying to connect 1.asp (main page) and robots.txt
> Then it prompts saying the mirror is empty ...
> Is it because the webmaster has created something to 
> prevent HTTrack from working?
Might be. The default browser identity allows to do 
such things, and the robots.txt rules can, too.
You can disable both of them, but please read the 
abuse faq first 
(http://www.httrack.com/HelpHtml/abuse.html) and 
especially, try to set reasonnable limits to n# os 
connection when downloading!

 
Reply Create subthread


All articles

Subject Author Date
Can website defeat HTTrack?

07/05/2001 20:36
Re: Can website defeat HTTrack?

07/05/2001 21:41
Re: Can website defeat HTTrack?

07/05/2001 22:25




5

Created with FORUM 2.0.11