HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: HTTrack is not downloading anything at all!
Author: William Roeder
Date: 02/23/2010 23:12
 
> What's wrong? I try to use the software to download
> some pages with images on wikipedia.
> No matter what rules I set, nothing gets downloaded.
> Why?You look at YOUR log file and see the message about robots.txt 
Look at the robots.txt and you'll see:
User-agent: HTTrack
Disallow: /
and many other ones.
If you choose to override robots, you had better put filters in place.

 
Reply Create subthread


All articles

Subject Author Date
HTTrack is not downloading anything at all!

02/23/2010 15:24
Re: HTTrack is not downloading anything at all!

02/23/2010 23:12




7

Created with FORUM 2.0.11