| Subject: Re: server reject HTTracks requests? |
Author: Leto |
Date: 12/12/2001 22:15 |
| | > In sub-page <http://www.vb-seminar.de/vb_5.htm>
> HTTracks cannot download images of subdirectory
> <http://www.vb-seminar.de/screenshots/> . HTTracks
> gets an error which is not listed in HTTracks
> results.
In your HTTrack options, go to "Spider" and change "follow robots.txt rules"
to "no robots.txt rules". This will allow HTTrack to get the screenshots.
The server administrators did this for a reason, so please also restrict your
download speed with "Flow Control" options. Maybe set "Number of connections"
to 3 or something.
| |
|
|
|
|
2
Created with FORUM 2.0.11