HTTrack Website Copier
Free software offline browser - FORUM
Subject: Cannot download folder by robot.txt rules
Author: Vu
Date: 07/02/2002 10:16
 
I am using HTTrack v3.20RC3. I can't download a folder of a 
webpage, the hts-log.txt file has lines:
...
Note: due to ... remote robots.txt rules, links begining 
with these path will be forbidden: /folder/ (see in the 
options to disable this)
No files purged
...
I also use filter : */folder/* in the options, but I still 
can't download.
Please help.
Thanks
 
Reply


All articles

Subject Author Date
Cannot download folder by robot.txt rules

07/02/2002 10:16
Re: Cannot download folder by robot.txt rules

07/02/2002 20:50




f

Created with FORUM 2.0.11