HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: hts download issue
Author: BT
Date: 04/18/2007 03:51
You might want to try ignoring the robots.txt file. I took a quick look at the
robots file at the site you mentioned and while the completely disallow a lot
of spiders httrack was not named in there. Give it a shot, cheers!
Reply Create subthread

All articles

Subject Author Date
hts download issue

04/08/2007 07:29
Re: hts download issue

04/18/2007 03:51


Created with FORUM 2.0.11