HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Directory Structure Download
Author: William Roeder
Date: 03/25/2009 03:13
 
> <http://www.drapertools.com/products/standard/>
> 
> is that possible?
Yes. <http://www.drapertools.com/robots.txt> says:
User-agent: *
Disallow: /
Therefor you need to tell httrack to set options -> spider -> spider=no
robots.txt rules
 
Reply Create subthread


All articles

Subject Author Date
Directory Structure Download

03/24/2009 13:02
Re: Directory Structure Download

03/25/2009 03:13
Re: Directory Structure Download

03/25/2009 15:44




9

Created with FORUM 2.0.11