HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: W3C Schools
Author: Stefan
Date: 03/17/2005 17:24
 
Hi

try to use this option:  
sN follow robots.txt and meta robots tags
(0=never,1=sometimes,* 2=always) (--robots[=N])

so you want httrack not to follow the robots.txt, use -s0 as
option

Stefan
 
Reply Create subthread


All articles

Subject Author Date
W3C Schools

03/17/2005 17:19
Re: W3C Schools

03/17/2005 17:24
Re: W3C Schools

03/03/2017 19:20
Re: W3C Schools

03/17/2005 17:34
Re: W3C Schools

03/17/2005 18:11
Re: W3C Schools

03/17/2005 20:55
Re: W3C Schools

03/17/2005 21:46
Re: W3C Schools

05/21/2005 21:15
Re: W3C Schools

05/21/2005 21:16
Re: W3C Schools

05/08/2009 15:49




5

Created with FORUM 2.0.11