| Subject: Re: W3C Schools |
Author: Stefan |
Date: 03/17/2005 17:24 |
| | Hi
try to use this option:
sN follow robots.txt and meta robots tags
(0=never,1=sometimes,* 2=always) (--robots[=N])
so you want httrack not to follow the robots.txt, use -s0 as
option
Stefan | |
|
|
|
|
5
Created with FORUM 2.0.11