HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: robots.txt options not set
Author: Xavier Roche
Date: 11/06/2003 19:58
 
> When using webhttrack, the robots.txt options i select (do
> not follow filters rules) isn't inserted in the command
> generated for httrack (the -s0 option). 
> Is it normal ?
Err, no. This is actually a bug, located 
in /usr/share/httrack/html/server/step4.html. You can fix 
it by applying this patch (using patch, or with emacs/vi)

--- httrack-3.30.01.orig/html/server/step4.html Thu Nov  6 
19:57:27 2003
+++ httrack-3.30.01/html/server/step4.html      Thu Nov  6 
19:57:27 2003
@@ -201,6 +201,7 @@
        ${test:build:-N0:-N0:-N1:-N2:-N3:-N4:-N5:-N100:-
N101:-N102:-N103:-N104:-N105:-N99:-N199:}
 \
        ${ztest:dos::--long-names=0:--long-names=2}
+       ${test:robots:--robots=0:--robots=0:--robots=1:--
robots=2}
        ${test:errpage:--generate-errors:--generate-
errors=0}
        ${test:external:--replace-external}
        ${test:hidepwd:--disable-passwords}

Thanks for pointing out the problem!

 
Reply Create subthread


All articles

Subject Author Date
robots.txt options not set

11/05/2003 23:49
Re: robots.txt options not set

11/06/2003 19:58
Re: robots.txt options not set

11/06/2003 22:35




2

Created with FORUM 2.0.11