HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: a precision about robots.txt when mirroring lo
Author: Xavier Roche
Date: 08/10/2003 11:51
 
> It's the normal behaviour to look for robots.txt in the
> root, but it is not very convenient to have a local site
> located in the hard disk root.

No, no - not in the hard disk root (/) but in the HTML root 
folder (probably /home/httpd or /var/www)

 
Reply Create subthread


All articles

Subject Author Date
a precision about robots.txt when mirroring locall

08/05/2003 11:50
Re: a precision about robots.txt when mirroring locall

08/07/2003 20:49
Re: a precision about robots.txt when mirroring lo

08/08/2003 10:16
Re: a precision about robots.txt when mirroring lo

08/10/2003 11:51
Re: a precision about robots.txt when mirroring lo

08/10/2003 22:51
Re: a precision about robots.txt when mirroring lo

08/15/2003 09:10
Re: a precision about robots.txt when mirroring lo

08/15/2003 16:07




3

Created with FORUM 2.0.11