HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Mirroring site on LAN
Author: William Roeder
Date: 04/13/2010 21:50
 
> <meta name='robots' content='noindex,nofollow' />

Or set don't follow robots.txt, like the log file indicates
 
Reply Create subthread


All articles

Subject Author Date
Mirroring site on LAN

04/12/2010 16:23
Re: Mirroring site on LAN

04/13/2010 01:48
Re: Mirroring site on LAN

04/13/2010 19:31
Re: Mirroring site on LAN

04/13/2010 21:50




e

Created with FORUM 2.0.11