Re: Can't get a good mirror of a site - HTTrack Website Copier Forum

Subject: Re: Can't get a good mirror of a site

Author: William Roeder

Date: 07/07/2010 00:50

> <http://lewebpedagogique.com/cahiertexte6e1/>

Page contains:
<meta name='robots' content='noindex,nofollow' />
So it doesn't follow. Override robots.txt

Create subthread

All articles

Subject	Author	Date
Can't get a good mirror of a site		07/05/2010 00:47
Re: Can't get a good mirror of a site		07/07/2010 00:50