HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: I do not understand how filters work
Author: William Roeder
Date: 08/25/2010 18:31
 
> I don't know why it is forced external, shouldn't
> be.
Found it. The page contains <meta name="robots" content="index, nofollow">
So you have to set options -> spider -> spider = no robot.txt rules

 
Reply Create subthread


All articles

Subject Author Date
I do not understand how filters work 08/24/2010 19:47
Re: I do not understand how filters work 08/25/2010 18:27
Re: I do not understand how filters work 08/25/2010 18:31
Re: I do not understand how filters work 08/29/2010 16:43
Re: I do not understand how filters work 08/30/2010 04:41




8

Created with FORUM 2.0.11