HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: "noindex,nofollow" and relative links
Author: Xavier Roche
Date: 12/02/2003 20:40
> WinHTTrack Website Copier 3.31-TEST-2 (+swf)
> I found that pages with 
> <META NAME='robots' CONTENT='noindex,nofollow'>
> (and only these ones within the mirror)
> had their relative links transformed into absolute links.

You mean http:// links ?
> Is there a reason for this behaviour ?
Yes - if robots.txt are enabled, "nofollow" in meta will 
force httrack to skip ALL links in the page.

(Err, isn't it the desired behaviour ?)
Reply Create subthread

All articles

Subject Author Date
"noindex,nofollow" and relative links

11/26/2003 14:32
Re: "noindex,nofollow" and relative links

11/26/2003 17:10
Re: "noindex,nofollow" and relative links

12/02/2003 20:40
Re: "noindex,nofollow" and relative links

12/03/2003 11:03


Created with FORUM 2.0.11