HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Robots.txt and metatag
Author: Constantine
Date: 07/03/2007 18:22
 
TNX,

/me used local-proxy Privoxy (www.privoxy.org)

This proxy (special filter) kill\cut robots metatag and block /robots.txt
links:
all OK, very good downloaded!
 
Reply Create subthread


All articles

Subject Author Date
Robots.txt and metatag

06/22/2007 00:08
Re: Robots.txt and metatag

07/03/2007 11:17
Re: Robots.txt and metatag

07/03/2007 18:22




c

Created with FORUM 2.0.11