HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Robots.txt and metatag
Author: Bo Hovgaard Thomasen
Date: 07/03/2007 11:17
 
Try setting the user-agent to: 
"Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)" 
as suggested in this forum posting: 
<http://forum.httrack.com/readmsg/16430/16426/index.html>
 
Reply Create subthread


All articles

Subject Author Date
Robots.txt and metatag

06/22/2007 00:08
Re: Robots.txt and metatag

07/03/2007 11:17
Re: Robots.txt and metatag

07/03/2007 18:22




8

Created with FORUM 2.0.11