HTTrack Website Copier
Free software offline browser - FORUM
Subject: User agent name and robots.txt
Author: simon
Date: 03/18/2007 04:29
Could you please confirm that the user agent name for WinHTTrack in robots.txt

Also, could you please add this information to the documentation so that those
wishing to know hoe to enable parts of a website specifically for WinHTTtrack
can easily find out how to do so.


All articles

Subject Author Date
User agent name and robots.txt

03/18/2007 04:29


Created with FORUM 2.0.11