HTTrack Website Copier
Free software offline browser - FORUM
Subject: User agent name and robots.txt
Author: simon
Date: 03/18/2007 04:28
 
Could you please confirm that the user agent name for WinHTTrack in robots.txt
is
"httrack".

Also, could you please add this information to the documentation so that those
wishing to know hoe to enable parts of a website specifically for WinHTTtrack
can easily find out how to do so.

thanks
 
Reply


All articles

Subject Author Date
User agent name and robots.txt

03/18/2007 04:28
Re: User agent name and robots.txt

03/18/2007 17:35




a

Created with FORUM 2.0.11