HTTrack Website Copier
Free software offline browser - FORUM
Subject: How does work the robot.txt ?
Author: Arnaud SECHER
Date: 04/17/2002 15:58
 
How does work the robot.txt ?Is it all the configuations of HTTrack process
?Where can I find a file robot.txt to know it is 
implemented ?
thanks
 
Reply


All articles

Subject Author Date
How does work the robot.txt ?

04/17/2002 15:58
Re: How does work the robot.txt ?

04/17/2002 20:58




1

Created with FORUM 2.0.11