HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: To protect site against Spider engines like HT
Author: spirit
Date: 03/30/2004 10:27
 
Patrick,

You can use the robots.txt file to block it.

regards
 
Reply Create subthread


All articles

Subject Author Date
To protect site against Spider engines like HTTra

11/05/2002 23:17
Re: To protect site against Spider engines like HTTra

11/05/2002 23:42
Re: To protect site against Spider engines like HT

11/05/2002 23:44
Re: To protect site against Spider engines like HT

03/30/2004 10:27
Re: To protect site against Spider engines like HTTra

01/28/2009 22:57




3

Created with FORUM 2.0.11