HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: How to exclude HTTrack from a site
Author: Xavier Roche
Date: 07/27/2001 09:25
 
> Does HTTrack check robot.txt to see if it's allowed 
to get a website or not?
Yes, this is the default behaviour

 
Reply Create subthread


All articles

Subject Author Date
How to exclude HTTrack from a site

07/26/2001 23:16
Re: How to exclude HTTrack from a site

07/27/2001 09:25
Re: How to exclude HTTrack from a site

07/27/2001 17:07




9

Created with FORUM 2.0.11