Re: How to exclude HTTrack from a site - HTTrack Website Copier Forum

Subject: Re: How to exclude HTTrack from a site

Author: Xavier Roche

Date: 07/27/2001 09:25

> Does HTTrack check robot.txt to see if it's allowed 
to get a website or not?
Yes, this is the default behaviour

All articles

Subject	Author	Date
How to exclude HTTrack from a site		07/26/2001 23:16
Re: How to exclude HTTrack from a site		07/27/2001 09:25
Re: How to exclude HTTrack from a site		07/27/2001 17:07