HTTrack Website Copier
Free software offline browser - FORUM
Subject: How to exclude HTTrack from a site
Author: firewire
Date: 07/26/2001 23:16
 
Does HTTrack check robot.txt to see if it's allowed to get a website or not?
Thanks
 
Reply


All articles

Subject Author Date
How to exclude HTTrack from a site

07/26/2001 23:16
Re: How to exclude HTTrack from a site

07/27/2001 09:25




5

Created with FORUM 2.0.11