HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Why are you doing this?
Author: Rob
Date: 12/15/2017 00:49
 
It appears to respect robots.txt. If you tune yours, that should fix it.
 
Reply Create subthread


All articles

Subject Author Date
Why are you doing this?

clemence

 12/12/2017 11:19
Re: Why are you doing this?

Rob

 12/15/2017 00:49




b

Created with FORUM 2.0.11