Subject: (Web)HTTrack ignores "no robots.txt rules" option
Author: Terry
Date: 05/26/2006 00:13
Even though I have chosen the spider option of "no robots.txt rules" in
WebHTTrack v3.30 , it still obeys those rules. Is there a bug in this
particular version?
