Re: Too many robots.txt - HTTrack Website Copier Forum

Free software offline browser - FORUM

Subject: Re: Too many robots.txt

Author: William Roeder

Date: 06/29/2008 20:26

looks like it's trying to download the internet
adjust your filters or external limit

Create subthread

All articles

Subject	Author	Date
Too many robots.txt		06/29/2008 16:51
Re: Too many robots.txt		06/29/2008 20:26
Re: Too many robots.txt		07/23/2008 11:41
Re: Too many robots.txt		07/28/2008 04:24
Re: Too many robots.txt		04/18/2009 17:40

b

Created with FORUM 2.0.11