HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: DL Entire Forum Thread? (Plus, Robots.txt Issu
Author: Max
Date: 04/06/2007 07:39
 
Hi - thanks for responding!

-> I gave it a try with your suggested scan rules, however it didn't work.

First off, it unexpectedly stopped scanning after only about a minute,
capturing a page or two. But most importantly, it once more did not grab the
user attached images, which is the main objective of this thread.

I believe that I have to tweak some settings in HTTrack to bypass the
website's robots.txt disallow rules, but I don't know where to start.

So, still seeking assistance.

Thanks in advance.
 
Reply Create subthread


All articles

Subject Author Date
DL Entire Forum Thread? (Plus, Robots.txt Issues)

03/29/2007 03:27
Re: DL Entire Forum Thread? (Plus, Robots.txt Issu

03/29/2007 23:56
Can Anyone Respond?...Re: DL Entire Forum Thread?

03/31/2007 02:19
Re: DL Entire Forum Thread? (Plus, Robots.txt Issues)

04/03/2007 01:11
Re: DL Entire Forum Thread? (Plus, Robots.txt Issu

04/06/2007 07:39
Re: DL Entire Forum Thread? (Plus, Robots.txt Issu

04/06/2007 14:19
Can Anyone Respond?...Re: DL Entire Forum Thread?

11/05/2009 11:21




b

Created with FORUM 2.0.11