HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Don't follow after x page
Author: William Roeder
Date: 09/01/2011 17:47
 
> Reply: fail
> 
> Offtopic: I didn't create this topic just because I
> was bored. I created it for a reason.
> 
> Ontopic: Yes there are links or if there aren't,
> httrack just keeps scanning empty pages

I answered your question with the limited amount of information you provided.
You said NOTHING about empty pages or looping. YOU FAILED. No mind-readers
here. Don't start whining that you didn't get an answer you like. Go back to
the original post and ReREAD it. Then explain to me what I missed using no
information other than what's in the post.

Next time post the command line used (log file line two) maybe the URL like
page 500 and what the problem REALLY IS.

The problem is the site has bad links 500 points to a non-existent 501 which
instead of returning error 401 does something else.

So filter out page 501 and the loop is broken.
 
Reply Create subthread


All articles

Subject Author Date
Don't follow after x page

08/31/2011 19:54
Re: Don't follow after x page

09/01/2011 00:42
Re: Don't follow after x page

09/01/2011 16:55
Re: Don't follow after x page

09/01/2011 17:47
Re: Don't follow after x page

09/01/2011 20:29




0

Created with FORUM 2.0.11