HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: retries on 404 errors
Author: Bojan K.
Date: 01/05/2009 20:48
 
Actually, I'm sure that the file exists (manual check), and I'm sure that it
isn't something wrong with my settings because when I do an update some of the
pages are downloaded correctly. 

The problem is (this is a guess), that the web-site owner actually forbids me
to crawl the page that fast by returning a 404 error.. I've changed the number
of connections and the speed, but that just removes part of the errors... 

It would be great If I could specify the number of retries on those 404 (fatal
not-found) errors...

Is there anyway I can do this in httrack, and if not, can you point me to the
correct file in the sources (I'll add this functionality myself)... 

Thanks for your time... Great product, btw...
 
Reply Create subthread


All articles

Subject Author Date
retries on 404 errors

01/05/2009 18:37
Re: retries on 404 errors

01/05/2009 19:58
Re: retries on 404 errors

01/05/2009 20:48
Re: retries on 404 errors

01/05/2009 21:46




4

Created with FORUM 2.0.11