HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: broken servers with bad responses...
Author: Xavier Roche
Date: 01/07/2003 21:19
 
> I had a nightmare of a site recently where the '404' page
> returned a 200 code.  The problem was, though, that
> their '404' page was a full page around 17KB with many
> links to other files which were ALSO 404 (so all those of
> course had 200 codes too).  Basically the mirror was in a
> crazy loop, and I had to add many many filters so that
> the HTTrack never reached a '404' :(

Humm. I will try to implement a feature to detect redirects 
from "clearly binary files" (gif, zip..) to html files - 
but I'm wondering if this is going to break things or not..

 
Reply Create subthread


All articles

Subject Author Date
broken servers with bad responses...

01/05/2003 12:09
Re: broken servers with bad responses...

01/05/2003 15:02
Re: broken servers with bad responses...

01/05/2003 22:24
Re: broken servers with bad responses...

01/07/2003 21:19
Re: broken servers with bad responses...

01/07/2003 21:21
Re: broken servers with bad responses...

01/08/2003 08:22
Re: broken servers with bad responses...also

01/08/2003 08:33




c

Created with FORUM 2.0.11