| Subject: Re: broken servers with bad responses... |
Author: Xavier Roche |
Date: 01/07/2003 21:19 |
| | > I had a nightmare of a site recently where the '404' page
> returned a 200 code. The problem was, though, that
> their '404' page was a full page around 17KB with many
> links to other files which were ALSO 404 (so all those of
> course had 200 codes too). Basically the mirror was in a
> crazy loop, and I had to add many many filters so that
> the HTTrack never reached a '404' :(
Humm. I will try to implement a feature to detect redirects
from "clearly binary files" (gif, zip..) to html files -
but I'm wondering if this is going to break things or not..
| |
|
|
|
|
c
Created with FORUM 2.0.11