HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: detecting missing/404 errors for broken file links
Author: Leto
Date: 03/13/2002 22:52
 
I think, as Xavier pointed out in another recent post,
that some of this is rather dependant upon the server
itself and it sending the correct HTTP headers.

If a file is not found on a server, it is programmed
to display a 404 page, and in that page it SHOULD
have a "404 Not Found" HTTP status header.  If it
doesn't then it would be recognised as an ordinary
page.

Coupled with that is also the "type" of a file.  I
believe this is also up to the server. It can look
at the requested file, see what type it is, and set
the appropriate header.

I don't think it would be very good "looking" at an
HTML page for <html>, as not every HTML page starts
with this, and sometimes doesn't even have one at all.
 
Reply Create subthread


All articles

Subject Author Date
detecting missing/404 errors for broken file links

03/13/2002 19:55
Re: detecting missing/404 errors for broken file links

03/13/2002 22:52
Re: detecting missing/404 errors for broken file links

01/08/2005 02:14
Re: detecting missing/404 errors for broken file links

03/14/2002 01:17
Re: detecting missing/404 errors for broken file links

03/14/2002 03:43




2

Created with FORUM 2.0.11