HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Images replaced with HTTP 416 Error HTML page.
Author: GreyWyvern
Date: 03/12/2009 01:23
 
I have set the program to output a debug log and apparently it is sending
requests for files which have already been downloaded, with a Range: header
that is too high.  Also I found that it's not just images which are affected,
but 10% of *all* files.  For example, here is the initial request for the
index.js file:

[1] request for intranet/js/index.js:
<<< GET /js/index.js HTTP/1.1
<<< Connection: Keep-Alive
<<< Host: intranet
<<< User-Agent: HTTrack/3.0x
<<< Accept: image/png, image/jpeg, image/pjpeg, image/x-xbitmap,
image/svg+xml, image/gif;q=0.9, */*;q=0.1
<<< Accept-Language: en, en, *
<<< Accept-Charset: iso-8859-1, iso-8859-*;q=0.9, utf-8;q=0.66, *;q=0.33
<<< Accept-Encoding: gzip, identity;q=0.9


[1] response for intranet/js/index.js:
code=200
>>> HTTP/1.1 200 OK
>>> Date: Wed, 11 Mar 2009 23:47:49 GMT
>>> Server: Apache/2.0.58 (Unix) PHP/5.1.2
>>> Last-Modified: Fri, 06 Feb 2009 21:12:30 GMT
>>> ETag: "1740de-f1c-7a8aeb80"
>>> Accept-Ranges: bytes
>>> Content-Encoding: gzip
>>> Content-Length: 1476
>>> Keep-Alive: timeout=15, max=93
>>> Connection: Keep-Alive
>>> Content-Type: text/javascript


Then here is the 2nd request for the same file with a Range header much higher
than the original Content Length (this request happens right near the end):

[55] request for intranet/js/index.js:
<<< GET /js/index.js HTTP/1.1
<<< If-Unmodified-Since: Fri, 06 Feb 2009 21:12:30 GMT
<<< Range: bytes=3868-
<<< Referer: <http://intranet/>
<<< Connection: Keep-Alive
<<< Host: intranet
<<< User-Agent: HTTrack/3.0x
<<< Accept: image/png, image/jpeg, image/pjpeg, image/x-xbitmap,
image/svg+xml, image/gif;q=0.9, */*;q=0.1
<<< Accept-Language: en, en, *
<<< Accept-Charset: iso-8859-1, iso-8859-*;q=0.9, utf-8;q=0.66, *;q=0.33
<<< Accept-Encoding: gzip, identity;q=0.9


[55] response for intranet/js/index.js:
code=416
>>> HTTP/1.1 416 Requested Range Not Satisfiable
>>> Date: Thu, 12 Mar 2009 00:18:39 GMT
>>> Server: Apache/2.0.58 (Unix) PHP/5.1.2
>>> Vary: Accept-Encoding
>>> Content-Encoding: gzip
>>> Keep-Alive: timeout=15, max=68
>>> Connection: Keep-Alive
>>> Transfer-Encoding: chunked
>>> Content-Type: text/html; charset=iso-8859-1

Then the local contents of the mirrored index.js is overwritten with the HTML
of the 416 response.  Is there some way to disable these last requests,
because the files are recieved properly to begin with!

Please help!
Brian
 
Reply Create subthread


All articles

Subject Author Date
Images replaced with HTTP 416 Error HTML page.

03/11/2009 23:51
Re: Images replaced with HTTP 416 Error HTML page.

03/12/2009 01:23
Re: Images replaced with HTTP 416 Error HTML page.

03/12/2009 01:26
Re: Images replaced with HTTP 416 Error HTML page.

03/12/2009 13:31
Re: Images replaced with HTTP 416 Error HTML page.

03/12/2009 15:05
Re: Images replaced with HTTP 416 Error HTML page.

03/12/2009 15:38
Re: Images replaced with HTTP 416 Error HTML page.

03/12/2009 16:46
Re: Images replaced with HTTP 416 Error HTML page.

03/12/2009 17:54
Re: Images replaced with HTTP 416 Error HTML page.

02/27/2011 21:39




0

Created with FORUM 2.0.11