| I have set the program to output a debug log and apparently it is sending
requests for files which have already been downloaded, with a Range: header
that is too high. Also I found that it's not just images which are affected,
but 10% of *all* files. For example, here is the initial request for the
index.js file:
[1] request for intranet/js/index.js:
<<< GET /js/index.js HTTP/1.1
<<< Connection: Keep-Alive
<<< Host: intranet
<<< User-Agent: HTTrack/3.0x
<<< Accept: image/png, image/jpeg, image/pjpeg, image/x-xbitmap,
image/svg+xml, image/gif;q=0.9, */*;q=0.1
<<< Accept-Language: en, en, *
<<< Accept-Charset: iso-8859-1, iso-8859-*;q=0.9, utf-8;q=0.66, *;q=0.33
<<< Accept-Encoding: gzip, identity;q=0.9
[1] response for intranet/js/index.js:
code=200
>>> HTTP/1.1 200 OK
>>> Date: Wed, 11 Mar 2009 23:47:49 GMT
>>> Server: Apache/2.0.58 (Unix) PHP/5.1.2
>>> Last-Modified: Fri, 06 Feb 2009 21:12:30 GMT
>>> ETag: "1740de-f1c-7a8aeb80"
>>> Accept-Ranges: bytes
>>> Content-Encoding: gzip
>>> Content-Length: 1476
>>> Keep-Alive: timeout=15, max=93
>>> Connection: Keep-Alive
>>> Content-Type: text/javascript
Then here is the 2nd request for the same file with a Range header much higher
than the original Content Length (this request happens right near the end):
[55] request for intranet/js/index.js:
<<< GET /js/index.js HTTP/1.1
<<< If-Unmodified-Since: Fri, 06 Feb 2009 21:12:30 GMT
<<< Range: bytes=3868-
<<< Referer: <http://intranet/>
<<< Connection: Keep-Alive
<<< Host: intranet
<<< User-Agent: HTTrack/3.0x
<<< Accept: image/png, image/jpeg, image/pjpeg, image/x-xbitmap,
image/svg+xml, image/gif;q=0.9, */*;q=0.1
<<< Accept-Language: en, en, *
<<< Accept-Charset: iso-8859-1, iso-8859-*;q=0.9, utf-8;q=0.66, *;q=0.33
<<< Accept-Encoding: gzip, identity;q=0.9
[55] response for intranet/js/index.js:
code=416
>>> HTTP/1.1 416 Requested Range Not Satisfiable
>>> Date: Thu, 12 Mar 2009 00:18:39 GMT
>>> Server: Apache/2.0.58 (Unix) PHP/5.1.2
>>> Vary: Accept-Encoding
>>> Content-Encoding: gzip
>>> Keep-Alive: timeout=15, max=68
>>> Connection: Keep-Alive
>>> Transfer-Encoding: chunked
>>> Content-Type: text/html; charset=iso-8859-1
Then the local contents of the mirrored index.js is overwritten with the HTML
of the 416 response. Is there some way to disable these last requests,
because the files are recieved properly to begin with!
Please help!
Brian | |