HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: 2) update always download some/skips others
Author: Xavier Roche
Date: 09/07/2008 20:42
 
> But I also said:
> > The one that always is redownloaded:
> > web/jpg/home86b0.jpg

Server-side problem: no etag, and update request not fulfilled
(if-modified-since).

HTTrack has an additional hack for this situation (update hack); based on the
remote file size. Unfortunately, the server does not even advertize the file
size, and transfer all data using chunked encoding.

There is no way not to update this kind of file, unfortunately: the waste of
bandwidth is a server-side design bug.

[0] request for
promos.naked.com/home.php?file=naked_120x600_adult_kat_03.jpg:
<<< GET /home.php?file=naked_120x600_adult_kat_03.jpg HTTP/1.1
<<< If-Modified-Since: Sun, 07 Sep 2008 18:39:24 GMT
<<< Connection: Keep-Alive
<<< Host: promos.naked.com
<<< User-Agent: Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
<<< Accept: image/png, image/jpeg, image/pjpeg, image/x-xbitmap,
image/svg+xml, image/gif;q=0.9, */*;q=0.1
<<< Accept-Language: en, en, *
<<< Accept-Charset: iso-8859-1, iso-8859-*;q=0.9, utf-8;q=0.66, *;q=0.33
<<< Accept-Encoding: gzip, identity;q=0.9

[0] response for
promos.naked.com/home.php?file=naked_120x600_adult_kat_03.jpg:
code=200
>>> HTTP/1.1 200 OK
>>> Date: Sun, 07 Sep 2008 18:39:48 GMT
>>> Server: Apache/2.2.3 (Unix) PHP/5.2.0
>>> X-Powered-By: PHP/5.2.0
>>> Cache-Control: no-cache
>>> Keep-Alive: timeout=5, max=99
>>> Connection: Keep-Alive
>>> Transfer-Encoding: chunked
>>> Content-Type: image/jpeg
 
Reply Create subthread


All articles

Subject Author Date
2) update always download some/skips others

09/07/2008 17:07
Re: 2) update always download some/skips others

09/07/2008 18:50
Re: 2) update always download some/skips others

09/07/2008 19:16
Re: 2) update always download some/skips others

09/07/2008 20:42




b

Created with FORUM 2.0.11