HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Checking for updates
Author: Xavier Roche
Date: 03/17/2009 21:18
> I see that httrack uses if-modified-since attribute
> to check if the file is modified or not. But for
> dynamic pages (aspx) this attribute will always
> return the date time when the page is requested. 

And thus, the dynamic page should use the "Etag" header field to handle
If-None-Match requests, using the page's entropy (variables, internal or
external, that will be hashed to produce an unique identifier)

Unfortunately most servers are just unable to serve Etags, and tools like
httrack can not efficiently update the corresponding dynamic pages.
Reply Create subthread

All articles

Subject Author Date
Checking for updates

03/06/2009 08:35
Re: Checking for updates

03/06/2009 15:20
Re: Checking for updates

03/06/2009 15:22
Re: Checking for updates

03/17/2009 21:18


Created with FORUM 2.0.11