HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: duplicate transfers when mirroring dynamic sites
Author: Xavier Roche
Date: 06/19/2002 22:32
 
> i recently mirrored a dynamic website that generates
> pages for urls like 'skript?value=parameter'. the site
> however is statically linked, in other words the links in
> a webpage don't change and links from different pages
> that point to the same file are identical.
> winttrack did download pdf (same url, same size, but
> maybe different server datetime) files that were
> referenced from 2 subpages, twice.

No, if the file has been downloaded twice (and is stored 
twice on the local filesystem), URLs must be different.. or 
slightly different. The query string, for example, might be 
different (..foo?param=2 and ..foo?param=2&bar)

Check the hts-cache/new.txt files and find the two 
occurences of this pdf file - and compare the http paths
 
Reply Create subthread


All articles

Subject Author Date
duplicate transfers when mirroring dynamic sites

06/19/2002 10:04
Re: duplicate transfers when mirroring dynamic sites

06/19/2002 22:32
Re: duplicate transfers when mirroring dynamic sites

06/24/2002 09:59
Re: duplicate transfers when mirroring dynamic sites

06/20/2002 12:01




4

Created with FORUM 2.0.11