HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: duplicate transfers when mirroring dynamic sites
Author: da5e
Date: 06/20/2002 12:01
 
> 
> No, if the file has been downloaded twice (and is stored 
> twice on the local filesystem), URLs must be different.. 
or 
> slightly different. The query string, for example, might 
be 
> different (..foo?param=2 and ..foo?param=2&bar)
> 
> Check the hts-cache/new.txt files and find the two 
> occurences of this pdf file - and compare the http paths
> 

indeed, you are right. the urls differ in one out of ~50 
characters, which i didn't recognize the first time.

is there any way to tell httrack that these files are 
equal? if not, maybe you can point out to me where i have 
to look in the source code; then i can try to post a 
solution.

thanx
  da5e
 
Reply Create subthread


All articles

Subject Author Date
duplicate transfers when mirroring dynamic sites

06/19/2002 10:04
Re: duplicate transfers when mirroring dynamic sites

06/19/2002 22:32
Re: duplicate transfers when mirroring dynamic sites

06/20/2002 12:01




2

Created with FORUM 2.0.11