HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: max file size exc; 2GB limit Problem solved!
Author: Xavier Roche
Date: 11/28/2002 20:19
 
> But running into a 2GB limit was not enough to bring my 
> chief down.

Eheh. Anyway, the major internal limit is the hashtable 
index, that is, the increment from the begining of new.dat 
and the cached headers and data. I could switch all 
hashtables in 64-bit, but I perfer to keep the "unsigned 
long int" internal type ; and anyway this is an 
exceptionnal case.

Another solution would have been to request your boss to 
buy a full-64-bit server (with 128GB of memory, and 8 
processors, for faster snapshot) :))

(Note that you could have disabled the cache generation :))

> P.S.: Xavier: No Problems at all with your code. It run 
patched to 
> 64 Bit perfectly. It Mirrored c.a. 188887 Pages with 21 
GB of total amount.

Yes, the output is ok - but if you try to update it, the 
internal hashtables will overflow.

> Again I like to state: Very good work you have done!

Thanks :)

Anyway I have cleanup up the code, 64-bit so that upgrade 
can be relatively easy.
 
Reply Create subthread


All articles

Subject Author Date
max file size exceeded

11/26/2002 13:45
Re: max file size exc; 2GB limit Problem solved!

11/26/2002 19:36
Re: max file size exc; 2GB limit Problem solved!

11/26/2002 20:22
Re: max file size exc; 2GB limit Problem solved!

11/26/2002 20:59
Re: max file size exc; 2GB limit Problem solved!

11/28/2002 06:50
Re: max file size exc; 2GB limit Problem solved!

11/28/2002 20:19
Re: max file size exc; 2GB limit Problem solved!

11/28/2002 22:20




a

Created with FORUM 2.0.11