HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: bug in 3.43-9 windows
Author: Xavier Roche
Date: 03/26/2010 13:09
 
> Bug in the GUI. Once the mirror has started, only
> Max transfer rate, connections/sec (possible some
> others) and flow controls can be changed. And the
> changes are not permanent.

Yep - the maximum number of links should be gr(e|a)yed. 

Anyway 100,000 links is yet a bit huge for a small website copier like httrack
- you may go up to 1,000,000 links, but the engine will slow down a bit,
because internal structures do not scale millions of pages.

Heritrix (http://crawler.archive.org/) is probably better for very large
mirrors (millions/billions of pages)
 
Reply Create subthread


All articles

Subject Author Date
bug in 3.43-9 windows

03/25/2010 10:53
Re: bug in 3.43-9 windows

03/25/2010 13:56
Re: bug in 3.43-9 windows

03/26/2010 13:09




7

Created with FORUM 2.0.11