HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Big difficulties on a big site!
Author:
Date: 01/25/2012 21:47
 
>Httrack is just too slow running one thread and onlarge lists it refuses to
run more than one even if you specify a large amount and use the unrestricted
options.

My experience has been that using the 3.33 version of httrack is a LOT faster
than the 3.44 versions and responds to the connection settings better, but is
slightly less stable and prone to gzip extraction errors. It's available
here;

<http://download.httrack.com/cserv.php3?File=httrack-previous.exe>

>I've attempted to use wget without success as it's just way too slow.

Maybe run many instances of wget, each taking a different url list. Obviously
not 200 at once, but ~10 wgets simultaneously should speed things up
significantly. 
 
Reply Create subthread


All articles

Subject Author Date
Big difficulties on a big site!

01/25/2012 17:06
Re: Big difficulties on a big site!

01/25/2012 21:47
Re: Big difficulties on a big site!

01/26/2012 08:14
Re: Big difficulties on a big site!

01/26/2012 13:52
Re: Big difficulties on a big site!

01/25/2012 23:59
Re: Big difficulties on a big site!

01/26/2012 00:43
Re: Big difficulties on a big site!

01/26/2012 00:52
Re: Big difficulties on a big site!

01/26/2012 13:44




d

Created with FORUM 2.0.11