HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Httrack and big lists?
Author: William Roeder
Date: 01/16/2012 14:53
 
> I'm trying to get httrack to download .html files in
> a list I've created, this is a very large list of
> 100,000+ files.
I assume you're using action = "Download all sites in pages" with the URL =
your text file with a list. (URL box is limited in size ~30kb)

> For some reason it will never successfully start,
The max links defaults to 100,000 so it will never start.
-#L  Maximum number of links (-#L1000000) or option -> limits -> maximum
number of links

> Any ideas?Always post the command line used (log file line two)
Always read the log file and see what it says.

 
Reply Create subthread


All articles

Subject Author Date
Httrack and big lists?

01/16/2012 13:24
Re: Httrack and big lists?

01/16/2012 14:53




8

Created with FORUM 2.0.11