HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: loading the list in memory takes time
Author: Xavier Roche
Date: 06/29/2001 08:42
 
> It really takes time loading in memory a big list of 
> URLs form file. For about 92000 entries it takes 
about 
> 3h with 100% CPU utilisation... is it normal? That 
> happens before the start of scanning/downloading.

> It really takes time loading in memory a big list of 
> URLs form file. For about 92000 entries it takes 
about 
> 3h with 100% CPU utilisation... is it normal? That 
> happens before the start of scanning/downloading.

Wow - a huge list! Did you use the "URL list" option, 
or the regular "scan all links in pages" with a 
starting file:// URL?
You can disable the type check, but if URLs are in 
unknown format type (.asp,.cgi..), the pages won't be 
readable properly locally
 
Reply Create subthread


All articles

Subject Author Date
loading the list in memory takes time

06/28/2001 15:28
Re: loading the list in memory takes time

06/29/2001 08:42
Re: loading the list in memory takes time

06/29/2001 10:45
Re: loading the list in memory takes time

06/29/2001 10:49
Re: loading the list in memory takes time

06/29/2001 22:51
Re: loading the list in memory takes time

06/29/2001 22:53




f

Created with FORUM 2.0.11