HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: links scanned - parsing huge site
Author: marcus
Date: 04/03/2009 21:20
 
Okay that clears up a lot, i expect it'll take some space and some time.

If I have that many files 'downloaded in the background' does that mean they
are queued up to be browesed for links or mirrored? 

I'm trying to figure out what my bottleneck is, i'd assumed it would be the
sites bandwidth [limiting to not overload] .. but the numbers make it seem
like the bottlenecks my cpu? Only thing is my cpu's arn't running near
capacity..

One last thing.. i'm going about 3 deep, and the first two level are just
large amounts of links.. the 3rd level is the html that i want, is there a way
to grab links in the first two levels and html in the last level?
Thanks for your time!
 
Reply Create subthread


All articles

Subject Author Date
links scanned - parsing huge site

04/03/2009 05:32
Re: links scanned - parsing huge site

04/03/2009 16:07
Re: links scanned - parsing huge site

04/03/2009 21:20
Re: links scanned - parsing huge site

04/03/2009 22:00
Re: links scanned - parsing huge site

03/06/2021 10:36




1

Created with FORUM 2.0.11