HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: crawling of may sites simultaneously
Author: Xavier Roche
Date: 12/14/2003 15:05
 
> is it possible tu run the crawl of many siters together 
> with a large bandwidth(10-20 Mbts), 20 sites or 40 sites)?> I've done it
with  a shell. But is it already included in 
> httrack?
In one signel project? Yes, httrack handles by default 
multiple starting URLS. But it will not "load balance" the 
traffic between IP's, if this is what you are looking for.

For multiple project mirroring, no, this is not possible 
using the GUI release, even if a "batch mirror" feature 
would be included in the future.
 
Reply Create subthread


All articles

Subject Author Date
crawling of may sites simultaneously

12/12/2003 18:45
Re: crawling of may sites simultaneously

12/14/2003 15:05




8

Created with FORUM 2.0.11