| > Bug in the GUI. Once the mirror has started, only
> Max transfer rate, connections/sec (possible some
> others) and flow controls can be changed. And the
> changes are not permanent.
Yep - the maximum number of links should be gr(e|a)yed.
Anyway 100,000 links is yet a bit huge for a small website copier like httrack
- you may go up to 1,000,000 links, but the engine will slow down a bit,
because internal structures do not scale millions of pages.
Heritrix (http://crawler.archive.org/) is probably better for very large
mirrors (millions/billions of pages)
| |