HTTrack Website Copier
Free software offline browser - FORUM
Subject: Large amount of links from text file
Author: KyleJ
Date: 08/19/2019 19:28
I plan to download a large archive which I've compiled which looks like
the total links is about 4000000 I have split this between 5 batches but i am
finding when i continue a disrupted project is is parsing all the links again
and then to actually grab the pages themselves is taking a long time itself

I have excluded file extensions .gif .jpg .jpeg and increased the connection

Is there anything else i can do such as download the .html straight away
instead of parsing 

All articles

Subject Author Date
Large amount of links from text file

08/19/2019 19:28


Created with FORUM 2.0.11