HTTrack Website Copier
Free software offline browser - FORUM
Subject: how to have maximum performance and not hammer URL
Author: Jim Zaba
Date: 01/05/2005 01:27
 
I need to download  e.g. 500 URLs
I do not want to hammer them. Can I slow down spider with 
some sleep (10 min.)
10 min. is time for access the URL

Is this SW smart that I can set 10 theards.
They grab first page from each URL and then wait x min.
(10 min - time of execution)

Thanks,

Jim
 
Reply


All articles

Subject Author Date
how to have maximum performance and not hammer URL

01/05/2005 01:27
Re: how to have maximum performance and not hammer URL

01/08/2005 11:08
Re: how to have maximum performance and not hammer URL

01/14/2005 16:47




d

Created with FORUM 2.0.11