HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: loading the list in memory takes time
Author: NikiG
Date: 06/29/2001 10:45
 
I think that if the CheckType is not off the 
downloading starts after all the links are 
scanned,,,which is madness?also I was pressed to separate the file of 7MB with

the urls to two files and process separately.

I used the fowoling configuration, any sugestions?
Near=0
Test=0
ParseAll=0
HTMLFirst=0
Cache=0
NoRecatch=0
Dos=0
Index=0
Log=1
RemoveTimeout=0
RemoveRateout=0
FollowRobotsTxt=0
NoErrorPages=1
NoExternalPages=1
NoPurgeOldFiles=0
Cookies=1
CheckType=0
ParseJava=0
HTTP10=0
TolerantRequests=0
UpdateHack=1
StoreAllInCache=0
LogType=0
UseHTTPProxyForFTP=1
Build=14
PrimaryScan=1
Travel=1
GlobalTravel=0
BuildString=%%h/%%M
MaxHtml=1024
MaxOther=1024
MaxAll=
Sockets=
Retry=
MaxTime=
TimeOut=30
RateOut=
UserID=Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 
98)
Footer=(none)
MaxRate=
WildCardFilters=+*.txt
Proxy=proxy.netvalue.fr
Port=8000
Depth=0
MaxConn=
CurrentUrl=
CurrentAction=0
CurrentURLList=D:\WORK\Test for The Big test\final 
extracts\crawlded\2.txt
 
Reply Create subthread


All articles

Subject Author Date
loading the list in memory takes time

06/28/2001 15:28
Re: loading the list in memory takes time

06/29/2001 08:42
Re: loading the list in memory takes time

06/29/2001 10:45
Re: loading the list in memory takes time

06/29/2001 10:49
Re: loading the list in memory takes time

06/29/2001 22:51
Re: loading the list in memory takes time

06/29/2001 22:53




2

Created with FORUM 2.0.11