| I think that if the CheckType is not off the
downloading starts after all the links are
scanned,,,which is madness?also I was pressed to separate the file of 7MB with
the urls to two files and process separately.
I used the fowoling configuration, any sugestions?
Near=0
Test=0
ParseAll=0
HTMLFirst=0
Cache=0
NoRecatch=0
Dos=0
Index=0
Log=1
RemoveTimeout=0
RemoveRateout=0
FollowRobotsTxt=0
NoErrorPages=1
NoExternalPages=1
NoPurgeOldFiles=0
Cookies=1
CheckType=0
ParseJava=0
HTTP10=0
TolerantRequests=0
UpdateHack=1
StoreAllInCache=0
LogType=0
UseHTTPProxyForFTP=1
Build=14
PrimaryScan=1
Travel=1
GlobalTravel=0
BuildString=%%h/%%M
MaxHtml=1024
MaxOther=1024
MaxAll=
Sockets=
Retry=
MaxTime=
TimeOut=30
RateOut=
UserID=Mozilla/4.5 (compatible; HTTrack 3.0x; Windows
98)
Footer=(none)
MaxRate=
WildCardFilters=+*.txt
Proxy=proxy.netvalue.fr
Port=8000
Depth=0
MaxConn=
CurrentUrl=
CurrentAction=0
CurrentURLList=D:\WORK\Test for The Big test\final
extracts\crawlded\2.txt | |