| | Hi, Apologies for large posting. I notice that RC4 always
crashes on a robots.txt Of course it's a different one
everytime... The latest crash happened on
www.ivu.org/robots.txt but as I said it seems to be a
different robots.txt every time. Cheers, dnt
Below winprofile.ini (Hope this helps)
Near=0
Test=0
ParseAll=1
HTMLFirst=0
Cache=1
NoRecatch=0
Dos=0
Index=1
WordIndex=0
Log=1
RemoveTimeout=0
RemoveRateout=0
FollowRobotsTxt=2
NoErrorPages=0
NoExternalPages=1
NoPwdInPages=0
NoQueryStrings=0
NoPurgeOldFiles=1
Cookies=1
CheckType=1
ParseJava=1
HTTP10=0
TolerantRequests=0
UpdateHack=1
StoreAllInCache=0
LogType=0
UseHTTPProxyForFTP=1
Build=0
PrimaryScan=3
Travel=1
GlobalTravel=0
RewriteLinks=0
BuildString=%%h%%p/%%n%%q.%%t
MaxHtml=
MaxOther=
MaxAll=
MaxWait=
Sockets=3
Retry=
MaxTime=
TimeOut=
RateOut=
UserID=Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
Footer=<!-- Mirrored from %%s%%s by The national Library of
New Zealand using HTTrack
Website Copier/3.x [XR&CO'2002], %%s -->
MaxRate=
WildCardFilters=+*.html* +*.php* +*.asp* +*.png +*.gif
+*.jpg +*.css +*.js -ad.doubleclick.net/*
-*.sitemeter.com/* -www.soapbox.co.nz/* -www.trade-
exchange.co.nz/* -*.msn.com/*
-www.govt.nz/* -*.sitemeter.com/* -
home.nzcity.co.nz/*weather*
-securepurchaseserver.com/* -www.ema.co.nz/*%0d%0a-
www1.asbbank.co.nz/*
-www.oecd.org/* -www.csfb.co.nz/* -*.*.com/* +*
[name].www.liveupdated.com/*
-*.hitwise.co.nz/* -www.aynrand.org/*%0d%0a-
www.stuff.co.nz/* -*.clear.net.nz/*
-www.cpalliance.net/* -www.propertystuff.co.nz/* -
www.*.govt.nz/* -ak.planet.gen.nz/*
-www.piperpat.co.nz/* -www.oneworld.org/* -
www.monthlyreview.org/* -home.clara.net/*
-www.edfac.usyd.edu.au/*
Proxy=
Port=
Depth=
ExtDepth=
MaxConn=
MaxLinks=
MIMEDefsExt1=php3,php,php2,asp,jsp,pl,cfm
MIMEDefsExt2=
MIMEDefsExt3=
MIMEDefsExt4=
MIMEDefsExt5=
MIMEDefsExt6=
MIMEDefsExt7=
MIMEDefsExt8=
MIMEDefsMime1=text/html
MIMEDefsMime2=
MIMEDefsMime3=
MIMEDefsMime4=
MIMEDefsMime5=
MIMEDefsMime6=
MIMEDefsMime7=
MIMEDefsMime8=
CurrentUrl=
CurrentAction=0
CurrentURLList=C:\Program Files\WinHTTrack\Text script
files\nz political parties.txt
| |
