Can anyone tell me why the following site causes WinHTTrack 
to crash? www.csfb.co.nz When Win HTTrack tries to 
find/access robots.txt the programme stops working. How can 
I stop HTTrack from going anywhere near this site? I've 
set 'No external pages' in the options and -
www.csfb.co.nz/* in the scan rules. Why is HTTrack going 
near the site at all? Is it falling over on the parsing? 
This happened in RC1, 2 and 3. Any help much appreciated, 
dnt