The deadlock when scanning certain robots.txt files has 
been fixed. The patch will be merged for RC5. 

Note to all HTTrack users: if you still encounter 
reproductible crashes with RC4, do not hesitate to report 
them.