The first thing you might try is NOT to follow the rules in 
the robots.txt file on the server.  This file may exclude 
your browser, which you identify as httracker.  I remove 
the identification of httracker (just leave it blank) and 
specify not to follow robots.txt.

You'll find the robots under the "Spider" tab in the GUI 
and the browser id under "BrowserID."  If you're using 
command line, set s0 and don't use -F (or try -F "").

Cheers.