> 1 - the program returns an error saying robot.txt
options -> spider -> spider

> 2 - I can't get it to grab the files on other sites
> that host .exe's such as sourceforge.net.
options -> links -> get non-html