> When this programm finds a file called robots.txt
> the download ends immediately without an error.

Options -> Spider -> Spider = no robots.txt rules