set options/Spider/Spider select there,
but don't forget to limit bandwith usage,
number of connections, max tranfer rate
and try to limit the downloads to what you need by setting
scan rules
in order to be "gentle" with the site server.
robots.txt are there for good reasons