Changing the spider options to 'no rules' does not change the behavior.