In the doc they say to set the http 1.0 option in the spider tab. Didn't try myself
Bombaret
V1nce
Created with FORUM 2.0.11