| I'm trying to have this spider my entire site. I enter the url, but it only
downloads the url I enter... it doesn't scan the url and traverse links like a
spider should.
So I'm expecting it to spider the entire site and download, but it is only
downloading the explicit url I enter. | |