| > OK. But can I make some way to download them. Maybe
> change some settings and make it work?
Options >> Spider >> Spider: "no robots.txt rules"
Just remember that robots.txt is usually in place to prevent massive amounts
of bandwidth usage and the like, so treat them with respect and set reasonable
limits (Options >> Limits) like low speed and low connections. | |