> I want to download the site for articles, but cannot
> due to some robot msg. How can I download it? How
> can override any setting ...:

options -> spider -> spider= no robot.txt rules