| I had no problem once I set the URL to
<http://www.moreart4u.de/internet/index.php>
<http://www.moreart4u.de/index.html> has a nasty javascript redirection towards
the online copy of the site.
As for robots.txt, you don't need one ; you can set the Spider option to no
robots.txt rules, but it won't change anything. | |