| > i have tried to download w3schools.com on various systems
> but unable to do that.
> ..
> robots.txt rules, links begining with these path will be
>
forbidden: /quiztest, /banners, /images, /ado/demo_db_edit.a
> sp, /html/tryit.asp, /css/tryit.asp (see in the options
to
> disable this)
There are remote robots.txt rules that prevent you from
downloading the site. If you disable them, please use lower
bandwidth settings first (2 connections, and a maximum of
5000B/s is pretty reasonnable for slow sites)
| |