| > I don't know why but this option has never worked (in
> but this only gets the index.html and not the images such
> as logo.gif Could somebody shed light on this matter.
.. because robots.txt prevent you from doing that. (and if
you override default robots.txt setings, PLEASE limit the
crawl scope AND bandwidth settings, because mirroring a
search engine is rather dangerous due to scope problems)
| |