| dear all, just want to clarify, given a starting of url
services.abc.xyz.co.uk
in the expert options, is my interpretation correct for:
1. stay on the same address:
pages with services.abc.xyz.co.uk/* will be crawled
2. stay on the same domain:
pages with *.abc.xyz.co.uk/* will be crawled
3. stay on the top level domain
pages with *.uk/* will be crawled
4. everywhere
no limitation on the url.
please correct me if i am wrong.
by the way, will url starting with https:// be downloaded?thx!!
| |