| Subject: Re: about staying in same address / domain |
Author: William Roeder |
Date: 10/14/2010 15:59 |
| | > in the expert options, is my interpretation correct
> 1. stay on the same address:
> pages with services.abc.xyz.co.uk/* will be crawled
in the absence of enabling filters
without the near flag (get non-html related)
> by the way, will url starting with https:// be
> downloaded?only if it doesn't require a login
| |
|
|
|
|
f
Created with FORUM 2.0.11