| I've tried setting external links to 0, but this does not help.
What I want to tell it to do is grab something like this:
website.com/subdir1/subdir2
And it will get pages from only "website.com/subdir1/subdir2" and below. That
means if a link is on a page in subdir2 that points to a page subdir1 that it
does NOT get that page. Does this make sense? Is there a way to configure it
to do this? | |