| Subject: Re: How to spider only one path and ignore all oth |
Author: William Roeder |
Date: 11/24/2008 15:17 |
| | > I can see how to exclude individual URLs, but the
> site has so many that I can't feasibly manually type
> all of them.
You're trying -*exclude1* -*exclude2* -*exclude3*...
> Is there a way to only spider one dir but tell it to
> ignore all others?
exclude all except the one you do want:
-* +*accept* | |
|
|
|
|
6
Created with FORUM 2.0.11