| Subject: Re: Crawl pages only at n depth |
Author: William Roeder |
Date: 04/03/2012 17:24 |
| | > Is it possible to download pages at the nth depth?If you have all the urls -
yes.
Otherwise you must let it spider the site at depth 1-(n-1) to get them. | |
|
|
|
|
9
Created with FORUM 2.0.11