| > I would like to just crawl the website, not download
> everything, but I don't see how to do this. Can
> anyone advise, please? TIA.
What do you mean by crawling ? Only html (/php etc.) pages ?
Use something like
Scan rules =>
-* +www.yoursite.com/*.html +www.yoursite.com/*.php +www.yoursite.com/*.asp
+www.yoursite.com/*/
| |