> I wonder how I can only get the files within a directory. 
> For example, all files within 
> <http://www.website.com/folder>. All files not in /folder 
are 
> simply ignored.

Set Options / Scan rules:
-* +www.website.com/folder*