is it possible to get a raw listing of files that are NOT 
linked in any html page using your software? example:
I have docs.zip on my site (personal except for those I 
share with) like this:

www.mysite.com/docs.zip

but there isn't a link in my html files to this. can this 
still be grabbed or listed?