I asked the program to go down only one level on external links but it seems to
think that means to collect everything at one level at any site to which there
is a link. If I link to one file on Amazon.com the program downloads thousands
of documents! Unless there is a solution to this problem, I will abandon the
project. Am I doing something wrong or is the program just poorly designed?
You can't even make it skip whole sites when something gets out of hand, just
individual files of which there are thousands as Amazon.