1) Always post the command line used (or log file line two) so we know what the
site is, what your settings are, etc.
2) Always post the URLs you're not getting and from what URL.
3) Always post anything USEFUL from the log file.
4) If you want everything use the near flag (get non-html files related) not
filters.

> This is the part of the site i cant get to copy
> <http://www.digikey.com/catalog/en/search?filters=172>
> 18 .

5) Page contains meta name="robots" content="noindex, follow" so you have to
override robots.

6) All links are absolute, the default is to go down only - you may have to
change experts->travel mode

7) The forms on that page (left side) wont work in the mirror.

8) Some images are stored on media.digikey.com (see #4)