1) Always post the command line used (or log file line two) so we know what the
site is, what your settings are, etc.
2) Always post the URLs you're not getting and from what URL.
3) Always post anything USEFUL from the log file.
4) If you want everything use the near flag (get non-html files related) not
filters.

> <http://forums.station.sony.com/eq>
Browser auto forwards to
<http://forums.station.sony.com/eq/forums/list.m>

which contains meta name="robots" content="nofollow"

Override robots.txt