> I am after downloading <http://www.lloyds.com/> but
> the quality is poor for the website. There is some
> robots.txt exclusion rules alright but it is still
> downloading 40 MB of links. There is only 81 links
> downloaded. Thats low. Why is that ?
Everything you see on the front page is one, giant form. Httrack does not
click on forms.