> Hiding behind a technical document? Nice. At the end
Don't blame the messenger. I'm just a user.

> software does more bad than good. Let me ask you
> this, what % of people who use a web scraping
> software is doing it for legitimately and legal
> reasons?
I would say 99.999% 

Most want to study a site while not on line. Some want to search for what they
want but the online search function is lacking.  Others want to see how a site
is set up, so they learn to do it them selves. Until recently, I used dial-up.
Waiting 2+ minutes for pages to load won't cut it. There are many different
legitimate reasons.

I pointed you to a page that explained it. If you don't want people to peruse
your content, you shouldn't have made it public.

Here are 2 other threads that you might find enlightening:
<http://forum.httrack.com/readmsg/14951/index.html>
<http://forum.httrack.com/readmsg/12525/index.html>