| I run a popular source code site that is getting
so overridden by bot copiers like HTTrack, WebCopier,
etc. (users want to download everything---which is
tens of thousands of pages) that they are tying up 3
entire T1's and blocking out normal users of the
site.
I am not a rich corporation...I am just one person,
but I purchased additional T1s out of the meager
profits from the web site and am paying for the rest
out of my own pocket. I want to continue this free
service for the users of the Internet, but if I can't
find a good way to block these bots, I'll have no
choice but to shut the site down.
I am going to implement the IP blocking scheme,
which as Austin explained works to a certain extent.
Can anyone recommend names for server side pattern
recognition products that can stop this problem?
Also, if anyone has any recommendations for IP
blocking software as well, it would be appreciated.
I'm running IIS on Windows 2000.
Ian
| |