| Use "robots.txt" file
Good: Easy to setup
Bad: Easy to override
How to do: Create a robots.txt file on top dir, with proper
parameters
Example:
User-agent: *
Disallow: /bigfolder
===> Bad: Easy to override
Yes it's very easy with YOUR great tool.
You made it easy.
You made httrack, gnu / open source blabla bla.
And at the same time, you don't respect the basis of the
robots.txt file ?
So...
>> but not webmaster's suggestions, victims
>> of your so wonderfull product!
>Yes I do. See various remarks at
>http://www.httrack.com/html/abuse.html
Yes you do ?When ?Where ?Are you joking ?These page is useless to stop YOUR
great tool. Hypocrisy. | |