HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Why do you allow robots.txt to be overriden?
Author: Steve
Date: 12/25/2006 19:24
 
1.) When you put it out there, it's out there.

2.) If you didn't want it out there, you should have never put it out there in
the first place.

Try to enforce the copyright law on websites. You're tilting at windmills.
It's 100% futile. Give it up.
 
Reply Create subthread


All articles

Subject Author Date
Why do you allow robots.txt to be overriden?

12/27/2005 21:13
Re: Why do you allow robots.txt to be overriden?

12/27/2005 22:00
Re: Why do you allow robots.txt to be overriden?

12/27/2005 22:39
Re: Why do you allow robots.txt to be overriden?

12/28/2005 00:47
Re: Why do you allow robots.txt to be overriden?

12/30/2005 11:18
Re: Why do you allow robots.txt to be overriden?

01/13/2006 12:23
Re: Why do you allow robots.txt to be overriden?

12/25/2006 19:24
Re: Why do you allow robots.txt to be overriden?

06/26/2007 19:49
Re: Why do you allow robots.txt to be overriden?

04/04/2010 08:06




e

Created with FORUM 2.0.11