HTTrack Website Copier
Free software offline browser - FORUM
Subject: HTTrack vs webmasters
Author: Renardrouge
Date: 01/27/2003 14:03
 
Use "robots.txt" file
Good: Easy to setup
Bad: Easy to override
How to do: Create a robots.txt file on top dir, with proper 
parameters
Example:
    User-agent: *
    Disallow: /bigfolder

===> Bad: Easy to override

Yes it's very easy with YOUR great tool.
You made it easy.

You made httrack, gnu / open source blabla bla.
And at the same time, you don't respect the basis of the 
robots.txt file ?
So...

>> but not webmaster's suggestions, victims
>> of your so wonderfull product!

>Yes I do. See various remarks at 
>http://www.httrack.com/html/abuse.html

Yes you do ?When ?Where ?Are you joking ?These page is useless to stop YOUR
great tool. Hypocrisy.
 
Reply Create subthread


All articles

Subject Author Date
HTTrack vs JOC Webspider

01/25/2003 15:30
Re: HTTrack vs JOC Webspider

01/25/2003 22:38
Re: HTTrack vs JOC Webspider

01/26/2003 08:59
Re: HTTrack vs JOC Webspider

01/26/2003 14:50
HTTrack vs webmasters

01/27/2003 14:03
Re: HTTrack vs webmasters

01/27/2003 19:10
Re: HTTrack vs webmasters

01/27/2003 21:45
Re: HTTrack vs webmasters

01/27/2003 22:46
Re: HTTrack vs webmasters

01/27/2003 23:03
Re: HTTrack vs webmasters

01/27/2003 23:22
Re: HTTrack vs webmasters

01/27/2003 23:31
Re: HTTrack vs webmasters

01/28/2003 07:23
Re: HTTrack vs webmasters

01/28/2003 22:12
Re: HTTrack vs webmasters

04/14/2005 19:22




6

Created with FORUM 2.0.11