HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Is it possible to do a bot/spider/robot download
Author: Xavier Roche
Date: 07/17/2002 20:30
 
> It is not designed to be a tool for that.  I would like
> to see HTTrack's respectability maintained.

That's exactly why  I won't implement such feature.. the 
same goes for email grabbing, multiple proxies, and other 
potentially harmful features. It is yet hard to explain to 
users that they should not spider websites using 32 
simultaneous connections when they have a T3 line and the 
website has only a poor connection ; I just don't want to 
see webmasters complaining that they had 1GB of logs during 
a night..
 
Reply Create subthread


All articles

Subject Author Date
Is it possible to do a bot/spider/robot download

07/15/2002 21:51
Re: Is it possible to do a bot/spider/robot download

07/15/2002 22:00
Re: Is it possible to do a bot/spider/robot download

07/15/2002 22:36
Re: Is it possible to do a bot/spider/robot download

07/16/2002 06:59
Re: Is it possible to do a bot/spider/robot download

07/16/2002 07:26
Re: Is it possible to do a bot/spider/robot download

07/16/2002 12:01
Re: Is it possible to do a bot/spider/robot download

07/17/2002 00:25
Re: Is it possible to do a bot/spider/robot download

07/17/2002 20:30
Re: Is it possible to do a bot/spider/robot downlo

07/13/2005 16:41
Re: Is it possible to do a bot/spider/robot downlo

07/13/2005 21:51




0

Created with FORUM 2.0.11