HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Is it possible to do a bot/spider/robot download
Author: Xavier Roche
Date: 07/16/2002 07:26
 
> That could be worth implementing, because Blackwidow has
> had that kind of functionality for a rather long time
> now. You can give it a base name + padding mask +
> extension, and it will explore how much you ever want,
> from name0000.zip to name9999.zip .

Humm, yes, but I really don't like such functionalities - 
it can even "allows you to retrieve e-mail..", that is, 
leeching websites for mass-spamming. I know most offline 
browsers allow to leech emails/brute force URLs/use 
multiple proxies to avoid banning, but I don't think I'll 
ever implement one of these "features". I just think such 
features are made to abuse.
 
Reply Create subthread


All articles

Subject Author Date
Is it possible to do a bot/spider/robot download

07/15/2002 21:51
Re: Is it possible to do a bot/spider/robot download

07/15/2002 22:00
Re: Is it possible to do a bot/spider/robot download

07/15/2002 22:36
Re: Is it possible to do a bot/spider/robot download

07/16/2002 06:59
Re: Is it possible to do a bot/spider/robot download

07/16/2002 07:26
Re: Is it possible to do a bot/spider/robot download

07/16/2002 12:01
Re: Is it possible to do a bot/spider/robot download

07/17/2002 00:25
Re: Is it possible to do a bot/spider/robot download

07/17/2002 20:30
Re: Is it possible to do a bot/spider/robot downlo

07/13/2005 16:41
Re: Is it possible to do a bot/spider/robot downlo

07/13/2005 21:51




f

Created with FORUM 2.0.11