HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Is it possible to do a bot/spider/robot download
Author: Leto
Date: 07/17/2002 00:25
 
> It cannot get larger like that:
> 000.gif to zzz.gif

Three characters of "zero to z" is something like 46,000 file request
combinations that HTTrack has to send to the server you are trying to get
files from.  If there is only ONE file, say "5c9.gif", then 45,999 file
requests are going to report an error.

Server administrators would get VERY annoyed VERY quickly, and the program
would get blacklisted.

It is not designed to be a tool for that.  I would like to see HTTrack's
respectability maintained.
 
Reply Create subthread


All articles

Subject Author Date
Is it possible to do a bot/spider/robot download

07/15/2002 21:51
Re: Is it possible to do a bot/spider/robot download

07/15/2002 22:00
Re: Is it possible to do a bot/spider/robot download

07/15/2002 22:36
Re: Is it possible to do a bot/spider/robot download

07/16/2002 06:59
Re: Is it possible to do a bot/spider/robot download

07/16/2002 07:26
Re: Is it possible to do a bot/spider/robot download

07/16/2002 12:01
Re: Is it possible to do a bot/spider/robot download

07/17/2002 00:25
Re: Is it possible to do a bot/spider/robot download

07/17/2002 20:30
Re: Is it possible to do a bot/spider/robot downlo

07/13/2005 16:41
Re: Is it possible to do a bot/spider/robot downlo

07/13/2005 21:51




c

Created with FORUM 2.0.11