HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Too many URLs, giving up..(>100000)
Author: Bill Sargent
Date: 07/29/2021 21:22
 
> I find such restrictions IDIOTIC - to say the least.
> This piece of idiocy code interrupted my download in
> the middle of mirroring some 50000+ papers,
> including their .bib files. Who are you to tell me
> when to stop?> 
> Now I restarted it by adding -#L9999999 - how
> idiotic is that? Does it mean it have to stop at 10
> million files, but 9,999,999 are OK?> 
> I find such artificial restrictions absolutely
> stupid. PLEASE remove them ASAP! I know what I am
> doing, I don't need you to protect me!

This is to protect servers from people like yourself who can use the tool even
unknowingly, in abusive ways, and cause servers that aren't well equipped for
aggressive site ripping, from becoming overburdened. It also keeps you from
ending up blocked from a website for doing aggressive things. It's meant
entirely for people like yourself who don't understand why the limit exists in
the first place. And well, its also pretty easy to override if you do "know
what you are doing". However I think you don't know, since you dont know the
reason it was implemented in the first place.

Also, the limit is in place to keep the program from chowing down on all the
ram and breaking the site rip. If httrack were to crash due to memory
problems, it could potentially damage your cache data that you're ripping and
cause it to not unrecoverable. 

Please try to think logically, rather than have temper tantrums about things
you know nothing about.
 
Reply Create subthread


All articles

Subject Author Date
Too many URLs, giving up..(>100000)

05/22/2001 10:33
Re: Too many URLs, giving up..(>100000)

05/22/2001 11:01
Re: Too many URLs, giving up..(>100000)

01/29/2010 11:05
Re: Too many URLs, giving up..(>100000)

04/18/2015 09:44
Re: Too many URLs, giving up..(>100000)

03/08/2019 13:09
Re: Too many URLs, giving up..(>100000)

06/01/2019 22:21
Re: Too many URLs, giving up..(>100000)

07/14/2019 02:26
Re: Too many URLs, giving up..(>100000)

08/25/2019 21:37
Re: Too many URLs, giving up..(>100000)

02/07/2020 18:41
Re: Too many URLs, giving up..(>100000)

02/28/2020 18:21
Re: Too many URLs, giving up..(>100000)

05/19/2020 03:49
Re: Too many URLs, giving up..(>100000)

11/06/2020 21:09
Re: Too many URLs, giving up..(>100000)

11/29/2020 21:37
Re: Too many URLs, giving up..(>100000)

06/19/2021 10:17
Re: Too many URLs, giving up..(>100000)

06/19/2021 10:19
Re: Too many URLs, giving up..(>100000)

06/28/2021 14:17
Re: Too many URLs, giving up..(>100000)

07/29/2021 21:22
Re: Too many URLs, giving up..(>100000)

07/31/2023 13:29
Re: Too many URLs, giving up..(>100000)

09/14/2023 01:41




f

Created with FORUM 2.0.11