HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Too many URLs, giving up..(>100000)
Author: John
Date: 09/14/2023 01:41
 
Hello from 2023, 22 years! from original posting.

> This is to protect servers from people like yourself who can use the tool
even
unknowingly, in abusive ways,

I am using HTTTrack for the first time.
I was running HTTTrack against my internal LANsite to create a cache and your
software stopped with "Too many URLs, giving up..(>100000)" error.

Sorry, but this restriction is just stupid. If you are afraid of malicious
user using your software why not just show big fat warning before
crawling?Just remove the limit and add this warning.

-----
WARNING!

You are going to crawl website(s) you specified.
Unless you have a permission to crawl target contents
you are forced to obey laws.

Are you really sure you want to continue?
[ YES (10 second timelock) ] [ NO ]
-----

 
Reply Create subthread


All articles

Subject Author Date
Too many URLs, giving up..(>100000)

05/22/2001 10:33
Re: Too many URLs, giving up..(>100000)

05/22/2001 11:01
Re: Too many URLs, giving up..(>100000)

01/29/2010 11:05
Re: Too many URLs, giving up..(>100000)

04/18/2015 09:44
Re: Too many URLs, giving up..(>100000)

03/08/2019 13:09
Re: Too many URLs, giving up..(>100000)

06/01/2019 22:21
Re: Too many URLs, giving up..(>100000)

07/14/2019 02:26
Re: Too many URLs, giving up..(>100000)

08/25/2019 21:37
Re: Too many URLs, giving up..(>100000)

02/07/2020 18:41
Re: Too many URLs, giving up..(>100000)

02/28/2020 18:21
Re: Too many URLs, giving up..(>100000)

05/19/2020 03:49
Re: Too many URLs, giving up..(>100000)

11/06/2020 21:09
Re: Too many URLs, giving up..(>100000)

11/29/2020 21:37
Re: Too many URLs, giving up..(>100000)

06/19/2021 10:17
Re: Too many URLs, giving up..(>100000)

06/19/2021 10:19
Re: Too many URLs, giving up..(>100000)

06/28/2021 14:17
Re: Too many URLs, giving up..(>100000)

07/29/2021 21:22
Re: Too many URLs, giving up..(>100000)

07/31/2023 13:29
Re: Too many URLs, giving up..(>100000)

09/14/2023 01:41




5

Created with FORUM 2.0.11