HTTrack Website Copier
Free software offline browser - FORUM
Subject: HTML Error 429 Too Many Requests
Author: David Abrames
Date: 04/05/2022 23:03
 
I am trying to download a website's documentation.

But when I do I get 118 errors on some pages "429 Too Many Requests"

From the log I choose one of the pages and I was able to get the page no
problem and as best that I can determine this site is all HTML.

I decided to try and get only the pages that failed by using the URL List File
option but when I can that project it just started downloading all of the
pages again but this time with a different set of pages with the error "429
Too Many Requests"

I have not been able to figure out how I need to configure the project so I
only get the pages that failed the first time.

From the behavior that I am seeing it looks like the server really is limiting
HTTrack after so many requests.

So would changing the speed or number of connections correct this situation?
My other option of using the URL List File option but so far I have not been
able to get it to work.

I tried searching this forum for help but have not been able to find anything
that helps.

I would appreciate some guidance on this problem I am having.

Thank you

David
 
Reply


All articles

Subject Author Date
HTML Error 429 Too Many Requests

04/05/2022 23:03




6

Created with FORUM 2.0.11