HTTrack Website Copier
Free software offline browser - FORUM
Subject: How to capture a list that grows when you scroll
Author: JimG
Date: 02/26/2014 05:47
 
I'm trying to archive a blog page which lists articles in chrono reverse order.
It shows the most recent 50. However, whenever you scroll down near the end of
the page, it automatically refreshes with an additional 50 or so additional
items (the displayed list becomes longer).

My problem is, when I try to copy the page with HTTrack, I have no way to
"scroll" and trigger this behavior. I always get just the first 50 list-items.
I need about the first 100 or so, so I need to scroll at least once.

And a further wrinkle: in Chrome, when I do view source, I can see the first
50 items, but even after scrolling, when more items have become visible, and I
do view source, I see only the first 50 in the source. So I have no idea how
the extra items are getting onto the screen, and even if I figured out how to
simulate a scroll, it's not clear that the extra items would be captured by
HTTrack.

Can anyone suggest an approach, or explain how this site's behavior is
triggered and works. Is there a standard name for automatically-self-extending
lists like this?
TIA/jim
 
Reply


All articles

Subject Author Date
How to capture a list that grows when you scroll

02/26/2014 05:47
Re: How to capture a list that grows when you scroll

01/13/2019 14:43
Re: How to capture a list that grows when you scroll

01/21/2020 04:07




1

Created with FORUM 2.0.11