| Hi Guys,
I want to copy a blogger site from the wayback machine. For reasons of his
own, the author has taken down the site econimica.blogspot.com. Almost all of
the data is available from this site:
<https://web.archive.org/web/*/https://econimica.blogspot.com/>*
these articles are scattered among more than 1000 links from about 100 crawls.
It looks like most of the links are redundant and only cover comments. I want
to make a consistent copy that aggregates all of the data without including
redundant data. What is the best way to do this? | |