HTTrack Website Copier
Free software offline browser - FORUM
Subject: files from Amazon S3 with AWSAccessKeyID
Author: Dominique
Date: 06/27/2017 14:14
 
Hi,

I have an issue with files stored on Amazon S3.

These files do have an AWSAccessKeyID that changes every time the file is
accessed.

As the website I am mirroring has multiple links to the same files, every time
HTTracker accesses these files it creates doubles/triples or more of the exact
same image/video but with different names.

Is there any way to tell HTTracker to only access a same link once?
The links look like this:

<http://view.xxx.com/model-portfolio.aspx?tbd=Yd74d5Y47Y7d7dd4&fromemail=&packagesentid=11036584&linkback=3&modelid=1187238&agencyid=10070&userid=-1&packageid=8569403&packagelineid=94412553&subid=0&mainsubid=0&a=1>

and for example an image file would look like this:

<http://assets.xxx.com/images/10070/1187238/Large/002.jpg?AWSAccessKeyId=AKIAIDGMRCKCBVQJOT7A&Expires=1498568177&Signature=djX4mznFAeDYOfT%2FwTZh%2FMWP%2FR0%3D>

where the accessKeyID changes every time the page is accessed.

Thank you in advance for any useful information.
 
Reply


All articles

Subject Author Date
files from Amazon S3 with AWSAccessKeyID 06/27/2017 14:14




e

Created with FORUM 2.0.11