HTTrack Website Copier
Free software offline browser - FORUM
Subject: 100,000+ files wiped after finished mirroring
Author: Cosmo
Date: 08/15/2020 16:51
 
So I was working on archiving a site and, using WinHTTrack, downloaded 109,049
files. WinHTTrack claimed it had completed the mirroring, so I closed it and
went to bed. The next day I checked the folder and there are only 79 files,
all temporary.

The cache contains the first 99,996 files, but the other ~9,000 are missing.

Checking the log indicates that WinHTTrack has a limit of 100,000 files and
that it gave up because there were too many. But if that is the case, I have
several questions about the design of WinHTTrack:
- Why did WinHTTrack claim the download had completed successfully when it
clearly had not?- Why did WinHTTrack allow me to create a file listing
containing more than 100,000 files in the first place?- Why did WinHTTrack
delete the files already there instead of creating a partial mirror if it hit
the file limit?
Thanks in advance,

Starfrost
 
Reply


All articles

Subject Author Date
100,000+ files wiped after finished mirroring

08/15/2020 16:51
Re: 100,000+ files wiped after finished mirroring

08/26/2020 01:23
Re: 100,000+ files wiped after finished mirroring

08/26/2020 01:26




3

Created with FORUM 2.0.11