Hello! After studying the cache format docs I got to thinking... is it
necessary for the cache zip file to store data+metadata?What about
externalizing the data in a (renamed) file and just storing
original-url-string, saved-file-name, MD5/SHA-1?File versioning is still
possible I think by assigning different names to each version of a file. The
zip would be MUCH smaller and faster to (re)process, and you would avoid a
duplicate copy of the data. The last mirror I made totaled over 1GiB, 50%
cache.
I hope you find this suggestion useful. Thank you anyway for this nifty
program!