Is there any way to store files by their MD5 _and_ somehow keep a table/csv of
the full path to the page and the md5?
I'd like to crawl a content mgmt. system that has crazily long urls.  I'd like
to store the files locally by naming them by their MD5, but I also want to be
able to map from the MD5 back to the original paths.