No, sadly not. I wrote to the Wayback Machine, which also uses web crawlers,
and they said they are having the same issue...