website using ajax. Why not use the browser to load page and cache instead of a
user agent or in addition. A simple browser or system env to chrome could
scrap the links when loaded that might work? Does httrack have this or plan on
adding this at leisure.