It would be fine, but you cannot list the links if you do not download the html
pages and the external js, css, class and other objects.
And you cannot make a map before all the html files have been completely
parsed.