| > know how to retrieve the contents of
> <http://web.archive.org/web/20060318161616/www.langua>
> ge-museum.com so that all of the files are stored on
Looking at <http://web.archive.org/robots.txt> you'll see that /web/ is
included, so by default, httrack gets nothing.
Override robots.txt option. | |