| > Looking at the help file in the HTtrack program, I do
> not believe Xavier will ever modify the program to
make
> it suitable for use websites that specifics bans
> offline browsers such as HTtrack...
That's right - See related talks
(http://www.httrack.com/HelpHtml/abuse.html#WEBMASTERS)
and advice to avoid offline browsers.
If webmasters don't want their pages to be crawled,
it's up to them.
| |