| Subject: Re: Failure in seemingly simple site |
Author: wellsilver |
Date: 07/17/2021 00:33 |
| | A small addon, robots.txt helps search engines so on smaller sites its possible
for robots.txt to not exist thus requireing the option to be disabled. HTTRACK
should just spit out an error instead of completely stopping the archive. | |
|
|
|
|
0
Created with FORUM 2.0.11
