HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Failure in seemingly simple site
Author: wellsilver
Date: 07/17/2021 00:33
 
A small addon, robots.txt helps search engines so on smaller sites its possible
for robots.txt to not exist thus requireing the option to be disabled. HTTRACK
should just spit out an error instead of completely stopping the archive.
 
Reply Create subthread


All articles

Subject Author Date
Re: Failure in seemingly simple site

07/17/2021 00:31
Re: Failure in seemingly simple site

07/17/2021 00:33




0

Created with FORUM 2.0.11