| Subject: Re: How to get rid of anti-robots protection |
Author: Silvia |
Date: 05/02/2019 07:35 |
| | use httrack options to ignore the robots.txt
when you start one project, you can see the options setting page. There is one
option "get the web-pages even forbidden" which is unchecked. Checked this
option then you can success.
| |
|
|
|
|
0
Created with FORUM 2.0.11