| Subject: Re: Cannot copy site |
Author: William Roeder |
Date: 06/26/2007 03:57 |
| | > I want to download the site for articles, but cannot
> due to some robot msg. How can I download it? How
> can override any setting ...:
options -> spider -> spider= no robot.txt rules | |
|
|
|
|
1
Created with FORUM 2.0.11
