| Subject: Re: problem with html |
Author: William Roeder |
Date: 05/03/2010 16:51 |
| | > i have a problem in the moment that i retrieve the
> page, an example of page is similar that the next
> url <http://es.wikipedia.org/wiki/Peru>
1) always post the actual command used (log file line 2) so we know exactly
what you DID do, as opposed to what you THINK you did.
> first use scan rules but then i delete all for test
2) Unless you are trying to restrict the mirror to a portion, don't use scan
rules, just the near flag (get non-html related)
3) I always run with no external pages=checked so you know where the mirror
ends
4) What does the log file say about robots.txt | |
|
|
|
|
a
Created with FORUM 2.0.11