| > i have a problem in the moment that i retrieve the
> page, an example of page is similar that the next
> url <http://es.wikipedia.org/wiki/Peru>
1) always post the actual command used (log file line 2) so we know exactly
what you DID do, as opposed to what you THINK you did.
> first use scan rules but then i delete all for test
2) Unless you are trying to restrict the mirror to a portion, don't use scan
rules, just the near flag (get non-html related)
3) I always run with no external pages=checked so you know where the mirror
ends
4) What does the log file say about robots.txt | |