| > > I am trying to download a total web site and then
> > line. I can not figure out how to set the
> software
> > up to do this. The site I am trying to download
> is
> > www.peopleflo.com. I would very much appreciate
>
> You don't state what version, what settings, what
> the log says, nor what the problem is. So your not
> likely to get any help.
>
> But the robots.txt for the site you mention is:
> User-agent: *
> Disallow: /administrator/
> Disallow: /cache/
> Disallow: /components/
> ...
>
> So for a "total web site" your going to have to
> ignore robots.txt (options -> Spider)
| |