HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: download total web site
Author: BilAl
Date: 02/18/2009 14:34
 
> > I am trying to download a total web site and then
> > line.  I can not figure out how to set the
> software
> > up to do this.  The site I am trying to download
> is
> > www.peopleflo.com.  I would very much appreciate
> 
> You don't state what version, what settings, what
> the log says,  nor what the problem is. So your not
> likely to get any help.
> 
> But the robots.txt for the site you mention is:
> User-agent: * 
> Disallow: /administrator/
> Disallow: /cache/
> Disallow: /components/
> ...
> 
> So for a "total web site" your going to have to
> ignore robots.txt (options -> Spider)

 
Reply Create subthread


All articles

Subject Author Date
download total web site

07/28/2008 21:19
Re: download total web site

07/28/2008 21:36
Re: download total web site

07/28/2008 22:18
Re: download total web site

07/28/2008 23:25
Re: download total web site

07/29/2008 00:05
Re: download total web site

07/29/2008 05:17
Re: download total web site

07/29/2008 15:14
Re: download total web site

07/29/2008 18:29
Re: download total web site

07/29/2008 20:02
Re: download total web site

07/29/2008 21:11
Re: download total web site

07/29/2008 22:21
Re: download total web site

07/29/2008 22:24
Re: download total web site

07/30/2008 01:55
Re: download total web site

07/30/2008 03:27
Re: download total web site

07/30/2008 21:01
Re: download total web site

02/18/2009 14:34
Re: download total web site

04/10/2009 15:14




5

Created with FORUM 2.0.11