HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Not Downloading Pages, Linking to Web Pages
Author: William Roeder
Date: 01/16/2010 23:18
 
> There is an error message about not downloading sub
> pages due to robots.txt, then refers me to options,
> but I find no options similar.
options -> Spider -> Spider

> The site is downloading, but all the links on the
> page on the local computer are to the website.
Those are probably pages excluded by robots.
I always run with options -> Build -> No error pages = checked so I get a
warning page with unmirrored links.
 
Reply Create subthread


All articles

Subject Author Date
Not Downloading Pages, Linking to Web Pages

01/16/2010 21:51
Re: Not Downloading Pages, Linking to Web Pages

01/16/2010 23:18




c

Created with FORUM 2.0.11