HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: only index page downloaded
Author: Xavier Roche
Date: 06/01/2003 17:50
 
> why is it that some sites when try to be copied from 
> httrack, permit only the first, index page to be copied. 
> not the whole site. example.www.bnf.org i have tried it 
> but failed. 

Note that some folders won't be downloaded by default, 
because of robots.txt rules:

17:46:58 Info:  Note: due to www.bnf.org remote robots.txt 
rules, links begining with these path will be 
forbidden: /navButtons, /navSecondMenu, /templates, /Library
, /images, /scripts (see in the options to disable this)

If you still have troubles, try to use the 3.30 pre-
release ; some problems were reported with "bad keep-alive" 
sites.

As far as I can see (115 links downloaded yet), this site 
seems to be okay with 3.30RC1.
 
Reply Create subthread


All articles

Subject Author Date
only index page downloaded

06/01/2003 12:36
Re: only index page downloaded

06/01/2003 17:50
Re: only index page downloaded

10/28/2003 12:59
Re: only index page downloaded

04/12/2015 00:43




4

Created with FORUM 2.0.11