HTTrack Website Copier
Free software offline browser - FORUM
Subject: HTTrack only retrieving a limited number of pages
Author: Garrett Lynch
Date: 06/24/2014 23:23
 
Hi

I'm trying to use HTTrack on OSX through Vine to download a reference website,
a dictionary essentially, for offline reference in some academic research
(i.e. non-profit etc.).  I've got it working without any problems and it seems
to download the site but not all of it.

The site seems to have about 3807 pages and I get less than 83.  The pages
that download all seem to work, the site uses an aspx query structure like
so:
entry.aspx?entry=0001

which HTTrack maps to html pages like so:
entry01bb.html

So that part is working.  What could ause it to stop after a certain number of
pages?  Is there a log somewhere that might give me a clue?  If this is
something site side (robots.txt perhaps) to stop excessive retrieval of pages
is there a way to run HTTrack several times and only retrieve pages it has not
retrieved before?
Any suggestions much appreciated.

regards
Garrett
 
Reply


All articles

Subject Author Date
HTTrack only retrieving a limited number of pages

06/24/2014 23:23




7

Created with FORUM 2.0.11