HTTrack Website Copier
Free software offline browser - FORUM
Subject: crawling order
Author: David Stevenson
Date: 08/09/2002 21:46
When httrack pulls the first file, does it then traverse 
the tree on the web site visiting all the top level links 
first, then second level links, or does it follow all the 
way down the tree first until it reaches the boundary of 
the site, then comes back up one level.

A would like to know whether downloading a site using a 
size limit will take the top level (more important) info 
first or not?
Many thanks
David Stevenson

All articles

Subject Author Date
crawling order

08/09/2002 21:46
Re: crawling order

08/09/2002 22:21


Created with FORUM 2.0.11