HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: File scanning
Author: Xavier Roche
Date: 01/13/2004 19:58
> Q: Is it possible only scan website but ONLY to know how 
> many files should I download and how big is the 'tree'?> When I know I can
make special filtering by download!

Err, actually no. You can scan the complete html structure 
without getting data, but unless you make (at least HEAD) 
requests for EACH non-html file, you won't get the size of 
the site. And checking eack file size can be as long as 
downloading the whole site. (Not to mention servers that 
will not fufill HEAD requests correctly and will return 
zero size conent-length)

Reply Create subthread

All articles

Subject Author Date
File scanning

01/13/2004 11:40
Re: File scanning

01/13/2004 19:58


Created with FORUM 2.0.11