| > Q: Is it possible only scan website but ONLY to know how
> many files should I download and how big is the 'tree'?> When I know I can
make special filtering by download!
Err, actually no. You can scan the complete html structure
without getting data, but unless you make (at least HEAD)
requests for EACH non-html file, you won't get the size of
the site. And checking eack file size can be as long as
downloading the whole site. (Not to mention servers that
will not fufill HEAD requests correctly and will return
zero size conent-length)
| |