Ls,

Is it possible that Httrack checks the mime-type in the http-response header
before downloading (through Content-Type:) and allow / disallows the download
for certain mime-types? This because from a lot of dynamic websites you can
not predict what the mime-type is based on the URL / extension.

In my case if have to scan more then 800.000 pages spread over 250 domains
(intranet environment). Lot of these domains are dynamic websites and contain
no indexable / readable content which I preffer not to download...

Thanks.

Richard