| > We use httrack to mirror 2000+ sites and then uses
> Microsoft Index Service to make search available on
> our site. 20% of our sites never gets mirrored
because
> of redirects. Our problem is that the URLs are
Well, follow redirects is implemented, BUT only if you
authorize the "followed" links. Example: if
www.foo.com redirects to www.bar.com, add the filter
rule +www.bar.com/*, for example.
Only non html files are "followed" due to security
reasons (a redirect may cause a mirroring of a
complete website due to other default parameters)
| |