HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Just a suggestion
Author: Xavier Roche
Date: 04/08/2001 13:54
 
> We use httrack to mirror 2000+ sites and then uses 
> Microsoft Index Service to make search available on 
> our site. 20% of our sites never gets mirrored 
because 
> of redirects. Our problem is that the URLs are 

Well, follow redirects is implemented, BUT only if you 
authorize the "followed" links. Example: if 
www.foo.com redirects to www.bar.com, add the filter 
rule +www.bar.com/*, for example.

Only non html files are "followed" due to security 
reasons (a redirect may cause a mirroring of a 
complete website due to other default parameters)
 
Reply Create subthread


All articles

Subject Author Date
Just a suggestion

04/07/2001 14:12
Re: Just a suggestion

04/08/2001 13:54




3

Created with FORUM 2.0.11