| Subject: Re: Protection other than robots.txt ? |
Author: D_A |
Date: 03/04/2006 18:09 |
| | Changing the browser user agent seems to solve the problem.
I could download all the subdirectories (not to overload servers, I also use
limits by default -1 connection/second, slow max transfer rate ... it may be
necessary, I didn't test) | |
|
|
|
|
4
Created with FORUM 2.0.11