| Subject: Re: Can't grab the site |
Author: William Roeder |
Date: 05/28/2012 17:10 |
| | > it goes well until writing about 7000 files but then
> httrack goes super slow and get 1 file per 3
> minutes.
>
> is this a site problem or httrack?HTTrack doesn't get slow.
You already overrode robots.txt. Did you read
<http://www.httrack.com/html/abuse.html#USERS>
Sounds like a anti-DOS measure | |
|
|
|
|
5
Created with FORUM 2.0.11