| How about an option that discontinues the site mirroring
after x amount of "forbidden" replies are received? Several
sites lock out the user for 30+ minutes if they detect
spidering, etc. During this time, some of the sites give
out "dummy" pages that are 1kb in size with nothing on
them. So to Httrack, it completed the mirror, but it simply
downloaded the "forbidden" error pages instead.
Httrack ending the process will allow one to recontinue
where it left off at a later time when the account is
reactivated. | |