| Hi Robert,
I found a solution that works for me but requires a hack to the source code.
In httrack version 3.40.1, in src/htsback.c, I have changed lines 3357 to 3361
from:
if (opt->errlog) {
fprintf(opt->errlog,"More than %d seconds passed.. giving
up"LF,opt->maxtime);
test_flush;
}
return 0;
to:
if (opt->errlog && opt->state.stop!=1) {
fprintf(opt->errlog,"More than %d seconds passed..
interrupting"LF,opt->maxtime);
opt->state.stop=1; /* Interrupt instead of quit! */
}
return 1; /* And keep going until all pending has completed */
I have to run with -X0 set so as not to purge deleted files. Otherwise it will
delete files from a previous crawl if it didn't have time to find them in the
current crawl.
To Xavier, please correct me if you think my changes are wrong. If you
understand what I mean, could a similar change be made to the product please?
Perhaps using an extra command line option that sets state.stop to 1 instead
of quitting abruptly?
Many Thanks
Spencer
| |