HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: How to enable direct file writing, prb with -E opt
Author: Spencer
Date: 03/07/2006 15:34
 
Hi Robert,

I found a solution that works for me but requires a hack to the source code.
In httrack version 3.40.1, in src/htsback.c, I have changed lines 3357 to 3361
from:

    if (opt->errlog) {
      fprintf(opt->errlog,"More than %d seconds passed.. giving
up"LF,opt->maxtime);
      test_flush;
    } 
    return 0;

to:

    if (opt->errlog && opt->state.stop!=1) {
      fprintf(opt->errlog,"More than %d seconds passed..
interrupting"LF,opt->maxtime);
      opt->state.stop=1; /* Interrupt instead of quit! */
    }
    return 1; /* And keep going until all pending has completed */

I have to run with -X0 set so as not to purge deleted files. Otherwise it will
delete files from a previous crawl if it didn't have time to find them in the
current crawl.

To Xavier, please correct me if you think my changes are wrong. If you
understand what I mean, could a similar change be made to the product please?
Perhaps using an extra command line option that sets state.stop to 1 instead
of quitting abruptly?
Many Thanks
Spencer

 
Reply Create subthread


All articles

Subject Author Date
How to enable direct file writing, prb with -E opt

02/24/2006 12:53
Re: How to enable direct file writing, prb with -E opt

03/07/2006 13:08
Re: How to enable direct file writing, prb with -E

03/07/2006 13:47
Re: How to enable direct file writing, prb with -E opt

03/07/2006 15:34
Re: How to enable direct file writing, prb with -E

03/07/2006 23:43
Re: How to enable direct file writing, prb with -E

08/13/2006 16:02
Re: How to enable direct file writing, prb with -E

05/15/2007 19:40




5

Created with FORUM 2.0.11