HTTrack Website Copier
Free software offline browser - FORUM
Subject: https sites very slow / hanging
Author: Ray Russell Reese III
Date: 06/04/2004 01:41
 
When crawling any https sites with httrack on Solaris, the
crawl litterally hangs. It becomes very very slow, it
occastionally gets some of the https site, but ends up
taking hours to get single files from them.

truss -p [pid] shows the following, looping over and over again:

alarm(0)                                        = 0
setitimer(ITIMER_REAL, 0xFFB82DC0, 0xFFB82DB0)  = 0
sigaction(SIGALRM, 0xFFB82C40, 0xFFB82D70)      = 0
setitimer(ITIMER_REAL, 0xFFB82DC0, 0x00000000)  = 0
sigprocmask(SIG_SETMASK, 0xFFB82CC0, 0x00000000) = 0
    Received signal #14, SIGALRM, in sigsuspend() [caught]
sigsuspend(0xFFB82D40)                          Err#4 EINTR
sigprocmask(SIG_SETMASK, 0xFEFECFB8, 0x00000000) = 0
sigprocmask(SIG_SETMASK, 0xFEFF8CE0, 0x00000000) = 0
setcontext(0xFFB826B0)
sigprocmask(SIG_SETMASK, 0xFFB82CD0, 0x00000000) = 0
sigaction(SIGALRM, 0xFFB82C40, 0x00000000)      = 0
setitimer(ITIMER_REAL, 0xFFB82DB0, 0x00000000)  = 0
time()                                          = 1086303392
time()                                          = 1086303392
poll(0xFFB82D60, 1, 100)                        = 0
time()                                          = 1086303392
alarm(0)                                        = 0
setitimer(ITIMER_REAL, 0xFFB82DC0, 0xFFB82DB0)  = 0
sigaction(SIGALRM, 0xFFB82C40, 0xFFB82D70)      = 0
setitimer(ITIMER_REAL, 0xFFB82DC0, 0x00000000)  = 0
sigprocmask(SIG_SETMASK, 0xFFB82CC0, 0x00000000) = 0
    Received signal #14, SIGALRM, in sigsuspend() [caught]
sigsuspend(0xFFB82D40)                          Err#4 EINTR
sigprocmask(SIG_SETMASK, 0xFEFECFB8, 0x00000000) = 0
sigprocmask(SIG_SETMASK, 0xFEFF8CE0, 0x00000000) = 0
setcontext(0xFFB826B0)
sigprocmask(SIG_SETMASK, 0xFFB82CD0, 0x00000000) = 0
sigaction(SIGALRM, 0xFFB82C40, 0x00000000)      = 0
setitimer(ITIMER_REAL, 0xFFB82DB0, 0x00000000)  = 0
time()                                          = 1086303392
time()                                          = 1086303392
poll(0xFFB82D60, 1, 100)                        = 0
time()                                          = 1086303392

Unfortunately, I do not have root access to the box, with no
gdb or httrack compiled with -g .. I can get that, probably,
but it takes a while for the request to be fullfilled to
have it done. Otherwise I would provide more information
(backtrace, etc)

Thanks for any help you can provide!
 
Reply


All articles

Subject Author Date
https sites very slow / hanging

06/04/2004 01:41
Re: https sites very slow / hanging

06/04/2004 14:24




7

Created with FORUM 2.0.11