HTTrack Website Copier
Free software offline browser - FORUM
Subject: seeing 412/416 error again
Author: Patrick
Date: 04/09/2014 17:31
 
Hi,

I'm using httrack to retrieve a couple of twitter user profiles.

After a few of these, the hts-log file quickly shows:

"17:21:55	Warning: 	file not stored in cache due to bogus state (broken size,
expected 227694 got 888): <https://twitter.com/TSBible>
17:21:56	Warning: 	file not stored in cache due to bogus state (broken size,
expected 20 got 1529): mobile.twitter.com/TSBible
17:21:57	Warning: 	file not stored in cache due to bogus state (broken size,
expected 20 got 1302): <https://mobile.twitter.com/TSBible>
17:21:57	Warning: 	Warning: store text/css without scan:
../cache/twitter/abs.twimg.com/a/1396889640/css/t1/highline_logged_out.bundle.css
17:21:59	Warning: 	Warning: store text/html without scan:
../cache/twitter/mobile.twitter.com/TSBible.html
17:21:59	Warning: 	Unexpected 412/416 error (Requested Range Not Satisfiable)
for
<https://abs.twimg.com/a/1396889640/css/t1/highline_rosetta_core.bundle.css>,
'../cache/twitter/abs.twimg.com/a/1396889640/css/t1/highline_rosetta_core.bundle.css'
could not be found on disk"


After that I'm seeing the 412/416 error for a couple of common twitter files
at the rate of 500/second (2.5MB/second (!)), after which I have to kill the
httrack process.

I'm running version 3.47.27, compiled from source, on CentOS 6.4, x86_64.

The httrack commandline used (with some random twitter account as an
example):

/usr/local/bin/httrack <https://twitter.com/TSBible> --mime-html -O
"../cache/twitter" --user-agent "Mozilla/5.0 (X11; Linux x86_64; rv:25.0)
Gecko/20100101 Firefox/25.0" --depth=1 --sockets=2 --max-rate=100000 -D -n
-%N0


Does anyone have any ideas as to what's causing this??
thanks,

Patrick
 
Reply


All articles

Subject Author Date
seeing 412/416 error again

04/09/2014 17:31
Re: seeing 412/416 error again

04/09/2014 21:34
Re: seeing 412/416 error again

04/10/2014 10:08
Re: seeing 412/416 error again

04/14/2014 09:02
Re: seeing 412/416 error again

04/14/2014 20:43
Re: seeing 412/416 error again

04/15/2014 10:47




9

Created with FORUM 2.0.11