HTTrack Website Copier
Free software offline browser - FORUM
Subject: keep-alives broken...strangeness at www.kibria.de
Author: Haudy Kazemi
Date: 01/16/2003 06:19
 
Hello,
----
Note: After writing the stuff below, I turned off keep-
alives and tested (project test3) with everything mirrored 
correctly (from what I could see...I think keep-alives 
are 'broken'.)
test1=no speed limit
test2=10 kb/sec limit
test3=no speed limit, keep-alives off after remembering it 
was a new feature and seeing it mentioned in the 301 error 
message.

This is with 3.23beta7 (latest beta).
----

My latest project consisted of:
<http://www.kibria.de/>
<http://www.kibria.de/frhed.html>

When mirrored with default settings of no speed controls I 
get a several 301 Errors for some of the zip files...
www.tu-darmstadt.de\_rkibria\frhed154.zip
www.tu-darmstadt.de\_rkibria\frhed155b1.zip
www.tu-darmstadt.de\_rkibria\frhed155b3.zip
(these are actually txt files, mis-named.  When I tried 
again with a new project name, a few of the files were 
grabbed and a few others were missed, but mostly it was 
these files.  Inside the text file is a copy of the 301 
error page with the correct working URL)

I did another test with a speed limit of 10kb/sec and a 
different set of files was given 301 Moved Permanently 
errors...it seems that speed changes don't fix the issue.

One thing that did work was to delete or rename the 
improperly grabbed ZIP files, so then HTTrack redownloaded 
them using Update Project Mirror.  If I didn't 
rename/delete these files, HTTrack's Update would not 
download the correct version.

Here is the contents of one of those 'zip' 301 errors:

0

HTTP/1.1 301 Moved Permanently
Date: Thu, 16 Jan 2003 04:56:40 GMT
Server: Apache/1.3.26 (Unix) PHP/4.2.2 mod_perl/1.27
Location: <http://homepages.tu>-
darmstadt.de/~rkibria/frhed151.zip
Keep-Alive: timeout=15, max=99
Connection: Keep-Alive
Transfer-Encoding: chunked
Content-Type: text/html; charset=iso-8859-1

17d
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<HTML><HEAD>
<TITLE>301 Moved Permanently</TITLE>
</HEAD><BODY>
<H1>Moved Permanently</H1>
The document has moved <A HREF=http://homepages.tu-
darmstadt.de/~rkibria/frhed151.zip">here</A>.<P>
<HR>
<ADDRESS>Apache/1.3.26 Server at <A 
HREF="mailto:webmaster@tu-darmstadt.de">www.tu-
darmstadt.de</A> Port 80</ADDRESS>
</BODY></HTML>

0

This part of the Test2's hts-log.txt is interesting:

22:56:58 Error:  "Unknown (not HTTP/xx) response structure" 
(-1) at link www.tu-darmstadt.de/~rkibria/frhed151.zip 
(from www.kibria.de/frhed.html)
22:56:58 Warning:  Moved Permanently for www.tu-
darmstadt.de/~rkibria/frhed150.zip
22:56:58 Warning:  Warning moved treated for www.tu-
darmstadt.de/~rkibria/frhed150.zip (real one is 
homepages.tu-darmstadt.de/~rkibria/frhed150.zip)
22:56:58 Warning:  Moved Permanently for www.tu-
darmstadt.de/~rkibria/frhed149.zip
22:56:58 Warning:  Warning moved treated for www.tu-
darmstadt.de/~rkibria/frhed149.zip (real one is 
homepages.tu-darmstadt.de/~rkibria/frhed149.zip)
22:56:58 Error:  "Unknown (not HTTP/xx) response structure" 
(-1) at link www.tu-darmstadt.de/~rkibria/frhed148.zip 
(from www.kibria.de/frhed.html)

The files with the "Unknown" error are not being downloaded 
correctly.

Total site size is about 6mb.

You can browse the test projects here:
<http://www.kazemizadeh.net/httrack/www.kibria.de/>
 
Reply


All articles

Subject Author Date
keep-alives broken...strangeness at www.kibria.de

01/16/2003 06:19
Re: keep-alives broken...strangeness at www.kibria.de

01/16/2003 22:05




9

Created with FORUM 2.0.11