HTTrack Website Copier
Free software offline browser - FORUM
Subject: HTTP authentication
Author: chris
Date: 01/06/2009 23:35
 
I have a web page with linked images/files, all stored on a server that
requires HTTP authentication.  HTTrack does a great job of getting the main
page and finding the necessary links, but it is unable to follow them.

The errors indicate authentication failed for the linked images/files:
###########################
HTTrack3.43-2+htsswf+htsjava launched on Tue, 06 Jan 2009 17:15:44 at
<http://myuser:mypass@xtse.aur.alcatel.com/view/xtse_2.4.3_auto_vu/cm8/auto/Automation/Tools/Xweb/Xtse/cgi-bin/report.cgi?>postfile:C:\Documents%20and%20Settings\myuser\My%20Documents\Saved%20Web%20Pages\temp\hts-post0>
+*.css +*.js -ad.doubleclick.net/* -mime:application/foobar +*.gif +*.jpg
+*.png +*.tif +*.bmp +*.zip +*.tar +*.tgz +*.gz +*.rar +*.z +*.exe +*.mov
+*.mpg +*.mpeg +*.avi +*.asf +*.mp3 +*.mp2 +*.rm +*.wav +*.vob +*.qt +*.vid
+*.ac3 +*.wma +*.wmv +*.txt +*.pdf +*.doc +*.xls +*.ppt
(winhttrack -qwC2%Ps2u1%s%uN0%I0p3DaK0H0%kf2A25000%f0#f -F "Mozilla/4.5
(compatible; HTTrack 3.0x; Windows 98)" -%F "<!-- Mirrored from %s%s by
HTTrack Website Copier/3.x [XR&CO'2008], %s -->" -%l "en, en, *"
<http://myuser:mypass@xtse.aur.alcatel.com/view/xtse_2.4.3_auto_vu/cm8/auto/Automation/Tools/Xweb/Xtse/cgi-bin/report.cgi?>postfile:C:\Documents%20and%20Settings\myuser\My%20Documents\Saved%20Web%20Pages\temp\hts-post0>
-O1 "C:\Documents and Settings\myuser\My Documents\Saved Web Pages\temp"
+*.css +*.js -ad.doubleclick.net/* -mime:application/foobar +*.gif +*.jpg
+*.png +*.tif +*.bmp +*.zip +*.tar +*.tgz +*.gz +*.rar +*.z +*.exe +*.mov
+*.mpg +*.mpeg +*.avi +*.asf +*.mp3 +*.mp2 +*.rm +*.wav +*.vob +*.qt +*.vid
+*.ac3 +*.wma +*.wmv +*.txt +*.pdf +*.doc +*.xls +*.ppt )
Information, Warnings and Errors reported for this mirror:
note: the hts-log.txt file, and hts-cache folder, may contain sensitive
information,
 such as username/password authentication for websites mirrored in this
project
 do not share these files/folders if you want these information to remain
private
17:15:56 Info:  engine: transfer-status: link updated:
myuser:mypass@xtse.aur.alcatel.com/view/xtse_2.4.3_auto_vu/cm8/auto/Automation/Tools/Xweb/Xtse/cgi-bin/report.cgi?>postfile:C:\Documents%20and%20Settings\myuser\My%20Documents\Saved%20Web%20Pages\temp\hts-post0
-> C:/Documents and Settings/myuser/My Documents/Saved Web
Pages/temp/xtse.aur.alcatel.com/view/xtse_2.4.3_auto_vu/cm8/auto/Automation/Tools/Xweb/Xtse/cgi-bin/report0544.html
17:15:59 Error:  "Authorization Required" (401) at link
xtse.aur.alcatel.com/view/tutor_1.0_dev_xtse_vu/cm8/auto/Automation/TestImages/xmlspy.gif
(from
myuser:mypass@xtse.aur.alcatel.com/view/xtse_2.4.3_auto_vu/cm8/auto/Automation/Tools/Xweb/Xtse/cgi-bin/report.cgi?>postfile:C:\Documents%20and%20Settings\myuser\My%20Documents\Saved%20Web%20Pages\temp\hts-post0)
17:15:59 Error:  "Authorization Required" (401) at link
xtse.aur.alcatel.com/view/tutor_1.0_dev_xtse_vu/cm8/auto/Automation/TestMisc/MTM_load_times.xls
(from
myuser:mypass@xtse.aur.alcatel.com/view/xtse_2.4.3_auto_vu/cm8/auto/Automation/Tools/Xweb/Xtse/cgi-bin/report.cgi?>postfile:C:\Documents%20and%20Settings\myuser\My%20Documents\Saved%20Web%20Pages\temp\hts-post0)
17:15:59 Error:  "Authorization Required" (401) at link
xtse.aur.alcatel.com/view/tutor_1.0_dev_xtse_vu/cm8/auto/Automation/TestImages/ISDN_BRI_VoiceQuality_TestSetup.bmp
(from
myuser:mypass@xtse.aur.alcatel.com/view/xtse_2.4.3_auto_vu/cm8/auto/Automation/Tools/Xweb/Xtse/cgi-bin/report.cgi?>postfile:C:\Documents%20and%20Settings\myuser\My%20Documents\Saved%20Web%20Pages\temp\hts-post0)
17:15:59 Error:  "Authorization Required" (401) at link
xtse.aur.alcatel.com/view/tutor_1.0_dev_xtse_vu/cm8/auto/Automation/TestImages/test1.jpg
(from
myuser:mypass@xtse.aur.alcatel.com/view/xtse_2.4.3_auto_vu/cm8/auto/Automation/Tools/Xweb/Xtse/cgi-bin/report.cgi?>postfile:C:\Documents%20and%20Settings\myuser\My%20Documents\Saved%20Web%20Pages\temp\hts-post0)
No files purged
HTTrack Website Copier/3.43-2 mirror complete in 15 seconds : 14 links
scanned, 9 files written (125106 bytes overall), 1 files updated [113209 bytes
received at 7547 bytes/sec], 1.5 requests per connection
(4 errors, 0 warnings, 1 messages)
###########################

Question!  How do I force the user/password to be used on every image/link
that is followed?
The closest setting appeared to be Options > Proxy > Configure >
Authentication, but I'm guessing you need an actual proxy for that.  I want to
make this easy for coworkers to use so I don't want to set one up.

Any help would be greatly appreciated!

Thanks in advance,
Chris

P.S.  You may notice I used the capture URL method to submit a form to
generate the report.  It is not for form authentication so don't be fooled! 
This is strictly HTTP authentication.
 
Reply


All articles

Subject Author Date
HTTP authentication

01/06/2009 23:35
Re: HTTP authentication

01/07/2009 16:45
Re: HTTP authentication

01/22/2009 17:51




4

Created with FORUM 2.0.11