i try to mirror a http-auth website that has links(video) to another http-auth
website.
The biggest problem i have is that httrack uses only 1 connection. My PC can't
be online all the time, so i have to restart from time to time, but --continue
doesn't work nor does only "httrack". The last problem isn't really big, it
looks like httrack needs to load the initial URLs to authenticate properly,
when i start within a project i always get 401 errors, when i delete the files
of the corresponding entry URLs everything works.
Connection problem details
after a lot of trying i now use a httrackrc-file for most options and a
filters-file for the filters. The only options in the command line are the
URLs in the form <http://username:password@site> and the -%N0 option. I tried
a lot of other settings but can't find the one that is limiting to 1
connection. the below settings are "grown" in a trial/error process. i simply
want to download the html, pics and video from 'site' and 'site2'
------httrackrc start--------------
disable-security-limits
path "c:\DL\"
max-rate 1000000
urllist "c:\DL\filters.txt"
index
build-top-index
search-index
user-agent "Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.1.5)
Gecko/20091102 Firefox/3.5.5 GTB5 (.NET CLR 3.5.30729)"
footer ""
language "de-de,de;q=0.8,en-us;q=0.5,en;q=0.3"
extended-parsing
near
robots 0
check-type 0
tolerant
mirror
structure 0
min-rate 1000
cached-delayed-type-check 1
disable-passwords 0
priority 7
------httrackrc end--------------
------filters.txt start--------------
-*
+*site/*.htm*
+*site2/*divx*.htm*
+*.jpg
+*.css
+*.js
+*.mov
+*.mpg
+*.mpeg
+*.avi
+*.wmv
+*.divx
------filters.txt end--------------
continue|update details
when i start the project with the --continue option or simply with 'httrack'
httrack builds a directory structure that includes parts of the set options
and doesn't start at all. This isn't a big problem as with --mirror everything
works fine including no redownloads of already present files.
english isn't my primary language, so i hope you understand what i want to
say
thanks in advance
Helmchen