HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Mirror folders with forbidden access
Author: William Roeder
Date: 11/25/2008 17:30
 
> I tried to mirror the "nippel" archive of this site
> <http://tvtotal.prosieben.de/downloads/nippel/>

> the actual folders wich contain the videos are
> <http://tvtotal.prosieben.de/imperia/md/video/tvtotal>
> /downloads/2008/sep-okt/

> unfortunatly httrack cant mirror the folder

<http://tvtotal.prosieben.de/robots.txt> says:
User-agent: *
Disallow: /imperia/

options -> Spider -> Spider = no robots

> the actual folders wich contain the videos are
> <http://tvtotal.prosieben.de/imperia/md/video/tvtotal>
> /downloads/2008/sep-okt/

httrack defaults to down only, the links are absolute. Try options -> expert
-> Travel = up/down

 
Reply Create subthread


All articles

Subject Author Date
Mirror folders with forbidden access 11/25/2008 16:51
Re: Mirror folders with forbidden access 11/25/2008 17:30
Re: Mirror folders with forbidden access 11/25/2008 18:00




5

Created with FORUM 2.0.11