HTTrack Website Copier
Free software offline browser - FORUM
Subject: Protection other than robots.txt ?
Author: Gregg E.
Date: 03/04/2006 07:55
 
I'm trying to get all of  but with any of the robots.txt options it'll only get
the contents of /th99/ and a few HTML files from /th99/z/

The directories below /th99/ are c, i, m, r, v, z. Each of those has one or
more subdirectories full of .jpg and .png images. So far no site downloader
I've tried has been able to get anything from below the directories directly
under /th99/

What's protecting them?! The site doesn't even have directory browsing
disabled.
 
Reply


All articles

Subject Author Date
Protection other than robots.txt ?

03/04/2006 07:55
Re: Protection other than robots.txt ?

03/04/2006 07:58
Re: Protection other than robots.txt ?

03/04/2006 18:09
Re: Protection other than robots.txt ?

03/05/2006 06:52
Re: Protection other than robots.txt ?

03/05/2006 10:46




4

Created with FORUM 2.0.11