HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Can only download index page
Author: William Roeder
Date: 05/26/2009 15:40
 
> Trying to download www.metro.mobi I only get the
> index page.

Robots.txt says:
User-agent: *
Disallow: /chl/1000/*
Disallow: *jsp$

So I ran with No Robots and Browser ID=Mozilla/4.0 (compatible; MSIE 5.5;
Windows NT 5.0)

Got 440 files before I canceled it:
HTTrack Website Copier/3.43-5 mirror complete in 14 minutes 8 seconds : 454
links scanned, 440 files written (3050289 bytes overall), 440 files updated
[3224047 bytes received at 3801 bytes/sec]
 
Reply Create subthread


All articles

Subject Author Date
Can only download index page

05/25/2009 23:32
Re: Can only download index page

05/26/2009 15:40




d

Created with FORUM 2.0.11