| > Trying to download www.metro.mobi I only get the
> index page.
Robots.txt says:
User-agent: *
Disallow: /chl/1000/*
Disallow: *jsp$
So I ran with No Robots and Browser ID=Mozilla/4.0 (compatible; MSIE 5.5;
Windows NT 5.0)
Got 440 files before I canceled it:
HTTrack Website Copier/3.43-5 mirror complete in 14 minutes 8 seconds : 454
links scanned, 440 files written (3050289 bytes overall), 440 files updated
[3224047 bytes received at 3801 bytes/sec]
| |