HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Another Forum download question....
Author: William Roeder
Date: 07/02/2009 15:37
 
> I'm trying to download;
> <http://forums.station.sony.com/mxo/forums/list.m>

> I've set the rules;
> +http://forums.station.sony.com/mxo/posts/*
> +http://forums.station.sony.com/mxo/forums/*
> +*.css +*.js -ad.doubleclick.net/*
> -mime:application/foobar
> +*.gif +*.jpg +*.png +*.tif +*.bmp
> +*.zip +*.tar +*.tgz +*.gz +*.rar +*.z +*.exe 
> 
> But the problem is that HTTrack doesn't pick up the
> posts.
You don't need the gif/jpg/etc since you don't filter anything out. Just set
links -> get non-html
You don't nee the +*/mxo/forums/* since that is your starting point.
You do need the +*/mxo/posts/* since the default is to go down only and posts
are up and over fom forums.

You don't get anything else because the page has:
<meta name="robots" content="nofollow" />

set options -> spider = no robots.txt
 
Reply Create subthread


All articles

Subject Author Date
Another Forum download question....

07/02/2009 14:08
Re: Another Forum download question....

07/02/2009 15:37
Re: Another Forum download question....

07/03/2009 00:45
Re: Another Forum download question....

07/03/2009 10:59
Re: Another Forum download question....

07/03/2009 15:28




7

Created with FORUM 2.0.11