HTTrack Website Copier
Free software offline browser - FORUM
Subject: Question regarding crawling a website
Author: mbp
Date: 05/22/2014 17:11
 
Hi,

I'm new to HTTrack, and I'm sure my question has been asked (and answered)
before, but I have no idea how to find it in this forum (because it's a bit
difficult for me to explain it), so here's my question:

Imagine I want to scrape the entire website of (e.g. www.website.com), I used
"mirroring with wizard" option and added the -s0 option, but I realised that I
only have "www.website.com/...", but not "aaa.website.com" or
"bbb.website.com".

I know I can also choose to "mirror all links in URLs", but that's generating
way too much data. I just want everything under "website.com", but not limited
to "www.website.com".

How can I do that?
Many thanks in advance guys!
 
Reply


All articles

Subject Author Date
Question regarding crawling a website

05/22/2014 17:11
Re: Question regarding crawling a website

05/22/2014 18:14
Re: Question regarding crawling a website

05/22/2014 20:44




d

Created with FORUM 2.0.11