HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Get a list of external links?
Author: William Roeder
Date: 06/17/2007 15:15
 
> It is possible to use httrack to just create a list
> of all external links on a website?  I would like to
> be able to use it to scan my website and generate a
> list of all external links that I could then use to
> write a script that will check for dead links.  I
> really don't want to download any content except for
> a href's.  Any help would be appreciated.

If you mirror the site with options -> Build -> No external pages = checked,
any links not mirrored will be:
a_href="..\external.html?link=http://www.site..."

create a sed script to isolate site
findstr external.html|sed ... |sort|uniq
 
Reply Create subthread


All articles

Subject Author Date
Get a list of external links?

06/16/2007 17:57
Re: Get a list of external links?

06/17/2007 15:15




4

Created with FORUM 2.0.11