Re: problem grabbing simple wiki site - HTTrack Website Copier Forum

Subject: Re: problem grabbing simple wiki site

Author: William Roeder

Date: 04/14/2007 00:26

> <http://wiki.ubuntuusers.de/WLAN>
contains: <meta name="robots" content="index,nofollow">

Try setting Options -> Spider = no robots.txt rules

All articles

Subject	Author	Date
problem grabbing simple wiki site		04/12/2007 18:30
Re: problem grabbing simple wiki site		04/14/2007 00:26
Re: problem grabbing simple wiki site		04/17/2007 20:36