HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Help - wikitravel
Author: William Roeder
Date: 01/06/2010 17:24
 
> -*/*/af/*/*/  
> -*/*/ar/*/*/  
> ...
> -*/*/zh-yue/*/*/  
> -*/*/zh/*/*/ 

If you're doing that you not think correctly. Instead you want to reject
everything except English.

-* +wikitravel.org/en/*

Also the robots.txt states:
Disallow: /en/wiki/
So you'll have to override robots.
 
Reply Create subthread


All articles

Subject Author Date
Help - wikitravel

01/06/2010 06:57
Re: Help - wikitravel

01/06/2010 17:24
Re: Help - wikitravel

01/07/2010 20:39
Re: Help - wikitravel

01/08/2010 04:58
Re: Help - wikitravel

01/25/2010 17:16




d

Created with FORUM 2.0.11