HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Copy of Mediawiki with german Umlaute
Author: Bo Hovgaard Thomasen
Date: 11/12/2007 11:42
 
The problem is, I think, not related to umlaud characters, but to robots.txt
restrictions. 

I'm currently mirroring the /Schätztheorie page  with no problems so far.  

The robots.txt at <http://mars.wiwi.hu-berlin.de/robots.txt> disallows
mirroring/indexing by all user-agents:

User-Agent: *
Disallow: /

See this posting for info about robots.txt rules: 
<http://forum.httrack.com/readmsg/16428/16426/index.html>

- Bo Hovgaard Thomasen
 
Reply Create subthread


All articles

Subject Author Date
Copy of Mediawiki with german Umlaute

11/12/2007 11:08
Re: Copy of Mediawiki with german Umlaute

11/12/2007 11:42
Re: Copy of Mediawiki with german Umlaute

11/12/2007 12:18
Re: Copy of Mediawiki with german Umlaute

11/12/2007 12:58
Re: Copy of Mediawiki with german Umlaute

11/12/2007 13:27
Re: Copy of Mediawiki with german Umlaute

11/12/2007 13:56
Re: Copy of Mediawiki with german Umlaute

11/06/2023 17:32




f

Created with FORUM 2.0.11