HTTrack Website Copier
Free software offline browser - FORUM
Subject: How do you beat meta/robot tag?
Author: Susan
Date: 08/21/2001 19:45
 
I am trying to mirror a site I am a member of. But it 
has the line 
<META NAME="Keywords" CONTENT="">

<META NAME="Robots" CONTENT="Noindex, Nofollow">

on the main page. This makes it where I cannot use 
httrack. Is there a way around this annoying text that 
is stopping me? THANK YOU, PLEASE EMAIL IF YOU HAVE 
THE ANSWER.  susantrades@hotmail.com
 
Reply


All articles

Subject Author Date
How do you beat meta/robot tag?

08/21/2001 19:45
Re: How do you beat meta/robot tag?

08/21/2001 20:01
Re: How do you beat meta/robot tag?

08/21/2001 21:07
Re: How do you beat meta/robot tag?

08/21/2001 21:08
Re: How do you beat meta/robot tag?

08/27/2001 09:46




7

Created with FORUM 2.0.11