HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re:
Author: William
Date: 09/26/2005 21:50
If the articles are in the /assetRoot/ directory on this site, here is the
reason:  ( robots.txt file)

User-agent: UKOnline

User-agent: *
Disallow: /assetRoot/

You need to Mirror, Modify Options and click the Spider tab.  in the
robots.txt combo box, select "no robots.txt rules"
Reply Create subthread

All articles

Subject Author Date

09/23/2005 10:32

09/26/2005 21:50

04/23/2006 15:53


Created with FORUM 2.0.11