HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: First Time Using HTTrack: Question About Mirroring
Author: William Roeder
Date: 11/13/2011 19:55
 
Always post the command line used (log file line two)

> I am trying to copy www.healthteacher.com.  What is
> all this other stuff? 
> <http://img141.imageshack.us/img141/3510/unledfk.png>

Your image shows a bunch of robots.txt from other sites.
Not all sites are fully contained on the initial site. Some store images and
javascript files on other sites.
HTT has to read a robots.txt from each it downloads from.

 
Reply Create subthread


All articles

Subject Author Date
First Time Using HTTrack: Question About Mirroring

11/13/2011 18:28
Re: First Time Using HTTrack: Question About Mirroring

11/13/2011 19:55




6

Created with FORUM 2.0.11