HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Trying To Make Local Copy Of Zimmerman's Website
Author: William Roeder
Date: 04/11/2012 19:30
 
> 09:13:11 Info:  Note: due to
> therealgeorgezimmerman.com remote robots.txt rules,
> links beginning with these path will be forbidden:
> /cache/, /_backup/, /_mygallery/, /_temp/,
> /_tempalbums/, /_tmpfileop/, /dbboon/, /Flash/,
> /images/, /plugins/, /scripts/, /stats/,
> /statshistory/, /WstxSearchResults.html,
> /WstxSearchResults.php, /QSC/ (see in the options to
> disable this)

What part of that was unclear and why didn't you override robots.txt?
 
Reply Create subthread


All articles

Subject Author Date
Trying To Make Local Copy Of Zimmerman's Website

04/10/2012 18:41
Re: Trying To Make Local Copy Of Zimmerman's Website

04/10/2012 19:22
Re: Trying To Make Local Copy Of Zimmerman's Website

04/10/2012 19:37
Re: Trying To Make Local Copy Of Zimmerman's Website

04/11/2012 19:30




e

Created with FORUM 2.0.11