HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: How to get rid of anti-robots protection
Author: Rukus
Date: 10/18/2019 03:12
 
I keep getting shut out of this site and redirected.  Any suggestions.
Log File:
HTTrack3.49-2+htsswf+htsjava launched on Thu, 17 Oct 2019 20:09:38 at
wideopenbaja.com +*.png +*.gif +*.jpg +*.jpeg +*.css +*.js
-ad.doubleclick.net/* -mime:application/foobar
(winhttrack -qwC2t%Pns2u1%s%uN0%I0p7DeK0H0%kf2A25000%f0#f -F "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0)" -%F "<!-- Mirrored from %s%s by
HTTrack Website Copier/3.x [XR&CO'2014], %s -->" -%l "en, *" wideopenbaja.com
-O1 "C:\My Web Sites\WO1" +*.png +*.gif +*.jpg +*.jpeg +*.css +*.js
-ad.doubleclick.net/* -mime:application/foobar )
Information, Warnings and Errors reported for this mirror:
note: the hts-log.txt file, and hts-cache folder, may contain sensitive
information,
 such as username/password authentication for websites mirrored in this
project
 do not share these files/folders if you want these information to remain
private
20:09:39 Warning:  Moved Permanently for wideopenbaja.com/robots.txt
20:09:39 Warning:  Redirected link is identical because of 'URL Hack' option:
wideopenbaja.com/robots.txt and <https://wideopenbaja.com/robots.txt>
20:09:39 Warning:  Warning moved treated for wideopenbaja.com/robots.txt (real
one is <https://wideopenbaja.com/robots.txt>)
20:09:40 Warning:  Moved Permanently for wideopenbaja.com/
20:09:40 Warning:  Redirected link is identical because of 'URL Hack' option:
wideopenbaja.com/ and <https://wideopenbaja.com/>
20:09:40 Warning:  File has moved from wideopenbaja.com/ to
<https://wideopenbaja.com/>
20:09:40 Warning:  HTML file (737 bytes) retransferred due to lack of cache:
wideopenbaja.com/
20:09:41 Warning:  Moved Permanently for wideopenbaja.com/
20:09:41 Warning:  Redirected link is identical because of 'URL Hack' option:
wideopenbaja.com/ and <https://wideopenbaja.com/>
20:09:41 Warning:  File has moved from wideopenbaja.com/ to
<https://wideopenbaja.com/>
20:09:41 Warning:  No data seems to have been transferred during this session!
: restoring previous one!
 
Reply Create subthread


All articles

Subject Author Date
Re: How to get rid of anti-robots protection

05/02/2019 07:35
Re: How to get rid of anti-robots protection

10/18/2019 03:12




8

Created with FORUM 2.0.11