HTTrack Website Copier
Free software offline browser - FORUM
Subject: 403 Forbidden on external page! workaround?
Author: mctaft2014
Date: 06/27/2017 12:44
 
alright, ive been trying to figure this out for 10 days, but no matter what i
do, i can't get the thumbnail pictures to download. everything else saves
fine, but the thumbnails just wont.

link: <https://www.fanfiction.net/movie/Zootopia/?&srt=1&r=10>

the link that all the images are on is:
ffcdn2012t-fictionpressllc.netdna-ssl.com/image/*

ive tried so many different settings to get around the 403 it gives me. when i
click open image in new tab on a random story, it opens just fine, but copy
and pasting the link, i get a 403. i read somewhere to try deleting
cookies.txt and that didnt work. httrack keeps downloading index.html files
with 403 errors in them instead of the image. the links look like this for a
given story: //ffcdn2012t-fictionpressllc.netdna-ssl.com/image/469246/75/
notice how it ends in a / instead of a file name, i read somewhere that's why
it doesnt work.
i also read some stuff about a file called .htaccess, what if i tried adding a
filter like -*/.htaccess ?
this is already too long, im going to copy part of my error log and ill post
my options.opt file's contents.

ERROR: 
05:38:54 Warning:  Note: due to
<https://ffcdn2012t-fictionpressllc.netdna-ssl.com> remote robots.txt rules,
links beginning with these path will be forbidden: / (see in the options to
disable this)
05:38:54 Error:  "Forbidden" (403) at link
<https://ffcdn2012t-fictionpressllc.netdna-ssl.com/> (from primary/primary)

(i disabled robots.txt too and still got the 403)
OPTIONS.OPT:
Near=1
Test=1
ParseAll=1
HTMLFirst=0
Cache=1
NoRecatch=0
Dos=0
Index=1
WordIndex=0
MailIndex=0
Log=1
RemoveTimeout=0
RemoveRateout=0
KeepAlive=1
FollowRobotsTxt=2
NoErrorPages=0
NoExternalPages=0
NoPwdInPages=0
NoQueryStrings=0
NoPurgeOldFiles=0
Cookies=1
CheckType=1
ParseJava=1
HTTP10=0
TolerantRequests=0
UpdateHack=1
URLHack=1
StoreAllInCache=1
LogType=0
UseHTTPProxyForFTP=1
Build=0
PrimaryScan=3
Travel=1
GlobalTravel=0
RewriteLinks=0
BuildString=%%h%%p/%%n%%q.%%t
Category=FFnet
MaxHtml=
MaxOther=
MaxAll=
MaxWait=
Sockets=
Retry=
MaxTime=
TimeOut=
RateOut=
UserID=Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.1) Gecko/20020826
Footer=<!-- Mirrored by: HTTrack Website Copier/3.x. Site: %%s. File: %%s.
Date: %%s -->
AcceptLanguage=en, *
OtherHeaders=
DefaultReferer=
MaxRate= 
WildCardFilters=+*.css +*.js -ad.doubleclick.net/*
-mime:application/foobar%0d%0a+//ffcdn2012t-fictionpressllc.netdna-ssl.com/image/*%0d%0a+www.fanfiction.net/s/*%0d%0a+*.gif
+*.jpg +*.jpeg +*.png +*.tif +*.bmp%0d%0a+*.zip +*.tar +*.tgz +*.gz +*.rar
+*.z +*.exe%0d%0a+*.mov +*.mpg +*.mpeg +*.avi +*.asf +*.mp3 +*.mp2 +*.rm
+*.wav +*.vob +*.qt +*.vid +*.ac3 +*.wma +*.wmv
Proxy=
Port=
Depth=
ExtDepth=
MaxConn=
MaxLinks=
MIMEDefsExt1=
MIMEDefsExt2=
MIMEDefsExt3=
MIMEDefsExt4=
MIMEDefsExt5=
MIMEDefsExt6=
MIMEDefsExt7=
MIMEDefsExt8=
MIMEDefsMime1=
MIMEDefsMime2=
MIMEDefsMime3=
MIMEDefsMime4=
MIMEDefsMime5=
MIMEDefsMime6=
MIMEDefsMime7=
MIMEDefsMime8=
CurrentUrl=https://www.fanfiction.net/movie/Zootopia/?&srt%3d1&r%3d10
CurrentAction=5
CurrentURLList=
 
Reply


All articles

Subject Author Date
403 Forbidden on external page! workaround?

06/27/2017 12:44




9

Created with FORUM 2.0.11