HTTrack Website Copier
Free software offline browser - FORUM
Subject: Follow robots.txt missing background media
Author: okiheh
Date: 03/10/2014 23:51
 
Well if i have robots.txt as follow i get all the site but not background gif
etc / if i set no robots.txt i get all the media but i cant pass login page (
i am using cookie.txt generated to do it ). What i am doing wrong ? Thx.
 
Reply


All articles

Subject Author Date
Follow robots.txt missing background media

03/10/2014 23:51




c

Created with FORUM 2.0.11