HTTrack Website Copier
Free software offline browser - FORUM
Subject: Adding index.html to links breaking crawl
Author: Jim
Date: 07/29/2014 18:17
 
I'm having an issue that it seems httrack adds index.html to links when
crawling.

i.e. www.example.com/page/ is crawled as www.example.com/page/index.html

Problem is that with the site I'm trying to mirror, if the index.html is
added, it redirects to the home page with htaccess (I presume).

So how can I crawl www.example.com/page/ without adding the index.html and the
crawler begin redirected to the home page?
Thanks!
 
Reply


All articles

Subject Author Date
Adding index.html to links breaking crawl

07/29/2014 18:17
Re: Adding index.html to links breaking crawl

07/29/2014 18:39




f

Created with FORUM 2.0.11