HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: filters
Author: Charles
Date: 06/12/2012 07:41
 
First off this is a fairly large mirror and I had no interest in finishing the
mirror to see how things went. So what I did is let it copy for a few minutes
and then stopped the mirror to check the links on the few pages that were
mirrored to see which links were being saved, and which ones were not.

In the short time I did the trial mirror no videos were downloaded, so when
the video links are finally come upon by (win)httrack I do not know how that
will go. And I do not know if the videos will be displayed correctly when
opened in the mirrored page. If you do not need the videos YOU will have to
come up with an exclusion(s) rule for them.

So if you want you can try what I have written below, adding or removing
exclusion rules as you see fit, as to what you are wanting to mirror.

Again, I only let it mirror for a few minutes, so the pages at lower depths
may have links to exclude, too. If nothing else you should get an idea of how
to do it.


The below rules do get the Provinces pages.


Below is what I would use in the Windows version.

Under the "links" tab click the "get non-html files related to a link" box.

Under the "Spider" tab select "no robot.txt rules". (Now I by default just
select that. I don't know if that is good or bad. But it has never caused me
any problems.)

Under "Browser ID" tab, select the first one in the list. Which is MSIE 6.0.

Under "Flow Control" tab, "Number of Connections" select 3.


**** web address to be copied ****

<http://www.italia.it/fr/decouvrez-litalie.html>


In the scan rules below there may be duplicate exclusions. I wasn't trying to
be particular when doing this, so I just copied the links as I came upon them.
I used a copy to clipboard application so that as I copied links they were
added to the clipboard. 


**** scan rules ****

+*.css +*.js -ad.doubleclick.net/* -mime:application/foobar
+*.gif +*.jpg +*.png +*.tif +*.bmp
+http://www.italia.it/fr/*
-http://www.italia.it/fr/contacts.html
-http://www.italia.it/fr/idees-de-voyage/montagne.html
-http://www.italia.it/fr/idees-de-voyage/nature-et-paysage.html
-http://www.italia.it/fr/idees-de-voyage/sport-et-aventure.html
-http://www.italia.it/fr/idees-de-voyage/art-et-histoire.html
-http://www.italia.it/fr/idees-de-voyage/bien-etre-et-sante.html
-http://www.italia.it/fr/idees-de-voyage/affaires-et-etudes.html
-http://www.italia.it/fr/idees-de-voyage/culture-et-spectacle.html
-http://www.italia.it/fr/idees-de-voyage/foi-et-spiritualite.html
-http://www.italia.it/fr/idees-de-voyage/lacs.html
-http://www.italia.it/fr/media/visites-virtuelles.html
-http://www.italia.it/fr/media/video.html
-http://www.italia.it/fr/informations-utiles/easy-italia.html
-http://www.italia.it/fr/informations-utiles/vacances-en-toute-securite.html
-http://www.italia.it/fr/informations-utiles/documents.html
-http://www.italia.it/fr/informations-utiles/securite.html
-http://www.italia.it/fr/informations-utiles/regles-routieres.html
-http://www.italia.it/fr/informations-utiles/meteo.html
-http://www.italia.it/fr/informations-utiles/ambassades.html
-http://www.italia.it/fr/informations-utiles/comment-venir.html
-http://www.italia.it/fr/notes-legales.html
-http://www.italia.it/fr/renseignements.html
-http://www.italia.it/fr/accessibilite.html
-http://www.italia.it/fr/plan-du-site.html
-http://www.italia.it/fr/notes-legales.html
-http://www.italia.it/fr/renseignements.html
-http://www.italia.it/fr/accessibilite.html
-http://www.italia.it/es/*
-http://www.italia.it/de/*
-http://www.italia.it/en/*
-http://www.italia.it/it/*
-http://www.italia.it/fr/home.html
-http://www.italia.it/fr/idees-de-voyage.html
-http://www.italia.it/fr/focus.html
-http://www.italia.it/fr/nouvelles/1.html
-http://www.italia.it/fr/media.html
-http://www.italia.it/fr/informations-utiles.html
-http://www.italia.it/fr/informations-utiles/plus-dinformations.html
-http://www.italia.it/fr/informations-utiles/faq/culture-et-spectacle.html
-http://www.italia.it/fr/idees-de-voyage/mer.html
-http://www.italia.it/fr/idees-de-voyage/se-restaurer.html


Sonia, it takes a lot of time to type out something like the above. I
generally don't have the time to do it, so I hope it helps you.
 
Reply Create subthread


All articles

Subject Author Date
filters

06/11/2012 23:28
Re: filters

06/12/2012 04:28
Re: filters

06/12/2012 07:41
Re: filters

06/12/2012 23:58




b

Created with FORUM 2.0.11