HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Can't scrape a WebSite
Author: Nijaz
Date: 08/06/2020 00:58
 
Well default settings are OK, jut with that user agent I told you, that and
+*.mp4 in scan rules if you wanna videos. If you just want that website then
just remove anything in scan rules, but then you will not have any images or
videos, because they are hosted on different website. This is rule for just
that website, put it in scan rules but remove anything else:
-*
+historyreviewed.best/*

But that may make page ugly, so maybe best use what I said earlier. (default
settings and user agent and mp4 filter in rules added next to existing
rules).
That is simplest rule I use in most cases.
You can use umatrix addon in firefox or chrome to see what there is exactly on
website, where are images or videos, it shows nice table explaining what is
where.
 
Reply Create subthread


All articles

Subject Author Date
Can't scrape a WebSite

08/01/2020 03:11
Re: Can't scrape a WebSite

08/01/2020 03:13
Re: Can't scrape a WebSite

08/04/2020 23:34
Re: Can't scrape a WebSite

08/05/2020 16:48
Re: Can't scrape a WebSite

08/06/2020 00:58
Re: Can't scrape a WebSite

08/06/2020 17:39




d

Created with FORUM 2.0.11