HTTrack Website Copier
Free software offline browser - FORUM
Subject: Re: Heritrix3
Author: WHRoeder
Date: 06/25/2013 14:41
 
1) Always post the ACTUAL command line used (or log file line two) so we know
what the site is, what ALL your settings are, etc.
2) Always post the URLs you're not getting and from what URL it is
referenced.
3) Always post anything USEFUL from the log file.
4) If you want everything use the near flag (get non-html files related) not
filters.
5) I always run with A) No External Pages so I know where the mirror ends.
With B) browser ID=msie 6 pulldown as some sites don't like a HTT one. With C)
Attempt to detect all links (for JS/CSS.) With D) Timeout=60, retry=9 to avoid
temporary network interruptions from deleting files.

> Can anyone tell me how can I configure user agent in
> Heritrix3? 

RTFM? <http://www.httrack.com/html/step9_opt8.html>
 
Reply Create subthread


All articles

Subject Author Date
Heritrix3

06/25/2013 11:38
Re: Heritrix3

06/25/2013 14:41




6

Created with FORUM 2.0.11