| | New Users: here are some useful pre-made HtTrack Rules for you! :) They may
need to be deleted/modified but this is a good start. :) Hope they help. I
will post updated Rules here as the program progresses and as I become better
at using the program, since I am an "average Joe" (non-programmer) user of the
program over last 7 years. :)
***These rules are for Win HTTrack. These wildcards/Rules and file extensions
are useful in almost every single download! :)
Before we begin: 3 quick tips:
1) If a site is causing problems with just HTPP:// address, try variation of
same page with WWW. (although newest Httrack has a hack for that under
"Spider" --> Url Hacks" (check this useful box). This may be useless as of
April 2015....
Example: +*http://website.com/subpage/* --> Not working, so TRY:
+*http://www.website.com/subpage/* or TRY +*http://www.website.com/subpage/
(no asterisk in the end of link)
2) If downloading a very large site and you get the incomplete site with error
"Too many URLs, giving up..(>100000)", even if site may not even be all that
large (like GameFAQs.com with tons of text of negligible size), make sure to
increase site link limit.
Here is how: <http://forum.httrack.com/readmsg/33944/310/index.html> (I wrote
this tutorial April 2015 to help average users like me). Basically start a new
project or "continue" project --> Click on "Set Options" --> Limits (tab) -->
"Maximum Number of links"
(bottom field) --> Just go for highest available of threads or write 999999999
!! But be warned! Constantly check the In Progress/action download
screen to be sure you are not copying the entire Internet! lol One way to do
that is to put "0" under the "Maximum external depth" field (Limits tab) and
checkmark "No external pages" under "Build" tab. I know this can cause you to
miss some files, but that can be fixed manually under "Rules".
3) Check the program's easy to use manual! The Developers of HtTrack are
VOLUNTEERS to allow us to have this awesome program FREE, so they cannot be on
Forum 24/7 answering questions. Check out the manual and FAQs:
<http://www.httrack.com/html/faq.html>
*****Now to the main article/help with pre-made generic Rules for n00bs and
average users alike:
Broad and useful types of POSITIVE rules for images (need positives on ALL
sites so images show properly!):
+*.gif +*.jpg +*.jif +*.png +*.bmp +*.tif +*.tiff +*.bpg +*.jpeg +*.svg
+*.svgz +*.cgm
Other useful formats to mass-capture (or not capture at all):
Images (uncommon): +*.CPT +*.PSD +*.PSP +*.XCF +*.PSD +*.XCF +*.
Misc Files: +*.pdf +*.XPS +*.pict +*.pct +*.pic +*.ear +*.apk (Android)
Flash/shockwave: +*.FLV +*.SWF +*.FLA +*.SWT +*.SWC
ISO (image files often used in emulation): +*.iso +*.img +.rom +*.zip (game
roms are often .zip or .7z)
Info Card data and presentations (PowerPoint): +*.pps +*.ppt +*.pptx +*.csv
+*.vcf
3D Image Files: +*.3dm +*.3ds +*.max +*.obj
Text/doc files: +*.doc +*.docx +*.log +*.msg +*.odt +*.pages +*.rtf +*.tex
+*.txt +*.wpd +*.wps +*.Pdf
Win Font Files: +*.fnt +*.fon +*.otf +*.ttf
Disk Image (large!!): +*.bin +*.cue +*.dmg +*.iso +*.mdf +*.toast +*.vcd
+*.bak +*.tmp +*.img
Common web extensions (add when site giving problems certain extensions):
+*.asp +*.aspx +*.cer +*.cfm +*.csr +*.css +*.htm +*.html +*.js +*.jsp
+*.php +*.rss +*.xhtml
POSITIVE all AUDIO: +*.aif +*.iff +*.m3u +*.m4a +*.mid +*.mp3 +*.mpa
+*.ra +*.wav +*.wma +*.pcm
POSITIVE all VIDEO/movie: +*.3g2 +*.3gp +*.asf +*.asx +*.avi +*.flv
+*.m4v +*.mov +*.mp4 +*.mp5 +*.mpg +*.rm +*.srt +*.swf +*.vob +*.wmv
+*.mpeg +*.mp2 +*.qt +*.vid +*.ac3 +*.mp4 +*.mp5 +*.bik
POSITIVE all zipped/compressed/exec files: +*.zip +*.zipx +*.tar +*.tgz +*.gz
+*.rar +*.z +*.exe +*.7z +*.arj +*.a +*.iso +*.ace +*.cab +*.cpt +*.jar
+*.lzh +*.lha +*.war +*.wim +*.sit +*.s7z -*.infl
NEGATIVE all AUDIO: -*.aif -*.iff -*.m3u -*.m4a -*.mid -*.mp3 -*.mpa
-*.ra -*.wav -*.wma -*.pcm
NEGATIVE all VIDEO/movie: -*.3g2 -*.3gp -*.asf -*.asx -*.avi -*.flv
-*.m4v -*.mov -*.mp4 -*.mp5 -*.mpg -*.rm -*.srt -*.swf -*.vob -*.wmv
-*.mpeg -*.mp2 -*.qt -*.vid -*.ac3 -*.mp4 -*.mp5 -*.bik
NEGATIVE all ZIPPED/compressed/exe files: -*.zip -*.zipx -*.tar -*.tgz -*.gz
-*.rar -*.z -*.exe -*.7z -*.arj -*.a -*.iso -*.ace -*.cab -*.cpt -*.jar
-*.lzh -*.lha -*.war -*.wim -*.sit -*.s7z -*.infl
STANDARD (all POSITIVE on movie, audio, and compressed files - big download):
+*.css +*.js -ad.doubleclick.net/* -mime:application/foobar -*.infl
+*.gif +*.jpg +*.png +*.tif +*.bmp +*.tiff +*.BPG +*.JPEG +*.svg +*.svgz
+*.CGM
+*.zip +*.tar +*.tgz +*.gz +*.rar +*.z +*.exe +*.7z +*.arj
+*.mov +*.mpg +*.mpeg +*.avi +*.asf +*.mp3 +*.mp2 +*.rm +*.wav +*.vob +*.qt
+*.vid +*.ac3 +*.wma +*.wmv +*.mp4 +*.mp5 +*.flv +*.3gp +*.3g2 +*.wav
STANDARD (NEGATIVE ALL download of compressed files and NEGATIVE on
movies/music, except images, which ARE major part of website):
+*.css +*.js -ad.doubleclick.net/* -mime:application/foobar -*.infl
+*.gif +*.jpg +*.png +*.tif +*.bmp +*.tiff +*.BPG +*.JPEG +*.svg +*.svgz
+*.CGM
-*.zip -*.zipx -*.tar -*.tgz -*.gz -*.rar -*.z -*.exe -*.7z -*.arj -*.a -*.iso
-*.ace -*.cab -*.cpt -*.jar -*.lzh -*.lha -*.war -*.wim -*.sit -*.s7z
-*.mov -*.mpg -*.mpeg -*.avi -*.asf -*.mp3 -*.mp2 -*.rm -*.wav -*.vob -*.qt
-*.vid -*.ac3 -*.wma -*.wmv -*.mp4 -*.mp5
NEGATIVE ON MULTIPLE AD SITES and other annoying tracking sites, blogs, huge
outside/external sites, forums, and misc sites that add useless data to
downloads:
(Note: These may have to be removed/deleted/altered base don the site you are
downloading. If you want a Forum, for example, then delete any -*Forum rules,
etc. :)
-*http://www.photobucket.com/*
-*http://www.photobucket.com*
-*https://www.photobucket.com*
-*www.photobucket.com*
-*photobucket.com*
-*www.flicker.com/*
-*http://www.fliker.com/*
-*http://www.fliker.com*
-*fliker.com/*
-*flicker.com/*
-*https://www.flicker.com/*
-*https://www.flicker.com*
-*http://www.youtube.com/*
-*http://www.youtube.com*
-*https://www.youtube.com/*
-*http://www.youtube.com/watch?v=*
-*http://www.youtube.com/watch?*
-*https://www.youtube.com*
-*https://www.youtube.com
-*http://www.youtube.com
-*www.youtube.com/*
-*www.youtube.com*
-*youtube.com/*
-*youtube.com*
-*http://www.facebook.com/*
-*http://www.facebook.com*
-http://www.facebook.com
-*http://www.facebook.com/sharer.php?s=*
-*http://www.facebook.com/sharer.php?*
-*http://www.facebook.com/sharer.php*
-*https://www.facebook.com/*
-*https://www.facebook.com*
-*facebook.com/*
-*https://www.facebook.com/
-*https://www.facebook.com
-*http://www.facebook.com
-https://www.facebook.com/
-*facebook.com/*
-*facebook.com*
-*http://www.facebook.com/campaign/landing.php?*
-*https://www.facebook.com/campaign/*
-*https://www.facebook.com/campaign*
-*photobucket.com/*
-*http://fliker.com/*
-*http://www.fliker.com/*
-*www.flicker.com/*
-*youtube.com/*
-*twitter.com/*
-*photobucket.com/albums/*
-*blogspot.com*
-*static.flickr.com/*
-*http://static.flickr.com/*
-*http://imageshack.us/*
-*http://imageshack.us*
-*https://imageshack.us/*
-*imageshack.us/*
-*http://www.addthis.com/bookmark.php*
-*http://www.addthis.com/*
-*http://www.addthis.com/?*
-*http://www.facebook.com/*
-*http://twitter.com/*
-*https://www.paypal.com/*
-*https://www.paypal.com/cgi-bin/webscr?cmd=*
-*https://www.paypal.com/cgi-bin/webscr?*
-*https://www.paypal.com/cgi-bin/*
-*https://www.paypal.com*
-*http://www.paypal.com/*
-*http://www.paypal.com*
-*http://youtube.com/*
-*http://www.youtube.com/*
-*http://adclick.g.doubleclick.net/pcs/click?*
-*http://adclick.g.doubleclick.net/pcs/*
-*http://adclick.g.doubleclick.net/*
-*http://adclick.g.doubleclick.net*
-http://adclick.g.doubleclick.net
-*http://adclick.g.*
-*http://adclick.*
-*http://adclick*
-*https://photobucket.com/*
-*http://photobucket.com*
-*http://photobucket.com/*
-*http://doubleclick.net/*
-*http://doubleclick.net*
-*http://ad.doubleclick.net/*
-*http://ad.doubleclick.net*
-*http://ad.doubleclick.net/*
-http://ad.doubleclick.net
-http://ad.doubleclick.net/
-*http://clk.atdmt.com/*
-http://googleads.doubleclick.net
-*http://googleads.g.doubleclick.net/*
-*http://googleads.g.doubleclick.net*
-*http://googleads.g.*
-*http://googleads.g*
-*http://googleads.*
-*http://googleads.doubleclick.net/*
-*http://googleads*
-*https://googleads*
-*googleads.g.doubleclick.net/*
-*googleads.g.doubleclick.net*
-*http://adclick.g.doubleclick.net/*
-*adclick.g.doubleclick.net*
-*http://adclick.g.doubleclick.net*
-*http://adclick*
-http://adclick
-http://adclick.g.doubleclick.net
-*http://doubleclick.net*
-http://doubleclick.net
-https://googleads.doubleclick.net
-*https://googleads.g.doubleclick.net/*
-*https://googleads.g.doubleclick.net*
-*https://googleads.doubleclick.net/*
-*http://googleads.g.doubleclick.net/*
-*http://googleads.g.doubleclick.net*
-*http://googleads.g.doubleclick.net
-*http://googleads.g.doubleclick.net/
-*https://googleads.g.doubleclick.net/*
-*https://googleads.g.doubleclick.net*
-*http://googleads*
-*http://googleads.com*
-*http://googleads.net*
-*www.google.com/chrome*
-*www.google.com/*
-*http://www.google.com/*
-*http://doubleclick.net/*
-*http://ad.doubleclick.net/*
-http://doubleclick.net
-http://ad.doubleclick.net
-*static.flickr.com*
-*farm2.static.flickr.com*
-http://www.flickr.com/
-*http://www.flickr.com/*
-*counter-counters.com*
-*counter.com*
-*blogger.com*
-*.blogspot.com*
-*blog.com*
-*blog.com/*
-*http://gravatar.com*
-*http://www.randomracket.com*
-*http://www.assoc-amazon.com*
-*/forum/*
-*/forums/*
-*/chat/*
-*/blogs/*
-*/irc/*
-*farm2.static.flickr.com*
-http://www.flickr.com/
-*http://www.flickr.com/*
-*counter-counters.com*
-*counter.com*
-*blogger.com*
-*.blogspot.com*
-*blog.com*
-*blog.com/*
-*http://gravatar.com*
-*http://www.randomracket.com*
-*http://www.assoc-amazon.com*
-*http://www.assoc-amazon.com/*
-http://www.assoc-amazon.com
-*www.assoc-amazon.com*
-*http://itunes.apple.com/us/podcast/*
-*https://itunes.apple.com/us/podcast/*
-*https://itunes.apple.com/us/*
-*https://itunes.apple.com/*
-*https://itunes.apple.com*
-*http://itunes.apple.com*
-*http://itunes.apple.com/us/*
-*http://itunes.apple.com/*
-*http://www.itunes.apple.com*
-*www.itunes.apple.com*
-*http://babelfish.altavista.com/*
-*http://babelfish.altavista.com*
-*http://www.play-asia.com/*
-*http://server.cpmstar.com/click.aspx?*
-*http://server.cpmstar.com/*
-*http://ad.doubleclick.net/*
-*http://www.play-asia.com/*
-*http://wordpress.org/*
-*blogspot.com/*
-*/feed/*
-/feed/
-*.infl
-*http://www.YouTube.com*
-*http://www.YouTube.com/*
-*/rss.xml*
-*/rss.php*
-*rss.*
-*http://server.cpmstar.com/click.aspx?*
-*http://server.cpmstar.com/*
-*http://validator.w3.org/check?uri=referer*
-*http://jigsaw.w3.org/css-validator/*
-*http://adserver.adtechus.com/*
-*http://adserver*
-*http://www.amazon.com*
-*/podcast/*
-*http://ads.brand.net/*
-*http://ads.*
-*https://docs.google.com*
-*http://docs.google.com*
-*docs.google.com*
-*https://www.tumblr.com/*
-*http://www.tumblr.com/*
-*tumblr.com/*
-*http://pinterest.com*
-http://pinterest.com
-*http://www.pinterest.com/*
-*https://www.pinterest.com/*
-*www.pinterest.com/*
-*pinterest.com/*
-*https://www.google.com/maps?q=*
-*https://www.google.com/maps?*
-*https://www.google.com/maps*
-*http://www.google.com/maps?q=*
-*http://www.google.com/maps*
-*http://www.google.com/*
-*http://www.google.com/
-http://www.google.com/
-http://www.google.com
-*www.google.com*
-http://www.google.com
-google.com
-*https://plus.google.com/*
-*http://plus.google.com/*
-*http://plus.google.com*
-*www.plus.google.com*
-plus.google.com
-*plus.google.com*
-*www.plus.google.com/*
-*https://plus.google.com/share?url=*
-*http://plus.google.com/share?url=*
-*https://plus.google.com/share?*
-*http://plus.google.com/share?*
-*https://plus.google.com/*
-*https://plus.google.com*
-*http://plus.google.com/*
-*plus.google.com/*
-*plus.google.com*
-*http://store.yahoo.com/*
-*http://phobos.apple.com/*
-*https://store.yahoo.com/*
-*https://store.yahoo.com*
-http://store.yahoo.com/*
-http://store.yahoo.com*
-*https://phobos.apple.com/*
-*http://del.icio.us/post?url=*
-*http://del.icio.us/post?*
-*http://del.icio.us/*
-http://del.icio.us
-*http://del.icio.us*
-*http://delicious/*
-*http://delicious*
-*https://plusone.google.com/*
-*http://plusone.google.com/*
-*https://plusone.google.com*
-*http://digg.com/*
-*https://www.google.com/adsense/*
-*https://www.google.com/*
-*http://www.google.com/adsense/*
-*http://www.google.com/*
-*http://www.google.com*
-http://googleads.g.doubleclick.net/
-*http://googleads.g.doubleclick.net/*
-*http://googleads.g.doubleclick.net*
-*http://googleads*
-*http://store.yahoo.com/cgi-bin/clink?*
-*http://store.yahoo.com/cgi-bin/*
-*http://phobos.apple.com/*
-*http://feeds.feedburner.com/*
-*https://feeds.feedburner.com/*
-http://feeds.feedburner.com/*
-*.xml
-*http://www.community.wikia.com/*
-*http://www.twitch.tv*
-*http://www.twitch.tv/*
-*twitch.tv/*
-*/rss.php*
-*http://www.game-advertising-online.com/index.php?*
-*http://www.game-advertising-online.com/*
-*http://server.cpmstar.com/click.aspx?*
-*http://server.cpmstar.com/*
-http://googleads.g.doubleclick.net/
-http://googleads.doubleclick.net/
-http://googleads.g.doubleclick.net/
-http://googleads.doubleclick.net/
-https://googleads.g.doubleclick.net/
-https://googleads.doubleclick.net/
-*http://googleads.g.doubleclick.net/*
-*http://googleads.doubleclick.net/*
-*http://googleads.g.doubleclick.net/*
-http://googleads
-*http://googleads.g*
-*http://googleads*
-*http://social.zune.net/podcast/*
-http://social.zune.net/podcast/
-*http://social.zune.net/*
-http://social.zune.net/
-*http://social.zune.net*
-*https://plus.google.com/*
-*http://plus.google.com/*
-https://plus.google.com/
-http://plus.google.com
-http://plus.google.com/
-*http://babelfish.altavista.com/babelfish/urltrurl?url=*
-*http://babelfish.altavista.com/babelfish/urltrurl?*
-http://babelfish.altavista.com*
-*http://itunes.apple.com/au/podcast/*
-*http://itunes.apple.com/*
-http://itunes.apple.com/au/podcast/
-*http://itunes.apple.com*
-*http://stitcher.com/listen.php*
-*http://stitcher.com/listen.php?*
-*http://stitcher.com/*
-http://stitcher.com
-*googlecommerce.com
-*http://googlecommerce.com/
-*https://googlecommerce.com/
-*http://googlecommerce.com/*
-*https://googlecommerce.com/*
-http://googlecommerce.com
-*http://www.linkedin.com/pub/*
-*http://www.linkedin.com/*
-*http://www.linkedin.com*
-http://www.linkedin.com
-*linkedin.com*
-*http://steamcommunity.com/*
-*http://steamcommunity.com*
-http://steamcommunity.com
-*http://www.reddit.com/user/*
-*http://www.reddit.com/*
-*http://www.reddit.com*
-http://www.reddit.com
-*.tumblr.com/*
-*http://www.tumblr.com*
-*www.tumblr.com*
-*tumblr.com*
-*/podcast/*
-*http://www.gtopstats.com/?r=*
-*http://www.gtopstats.com/?*
-*http://www.gtopstats.com*
-*http://addthis.com/bookmark.php?*
-*http://addthis.com/bookmark.php*
-*http://addthis.com/bookmark*
-*http://addthis.com/*
-*http://addthis.com*
-*http://www.addthis.com/*
-*https://plus.google.com/*
-*https://plus.google.com*
-*http://plus.google.com/*
-*http://plus.google.com*
-*plus.google.com/*
-*plus.google.com*
-*https://plus.google*
-*http://google.com/*
-*http://www.google.com/*
-*https://google.com/*
-*https://www.google.com/*
-*google.com/*
-*http://office.microsoft.com/*
-*https://drive.google.com/*
-*http://drive.google.com/*
-*drive.google.com/*
-*drive.google.com*
-*https://play.google.com/store/apps/*
-*https://itunes.apple.com/us/app/*
-*https://play.google.com/*
-*https://itunes.apple.com/*
-*https://play.google.com*
-*https://itunes.apple.com*
-*itunes.apple.com/*
-*https://apple.com/*
-*http://apple.com/*
-*https://itunes.com*
-*http://itunes.com*
-*http://play.google.com*
-*http://itunes.apple.com*
-*http://www.play-asia.com/*
-*http://play-asia.com/*
-*http://play-asia.com*
-*http://pinterest.com/*
-*http://pinterest.com*
-*pinterest.com*
-*https://www.paypal.com/cgi-bin/*
-*https://www.paypal.com/*
-*https://www.paypal.com*
-*http://www.paypal.com*
-*http://astore.amazon.com/*
-*http://astore.amazon.com*
-*http://amazon.com/*
-*https://amazon.com/*
-*https://amazon.com*
-*amazon.com*
-*http://www.reddit.com/submit?url=*
-*http://www.reddit.com/submit?*
-*http://www.reddit.com/*
-*http://www.reddit.com*
-http://www.reddit.com
-*https://www.reddit.com*
-*https://www.reddit.com/*
-*http://redirect.disqus.com/url?url=*
-*http://redirect.disqus.com/url?*
-*http://redirect.disqus.com/*
-*https://redirect.disqus.com*
-*http://redirect.disqus.com*
-*http://disqus.com*
-*disqus.com*
-*/feed/*
-*http://youtu.be/*
-*http://youtu.be*
-*http://youtu.*
-*http://amzn.com/*
-*http://amzn.com*
-*https://amzn.com/*
-*https://astore.amazon.com/*
-*https://astore.amazon.com*
-*http://astore.*
-*https://astore.*
-*http://astore*
-*http://feeds.feedburner.com/*
-*http://phobos.apple.com/*
-*http://www.play-asia.com/*
-*http://store.yahoo.com/*
-*http://nintendo.wikia.com*
-*http://www.nintendo.wikia.com*
-*https://twitter.com/*
-*https://www.twitter.com/*
-*http://twitter.com/*
-*http://twitter.com*
-*twitter.com/*
-*twitter.com*
-*tumblr.com/*
-*tumblr.com*
-*http://www.bing.com/local/*
-*https://www.bing.com/*
-*https://www.bing.com*
-*http://www.bing.com*
-*www.bing.com*
-http://www.bing.com
-www.bing.com
-bing.com
-*http://www.yelp.com/biz/*
-*http://www.yelp.com/*
-*http://www.yelp.com*
-*https://www.yelp.com/*
-http://www.yelp.com
-*http://www.angieslist.com/*
-*http://www.yellowpages.com/*
-*http://www.dexknows.com/*
-*http://local.yahoo.com/*
-*http://local.yahoo.com*
-*https://local.yahoo.com/*
-*http://www.yahoo.com/*
-*http://www.yahoo.com*
-*https://www.yahoo.com*
-*www.yahoo.com*
-*yahoo.com/*
-*download-software-freeware.com*
-*http://download-software-freeware.com*
-*https://www.yahoo.com*
-*http://denver.citysearch.com/*
-*http://denver.citysearch.com*
-*http://www.citysearch.com/*
-*https://www.citysearch.com/*
-*http://www.linkedin.com/pub/*
-*http://www.linkedin.com/*
-*https://www.linkedin.com/*
-*http://steamcommunity.com/*
-*http://steamcommunity.com*
-*https://steamcommunity.com/*
-*http://www.steamcommunity.com/*
-*https://steamcommunity.com*
-*http://steamcommunity.com/groups/*
-http://steamcommunity.com/
-*http://www.twitch.tv/*
-*http://www.twitch.tv*
-*http://twitch.tv*
-*www.twitch.tv*
-*www.twitch.tv/*
-*https://www.twitch.tv/*
-*https://www.twitch.tv*
Other massive external sites that are huge and often linked to average sites
and you may want to prevent their download:
-*http://api.wikia.com/*
-http://www.wikia.com/Advertising
-http://www.wikia.com/Careers
-http://community.wikia.com/wiki/Wikia:Licensing
-*http://www.wikia.com/Gaming*
-http://www.wikia.com/Gaming
-*http://www.wikia.com/Entertainment*
-http://www.wikia.com/Entertainment
-*http://www.wikia.com/Lifestyle*
-http://www.wikia.com/Lifestyle
-http://www.wikia.com/Privacy_Policy
-http://www.wikia.com/Wikia
-*http://www.wikia.com/Wikia*
| |
