I wanted to download this site <http://www.9minecraft.net>
But it didn't download any of the files in www.*.minecaft.net except images.
So i tried downloading 1 internal site(Succeded) for example
with these rules: no robots, no browser id,Get non-Html files checked, Can
both go up and down, Go everywhere in the Web.
+*.zip +*.tar +*.tgz +*.gz +*.rar +*.z +*.exe +*.jar
note: it worked even without the lines +*.zip... , +mime...
Everything i needed was downloaded including zip files in external links as:
but when i tried downloading the whole site or multiple internal links:
(succesed with 2 links or 3)
as i increase the number of internal links less files are downloaded with the
same settings for example:
Sites to download:
as i increase the number of links to download, it stops downloading the zip
external files from some sites, and when i add about 20 internal sites, it
doesnt download any zip file at all. same thing happens when i try to download
the whole site, not 1 external zip file will be downloaded from
www.*.9minecraft.com - example: