What would be the best options to download ALL pages from
<https://code.google.com/p> directory.
( all labels that come under <https://code.google.com/hosting/search?q=label> on
all pages )
For now i have been downloading thousands of pages
but /p/ directory has just one file per folder like:
logo7eff.png.tmp
logo7eff.html.tmp
logo7eff.png.tmp ...
(png one specially strange..)
(i add "go one link deep outside" also to get coders homepage front pages...
so it surfs on these for some reason now but would like to force it to focus
on /p/ directory )
Thank You! |