| > Hello,
>
> I am doing a very important project and I have to
> download thousands of search result pages of Google
> of hundreds of search terms. (This project of mine
> is very important. If you guys can point me to the
> right direction, then I will give this website a
> <http://www.google.com/search?as_q=yahoo&hl=en&num=10>
> &btnG=Google+Search&as_epq=&as_oq=&as_eq=&lr=&cr=&as
> _ft=i&as_filetype=&as_qdr=all&as_nlo=&as_nhi=&as_occ
> t=any&as_dt=i&as_sitesearch=&as_rights=&safe=images
if you change the num=10 to num=10000 you'll should get one huge page with all
the results
> Now, plz provide a detailed "step-by-step" guide as
> to how I can download all the 100 Google search
> result pages using HTTRACK.
Since the results are sites external to google, you'll have to set options ->
limits -> external
You also need goggle pages since the search result redirect through google
filter +*/search*
options -> limits -> internal = 1
> (While answering the above question, plz do a test
> run of HTTRACK on your PC.)
That's what I did using 3.32 and it started grabbing yahoo
I also have browser ID set to Mozilla/4.0 | |