| Subject: Re: how to get data out of a site [ like this one ] |
Author: William Roeder |
Date: 09/19/2010 15:34 |
| | > need to grab the adresses of the shools here:
> <http://www.schulweb.de/de/schulsuche/index.html?ausw>
> ahl_1=0&auswahl_2=0&auswahl_3=0&suchtext=&zeigen2=+Z
> eigen+®ion=de
What does the log file say about robots.txt and did you override options ->
spider -> robots | |
|
|
|
|
b
Created with FORUM 2.0.11
