| > Hello, I would like to crawl only text files from
> web page (do not download jpg, png, zip and other
> non-text files).
By text I assume you mean html pages
-* +mime:text/html
> I tutorial I can see option:
> -%A php3=text/html
assume is for broken sites
| |