| Subject: Re: only text web pages |
Author: William Roeder |
Date: 12/05/2011 17:19 |
| | > Hello, I would like to crawl only text files from
> web page (do not download jpg, png, zip and other
> non-text files).
By text I assume you mean html pages
-* +mime:text/html
> I tutorial I can see option:
> -%A php3=text/html
assume is for broken sites
| |
|
|
|
|
d
Created with FORUM 2.0.11