| Subject: Re: how can I get a 'list of files' from a website |
Author: Xavier Roche |
Date: 05/19/2002 20:30 |
| | > So I don't need the files themselves, but just the file
> names
Well, you can use the spider option (--spider, or in
Options/Experts Only: "store html files only") and activate
Options/Links/Test validity of all links. This will crawl
the website and check all links. To get the list, look at
the hts-cache/new.lst file. The current beta release (3.20-
b6) will also include a new.txt files which will be much
more complete (mime type, scan result, and so on..)
| |
|
|
|
|
7
Created with FORUM 2.0.11