| Subject: Re: prob mirroring w3schools.com |
Author: Abhishek |
Date: 10/05/2005 18:51 |
| | Please note don't use quotes (') while entering text.
Enter the site address to download
go to 'Set Options'
tab to 'Scan Rules'
click on 'Include Link(s)..'
in 'Criterion:' select 'File names with extension:'
in 'String:' enter '*'
click on 'Add'
#next
tab to 'Spider'
in 'Spider:' select 'no robots.txt rules'
click on 'OK'
that's done. | |
|
|
|
|
e
Created with FORUM 2.0.11