| Subject: Re: avoiding BL's |
Author: danday3953 |
Date: 12/02/2008 10:15 |
| | Also; Is there a way to bypass the /robots.txt check using HTTRACK? I know
it's based on user-agent submissions by the application... I think?
Also, does anyone in this forum have experience integrating HTTRACK into web
apps? | |
|
|
|
|
6
Created with FORUM 2.0.11
