| > Your log shows your mirroring blackviper.com not www.blackviper.com.
Doesn't matter. I also tried with www, but with no luck.
> You override this with options -> spider.
Could you please tell me which exactly option overrides robots.txt protection?
I tried to use --robots and --spider, but also had no luck. I'm still gettings
"403" error which says access to the sites is forbidden. Still I can access
the website from my web browser (Konqueror).
If I can access the web site using my web browser, may be I should try to
change httrack's browser ID to that one Konqueror uses? | |