| You have "s2" in your options. This tells httracker to
follow the rules outlined in the webmaster's "robots.txt"
file (in the web server's root directory). Unless the
webmaster allows wide open access to his server (i.e. puts
an "*" in the robots file next to "user_agent") or
specifically allows the agent that you are "impersonating"
to access his web site, your s2 option will crash on
hitting the robots.txt entry for "user_agent."
I think that's probably your problem and changing s2 to s0
(ignore robots.txt file) might do the trick.
Cheers,
Dan. | |