> > Does HTTrack check robot.txt to see if it's allowed > to get a website or not?> > Yes, this is the default behaviour See also: <http://www.httrack.com/HelpHtml/abuse.html>
Xavier Roche
Created with FORUM 2.0.11