a precision about robots.txt when mirroring locally 
(http://127.0.0.1/site/index.php) :
Winhttrack looks for <http://127.0.0.1/robots.txt> instead of 
<http://127.0.0.1/site/robots.txt>