update:

found out whats robots.txt for -> better results now
i'll check options step by step in httrack and understand them -> my goal
since today is understand programs like httrack and how web works cause i
final realised i am often in situation where i must know how such programs
work

what i can't find out is how httrack is limited by java or other similiar
languages -> what it copy's and what not