http://unix.rulez.org/~calver/pictures/ 

this is just an example.

on basic default it starts off by downloading robots.txt 
and that's about it, i've read into the robot.txt but 
don't quite understand the rules of it.. is there an 
option to get all *.jpg or *.gif and override this? I've 
tried different things, proabably made it worse, heh. 


i'm sure i'm missing something simple here. Other than 
this i've loved the program for a while now. 

thanks in advance

jeff