It's doing ok now with jpegs and everything, added one more url and chose not
to follow the robots.txt rules. Thank you.