Never mind, it was a problem with robots.txt. I know changed the options to not
index robots.txt.