I had the same problem, then i tried excluding the robots,txt in rules. It
worked like a charm!