thx for replying, i tried what u said but it still doesn't work. I also tried
selecting the "no robot.txt rule" under Options > spiders but to no avail.