Robots.txt file
I’m an idiot. Google continues not to index my relatively new site, Project Mai Tai. Possible reason? I forgot to create a robots.txt file for it! D’oh!
I’ve heard Google will bounce a site for not having that. If that’s what’s been keeping me out, I’m happy to say the Google bots come along frequently, so with any luck they’ll index the site soon.
In the meantime, I feel like an idiot.

Categories:
Tags:
December 13th, 2006 at 2:49 am
I don’t think the missing robots.txt would make the SEs ignore the website. The reason lies very probably elsewhere. Anyway, good luck with Mai Tai!
December 13th, 2006 at 8:47 am
Another friend of mine pointed that out. I don’t know what to think. The domain DID exist before I bought it – from Wayback, it appears always to have been a harmless personal blog with nothing that looks to me like it would trigger a Google ban. But maybe it is banned, and I need to start over with another domain name.