Has Wordpress Killed Your Spider?

aordpress is a piece of software that I obviously barely ever mention, it scarely gets a mention in this blog, which runs on it and has currently mentioned it in 50-60% of posts.  But until recently you probably wouldn’t have noticed this, you may wonder why.

When installing Wordpress, there’s a little checkbox that says:

“Allow your blog to appear on search engines like Google and Technorati?”

Whilst in the past, I’ve generally remembered to check this box, but when quickly installing this blog after the original hosting company disappeared from the planet, I didn’t.

Naturally, I made sure to set up the robots.txt file correctly, and wrote the header myself when I created the theme. I hadn’t counted on Wordpress getting in the way though.Sneakily, WP had inserted a “noindex, nofollow” into the head of each page without my knowing, and as such Google and all the others were completely ignoring my site.

So. let this be a warning, and don’t let Wordpress kill your spider.

No related posts.