The theme I'm using uses posts to insert pictures into a gallery page. Google is indexing the picture post pages and I don't want it to. I have made a robots.txt file disallowing these posts and Google's robots.txt validator says it's working:
Disallow: /9 (that is the slug of the post page)
I made the robots file about 30 hours ago so maybe it indexed it before that or maybe something is wrong. I also have submitted an xml sitemap that only includes the pages I want indexed.
The posts that are disallowed just showed up on Google today. I am now putting the Robots Meta plugin on the site to place noindex on those posts. Can anyone tell me if this is correct? Is there anything else I can do? Is there a way to get those links off Google asap?
Its correct robot.txt+noindex meta tag
Added 'password protected page' + make the post 'private' could be use too.
Depending of your site pagerank, please wait until google spider crawl and update your site..
A lot of big site also has their content being cache by google even if the have remove the content.
Making it private keeps it from showing up on the gallery page.
Yeah.. sorry it midnight here *_*
No problem, just thought there might be a way to mark private and still have it in the gallery.
Jarret Minkler answers:
I could also be indexing it through the tags or categories pages?
I don't use tags, but categories is what is inserting the picture in the gallery page. I just set Robots Meta to "prevent indexing of category archives". And robots.txt has Disallow: /category/*/* (copied from Wordpress Codex). Maybe it will be right next time it is crawled. Thank you for your reply.