Stopping crawling by search engines

  • Author
    Posts
  • #98939

    I’ve checked the “I would like to block search engines, but allow normal visitors” option, and yet my blog still appears when I search for its title through Google. It’s been at least a month since I selected that option, so it’s not a question of Google having time to update its crawling habits. What can I do to remove my blog from search results ASAP?

    #99298

    timethief
    Member

    Suffice to say that you must immediately stop using category tags so your blog posts do not appear in the wordpress.com category tag pages.
    Google has cached your blog articles. You can take also take direct action to have them removed from the Google cache http://googlewebmastercentral.blogspot.com/2007/04/requesting-removal-of-content-from-our.html lorelle explains how to do this http://lorelle.wordpress.com/2007/04/22/how-to-remove-your-blog-content-from-google/
    Lastly note that Google is not the only search engine and that it frequently takes 3-4 months for their caches to be cleared as well.

    #99299

    Thanks for your response. I don’t actually use the category system, though I’m now pursing the Google links. Hopefully that will help.

    #99301

    raincoaster
    Member

    Retroactively setting your blog as not indexable is not nearly as effective as setting it that way from the beginning. At this point not only Google but MSN, Yahoo, Ask.com, and all their overseas divisions such as .co.uk will have caches of your blog as well. You will have to contact them one by one and ask them to delete the caches, or simply wait it out for a few months until they vanish.

    #99329

    drmike
    Member

    Older pages don’t get spidered that often which is why it takes a bit.

The topic ‘Stopping crawling by search engines’ is closed to new replies.