Need help? Check out our Support site, then


Robot.txt issue

  1. When I Google my website (http://farahmustafa.com), this is how it shows up:

    farahmustafa.com/
    A description for this result is not available because of this site's robots.txt – learn more.

    I have very little understanding about what a robots.txt file is, and I'm pretty new to this stuff. I verified my website using the Google Webmaster Tools. I tried searching up what a robots.txt file is but I need further clarification.

    What is a robots.txt file, and how do I change the description of my website on Google? I'm super confused. Thanks for your help!

    The blog I need help with is farahmustafa.com.

  2. thistimethisspace
    Member

    That means that when Google's search spiders first visited your site the site visibility was marked "private". It is now public so in time the search spiders will visit again index your content and that will change.

    You need to post frequently. It takes weeks for search engines to index content in a new blog and/or to re-index content under a new URL. What attracts search engines is unique content the cannot in posts that cannot be found anywhere else on the internet. Start now publishing original content posts frequently two or even three times weekly. For more information read > http://onecoolsitebloggingtips.com/2010/01/21/omg-i-cant-find-my-blog-on-google/

    The rule of thumb is to assign the least, not the most, combined number of only relevant categories and tags that accurately describe the post content. For tips on tagging see > http://onecoolsitebloggingtips.com/2013/03/15/quick-blog-post-tagging-tips/

    To verify blog ownership of a WordPress.com blog with the major search engines you must use this process > http://en.support.wordpress.com/webmaster-tools/
    Note: Even if you do not verify the blog the content will be indexed by search engines so don't feel panicky about this please.

    Note also that WordPress.com automatically supplies sitemaps for our blogs to search engines - we do nothing. http://en.support.wordpress.com/sitemaps/#xml-sitemaps-for-search-engines

  3. Thanks for your reply! That helps so much.

  4. thistimethisspace
    Member

    You're welcome and best wishes with your blog. :)

  5. http://ismyblogworking.com/farahmustafa.com - Shows your robots.txt file is set correctly

  6. Thanks again, thistimethisspace.

    Thanks auxclass. That's a neat website that I'll definitely bookmark.

  7. Thanks,

    You be welcome & good luck

Topic Closed

This topic has been closed to new replies.

About this Topic