WordPress.com Forums » Topic: Googlebot Site Crawling Issue - (robots.txt) http://en.forums.wordpress.com/topic/googlebot-site-crawling-issue-robotstxt WordPress.com Forums » Topic: Googlebot Site Crawling Issue - (robots.txt) en Sun, 26 May 2013 06:14:17 +0000 http://bbpress.org/?v=1.1-alpha-2539 johndilligent on "Googlebot Site Crawling Issue - (robots.txt)" http://en.forums.wordpress.com/topic/googlebot-site-crawling-issue-robotstxt#post-1097770 Mon, 17 Dec 2012 23:37:55 +0000 johndilligent 1097770@http://en.forums.wordpress.com/ Thanks.

Ya'll do this to me every friggin' time.

Every...

Time.

]]> johndilligent on "Googlebot Site Crawling Issue - (robots.txt)" http://en.forums.wordpress.com/topic/googlebot-site-crawling-issue-robotstxt#post-1097251 Mon, 17 Dec 2012 16:57:50 +0000 johndilligent 1097251@http://en.forums.wordpress.com/ Hey, this is what Google says:
_______________________________

Googlebot is blocked from http://thedirtylowdown.wordpress.com/

Blocked by line 3: Disallow: /
Detected as a directory; specific files may have different restrictions

]]> johndilligent on "Googlebot Site Crawling Issue - (robots.txt)" http://en.forums.wordpress.com/topic/googlebot-site-crawling-issue-robotstxt#post-1097237 Mon, 17 Dec 2012 16:49:40 +0000 johndilligent 1097237@http://en.forums.wordpress.com/ Happy Holidays to all!

After a year of good crawling with no apparent issues,
I decided I needed to get away from my blog for awhile
and turned it all off as best I could without deleting it
entirely.

I set my public visibility to private and blocked search
engines from indexing my site -- amongst other things.

I've spent the last day attempting to get it all back up
online, with public visibility and bot crawling.

But Google says: "Googlebot is blocked from http://thedirtylowdown.wordpress.com/" and
the current robots.txt file shows nothing but
"Disallow" all the way down the page through
like 12 line items: disallow everything.

How can I fix this? Thanks.

]]>