WordPress.com Forums » Tag: blocked URLS - Recent Posts http://en.forums.wordpress.com/tags/blocked-urls WordPress.com Forums » Tag: blocked URLS - Recent Posts en Wed, 22 May 2013 05:00:43 +0000 http://bbpress.org/?v=1.1-alpha-2539 kathrynwp on "How do I correct a blocked page?" http://en.forums.wordpress.com/topic/how-do-i-correct-a-blocked-page#post-1062592 Tue, 06 Nov 2012 20:46:53 +0000 kathrynwp 1062592@http://en.forums.wordpress.com/ Your robots.txt looks fine:

http://saailerdotcom1.wordpress.com/robots.txt

Here are some tips on getting more traffic and views:

http://en.support.wordpress.com/getting-more-views-and-traffic/

If you have any further questions just let us know.

]]> saailer on "How do I correct a blocked page?" http://en.forums.wordpress.com/topic/how-do-i-correct-a-blocked-page#post-1062444 Tue, 06 Nov 2012 18:55:49 +0000 saailer 1062444@http://en.forums.wordpress.com/ No comments and no clicks...The administrative page is blocked by robot.txt...I have no experience and need help to solve fault...David Burbee

]]> timethief on "How do I correct a blocked page?" http://en.forums.wordpress.com/topic/how-do-i-correct-a-blocked-page#post-1062443 Tue, 06 Nov 2012 18:54:56 +0000 timethief 1062443@http://en.forums.wordpress.com/ Hi there,
You blog is visible and accessible not to worry. I just recently posted a similar thread. What I discovered is that if I had clicked the link provided by Google webmasters then I would have seen that the files that were blocked were files that i wanted to be blocked.

]]> saailer on "How do I correct a blocked page?" http://en.forums.wordpress.com/topic/how-do-i-correct-a-blocked-page#post-1062438 Tue, 06 Nov 2012 18:52:50 +0000 saailer 1062438@http://en.forums.wordpress.com/ Page is being blocked. Webmaster says could be caused by robots.txt. Please tell me how to correct
Blog url: http://saailerdotcom1.wordpress.com/

]]> macmanx on "Blocked URLs - robots.txt - Google Webmaster reports" http://en.forums.wordpress.com/topic/blocked-urls-robotstxt-google-wembaster-reports#post-1059770 Sat, 03 Nov 2012 23:37:08 +0000 macmanx 1059770@http://en.forums.wordpress.com/ You're welcome!

]]> timethief on "Blocked URLs - robots.txt - Google Webmaster reports" http://en.forums.wordpress.com/topic/blocked-urls-robotstxt-google-wembaster-reports#post-1059739 Sat, 03 Nov 2012 23:08:59 +0000 timethief 1059739@http://en.forums.wordpress.com/ @macmanx
Thanks so much for the clarity. I really appreciate it.

]]> macmanx on "Blocked URLs - robots.txt - Google Webmaster reports" http://en.forums.wordpress.com/topic/blocked-urls-robotstxt-google-wembaster-reports#post-1059738 Sat, 03 Nov 2012 23:07:56 +0000 macmanx 1059738@http://en.forums.wordpress.com/ That's actually quite normal, and you can see the blocked directories in the robots.txt files http://onecoolsitebloggingtips.com/robots.txt and http://thistimethisspace.com/robots.txt

All pages below the directories are blocked, but they're all pages that you don't want indexed anyway.

User-agent: *
Disallow: /next/

Keeps search engines from indexing each Next page on your blog. It's better for the search engines to index the individual posts, not Page 1 of posts, Page 2 of posts, and so on. Also, it prevents duplicate content.

User-agent: *
Disallow: /activate/

Prevents search engines from indexing your blog's activation URL. Who knows how they would get it, but regardless they shouldn't index it.

User-agent: *
Disallow: /wp-login.php

Prevents search engines from indexing your login form.

User-agent: *
Disallow: /signup/

Prevents search engines from indexing signup forms. Again, who knows how they would get it, but regardless they shouldn't index it.

User-agent: *
Disallow: /related-tags.php

Prevents search engines from indexing what is essentially a gigantic pile of words when not parsed correctly.

User-agent: *
Disallow: /cgi-bin/

Prevents search engines from indexing any operational CGI scripts.

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/

Prevents search engines from indexing your admin directory and WordPress resource files.

So, in summary, there are a lot of pages blocked by blocking those directories, but you don't want any of those pages on Google.

]]> auxclass on "Blocked URLs - robots.txt - Google Webmaster reports" http://en.forums.wordpress.com/topic/blocked-urls-robotstxt-google-wembaster-reports#post-1059293 Sat, 03 Nov 2012 15:43:15 +0000 auxclass 1059293@http://en.forums.wordpress.com/ Is My Blog Working shows the robots.txt file as allowing search engines to index your site - some files and folders are blocked all the time relating to program files etc.

Last time I linked to ismyblog I was caught in the spam filter - maybe things will be better this time

http://ismyblogworking.com/onecoolsitebloggingtips.com

]]> timethief on "Blocked URLs - robots.txt - Google Webmaster reports" http://en.forums.wordpress.com/topic/blocked-urls-robotstxt-google-wembaster-reports#post-1059291 Sat, 03 Nov 2012 15:42:04 +0000 timethief 1059291@http://en.forums.wordpress.com/ P.S. I'd appreciate Staff fixing the dyslexic typo error in the thread title too.

]]> timethief on "Blocked URLs - robots.txt - Google Webmaster reports" http://en.forums.wordpress.com/topic/blocked-urls-robotstxt-google-wembaster-reports#post-1059286 Sat, 03 Nov 2012 15:37:36 +0000 timethief 1059286@http://en.forums.wordpress.com/ I don't log in to my Google Webmasters account very often. This is what greeted me when I logged into my Google Webmasters account:

robots.txt file
http://onecoolsitebloggingtips.com/robots.txt
Blocked URLs
robots.txt 20
Downloaded
13 hours ago
Status
200 (Success)

robots.txt file
http://thistimethisspace.com/robots.txt
Blocked URLs robots.txt 18
Downloaded
9 hours ago
Status
200 (Success)

I am asking for Staff help with rectifying this situation by removing the robots.txt re: the blocked URLs please.

]]>