Need help? Check out our Support site, then


please help,google stopped crawling my site 12 days ago

  1. Strange my last post was indexed but others not, still not crawled

  2. This has been going on for 2 weeks now. I still see same results from google webmaster tools

  3. Anything yet?

  4. We are seeing other reports on Google not crawling some of our sites, and we're trying to figure out right now what may be causing that issue.

    The page loading issue is separate, and our developers are also digging into that one.

    At this time, I have no further updates for you beyond that, but I will post here when I have something to report. I appreciate your patience.

  5. Thanks Jackie / appreciating the support

  6. This is getting depressing , after a year building a following I am setting hitting all time lows for traffic

  7. It could be worse. I used to average 3600 hits per day. WordPress.com disassociated local from general tag pages and my hits have fallen to 200 a day. So keep perspective.

  8. We are still investigating this issue, as it appears to be widespread, but I do not yet have an answer for you. Please rest assured that this is a priority for us and I will keep you informed whenever I have more information.

  9. @jackiedana
    My last two posts did not appear in Google. Worse still look at this report on my blog "Your blog is not indexed by Google"
    http://ismyblogworking.com/thistimethisspace.com

    Look at the feed validation report http://feedvalidator.org/check.cgi?url=http%3A%2F%2Fthistimethisspace.com

    Then note the blog is several years old and has over 700 published posts. This blog was founded on April 23, 2007.

  10. @timethief, I understand. Like I said, this is a widespread issue and we're digging into it both on our end and with Google. Unfortunately at this time I have no more information to report than that, but I can promise we are trying to resolve it.

  11. @jackiedana
    okay ... :(

  12. I'm having a similar problem! I got a google staff reply...no sure if this helps...I documented it here:

    http://en.forums.wordpress.com/topic/googlenews-stopped-crawling-weird-problem?replies=3

    We were getting so many hits and for a small newspaper like us (yes, we're a physical newspaper, as well) that means a lot! So getting back on googlenews would be a big deal. Not sure if it is actually a bandwith issue, as the googlenews rep said in that email.

  13. @pawirenews

    You have unlimited bandwidth at WordPress.COM, there is NO bandwidth upgrade you can buy. If your site went viral at 1,000,000 page views in a day, that is a rounding error on the servers here, you are on the same server system as such "minor" players at CNN.com

    That Google is having trouble is to my best guess some sort of integration issue, also very odd that the problem only seems to be with sites that have domain mapping, my other sites that do not have domain mapping are not affected, and Google is crawling at the normal rates

  14. @TT & @Jackie

    I have also seen the "not indexed by Google" for my site for quite a while, I still get traffic from Search engines, I don't use ismyblogworking on my site very often, but robots.txt is always set correctly, but the not indexed has been for some time

  15. @auxclass

    Can you tell me what I'm doing wrong? Not sure what to do about domain mapping, etc?

    Really not a tech guy, here.

  16. Doesn't sound like you're doing ANYTHING wrong. Just wait for staff to sort it out.

  17. Okay...So you think it is just arbitrarily happening?

  18. So you think it is just arbitrarily happening?

    No not at all, there is a reason, but there are a lot of moving parts for a web site and search engines - but we don't know why the indexing has stopped, might be a change here might be something that Google did or a combination

  19. Okay, cool. Thank you.

  20. You be welcome

  21. Site is barely even loading anymore .....

  22. On the crawling issue, we think we've made some progress with Google, but we are still working on this.

    I still have no explanation why your site is loading so slowly, but I will continue to look into it.

  23. http://developers.google.com/speed/pagespeed/insights/?url=www.solobagging.com&tab=desktop

    Jackie, I don't know if this helps, but found this through Google page speed insight

    Leverage browser caching
    Setting an expiry date or a maximum age in the HTTP headers for static resources instructs the browser to load previously downloaded resources from local disk rather than over the network.
    Eliminate render-blocking JavaScript and CSS in above-the-fold content
    Your page has 6 blocking script resources and 8 blocking CSS resources. This causes a delay in rendering your page.

    Of course, it's like a foreign language to me....

  24. Sorry for that 1st link- that was accidental

  25. Based on my most recent tests, loading an uncached version of your site in both Firefox and Chrome, and doing a speed check at http://www.webpagetest.org/, it seems that your page is loading much more quickly. One of our developers also had the same results. I'm not sure if you made a change on your end or something changed on ours, but it seems to be working properly now.

    I think you can take the pagespeed data from Google with a grain of salt, as many websites "fail" their tests. Try checking some popular sites and see what the results are there, and compare them, and you'll see what I mean.

    As far as the Google crawling goes, it sounds like they have improved the rate at which they are crawling our sites, so that *may* help you and the others out. Please keep an eye on that and let me know if you see any improvement, or not.

  26. Jackie, I didn't make any changes on my end, but I just did the test at the link you provided and received an F rating for 'first byte time' with a first load time of 23.190s? Most of the other ratings came in at F also.

    As far a crawling goes, the average has shot back up to above average number before the crash :)

    Again thanks for your help and still trying to see if load time can be improved

  27. When I just ran a speed test, the things that seem to be loading the slowest are the traveldude images and one of the Gravatars in your Community widget:

    http://www.webpagetest.org/result/131104_ZT_TV9/1/details/

    (Hopefully that link works... I'm not sure how long the URLs persist).

    You might play around with that information to see if you can reduce your load times.

    The crawling issue has been resolved. Thanks for your report, which matches what we've heard elsewhere... it's actually better than before! :)

  28. @Jackie

    Thanks - I noticed the crawl rates went back up two days ago - there still seems to be a glitch in the number of URL's submitted & indexed - seems to be down one URL (I added a new Post during the not quite right time frame)

Topic Closed

This topic has been closed to new replies.

About this Topic