Monday, July 26, 2010 at 2:50 PM
Webmaster Level: AllWhen Googlebot crawls your site, it’s expected that most URLs will return a 200 response code, some a 404 response, some will be disallowed by robots.txt, etc. Whenever we’re unable to reach your content, we show this information in the Crawl errors section of Webmaster Tools (even though it might be intentional and not actually an error). Continuing with our effort to provide useful and actionable information to webmasters, we're now sending SiteNotice messages when we detect a significant increase in the number of crawl errors impacting a specific site. These notifications are meant to alert you of potential crawl-related issues and provide a sample set of URLs for diagnosing and fixing them.
A SiteNotice for a spike in the number of unreachable URLs, for example, will look like this:
We hope you find SiteNotices helpful for discovering and dealing with issues that, if left unattended, could negatively affect your crawl coverage. You’ll only receive these notifications if you’ve verified your site in Webmaster Tools and we detect significant changes to the number of crawl errors we encounter on your site. And if you don't want to miss out on any these important messages, you can use the email forwarding feature to receive these alerts in your inbox.
If you have any questions, please post them in our Webmaster Help Forum or leave your comments below.
39 comments:
Boy, this keeps getting better and better! Thank you for all you do to make it easier for us!
http://www.photosforsouls.com/sitemap.xml
I hope you'll add support for HTTP status 410 (currently you display it as 404), as I'm afraid I'm going to be flooded with bogus messages.
Better indeed.
Only problems I'm having at the moment good testing for "#!" style links. Doesn't seem to be a good method to test if the crawler is reaching the right _escaped_fragments_ pages.
Its a good step in the right direction in improving the communication from Google via Webmaster Tools to the webmasters and website owners.
Great feature!
We like to get errors down to zero and fix them ASAP. Perhaps you could add an option to send an email whenever a new crawl error is detected?
@Magic Toolbox: As said in the blog post, use the Email forwarding feature to receive the messages directly in your inbox.
Nice, Thanks...
Great new feature, thank to always improve it.
We agree with Magic Toolbox, we think an email alert would be a sensible idea and would add value to Web Masters.
That's Good news for me...
I can't keep checking webmaster tool for any error. This service will help not only to me, but to many.
Very good news. It would be beneficial for those who have a lot of websites and don't have time to check all of those sites.
Awesome. Very crucial news!
Why webmasters give me information that many url of my site restricted by robot? I don't write anything to restrict google robot. Help me please
Good update for all of us!
Thanks. Keep these nice updates coming.
Kinda off topic sorry but I have a suggestion for reducing redundancy of the meta tags in a webpage.
You know the [meta name="description" content="bla bla bla"] and similar tags right...
Now imagine if it instead was [meta name="description" href="#intro"]
and then you could just markup the first paragraph of this blogpost with that as an id and a search engine like Google would then know that the paragraph is also the meta description.
Similarly author,date,copyright, etc. could be referenced this way.
The meta content is now not just meta content but it's also user visible this way,
and everyone benefits from not needing to duplicate say the first paragraph into the meta description, this means even less loading times overall.
And here’s the Meta href proposal at the WHATWG wiki.
Defiantly find Site Notifications helpful thanks for latest updates.
Gopi Krishan
Awesome, thanks for news.
It is good move and specially it is an added feature for webmasters.
google do it once again.
need googlebot visit to my blog :(
http://omponk.routelink.net/blog/
I asked people at a webmaster forum and unfortunately didn't get any results.
I've been using webmaster tools to make any corrections to our site (http://www.interclass.kiev.ua) and it's been very useful and given many ideas of how to improve it. (Thank you for such a nice tool :)
Unfortunately this month crawling mistakes have been appearing for more and more pages: now already 65!!! pages :(((
Crawling errors
Unreachable (65)
www.site/page/ Error 200
Could you advice me of anything until it's too late...
Thank you in advance!
Oh, thanks Google, I love it
http://www.pitvietnam.com
binbuu article was very informative
nice post!
Regards
Oliver
How do i replace a url? the one that is trying to crawl is no longer valid.
nice blog u have...
pls click below to visit my blog...
http://bannedarea.blogspot.com/
dear simon
about www.updatejo.com crawling errors
what i have to do to solve these errors ?
thank you much
I visit your blog second time. Thanks for sharing this.
http://wofgtg.blogspot.com/
Thanks.
How improve fast websites pages indexing on google as soon as possible?in spite of already submitted sitemap.xml with reverent site and doen social bookmarking on most site but google indexing is not increase.
HELP! our website http://www.stateofl3.com/
doesn't even show up in Google, there are many links on the net to our site but are not to be seen! what happens?
mail me to zeroguzman@live.nl
This is a significant improvement. Thanks. Will be definitely useful.
Hi,
Few Days Back i launched new real estate portal www.buy-sellproperty.co.in and put few real estate projects of builders, initial, projects are at top position, now no projects is coming in top 10-15 pages, when users search those project through keywords.
Please Tell me why my all project is blacklisted in google.
Sounds like a useful feature, cheers guys :)
Hello sir,
I m prem, my site www.fxtay.com not show in google. when i check indexing. and my ranking are down. so plz suggest me that how can i again improve my ranking.
Thanks,
Prem Prakash
I'm agree. It was supposed to tell google webmaster or reprimand those webmasters who make mistakes, even though sometimes unintentional mistakes. Rgrds
Hello , currently i have over 286 not followed error in Crawl errors. In the detail section it said redirect error , but all the urls are working fine - and none of them are redirecting to a new urls.
can you please let me know what should i do to resolve this issue ?
thanks
My site is running quite
why this comment is posted
http:/ / mymuskan. com/ forum/ index. php? showtopic= 0 Not Found Aug 15, 2010
Hi everyone,
Since over a year has passed since we published this post, we're closing the comments to help us focus on the work ahead. If you still have a question or comment you'd like to discuss, free to visit and/or post your topic in our Webmaster Central Help Forum.
Thanks and take care,
The Webmaster Central Team
Post a Comment