Tuesday, October 17, 2006 at 3:14 PM
We've added a few new features to webmaster tools and invite you to check them out.Googlebot activity reports
Check out these cool charts! We show you the number of pages Googlebot's crawled from your site per day, the number of kilobytes of data Googlebot's downloaded per day, and the average time it took Googlebot to download pages. Webmaster tools show each of these for the last 90 days. Stay tuned for more information about this data and how you can use it to pinpoint issues with your site.
Crawl rate control
Googlebot uses sophisticated algorithms that determine how much to crawl each site. Our goal is to crawl as many pages from your site as we can on each visit without overwhelming your server's bandwidth.
We've been conducting a limited test of a new feature that enables you to provide us information about how we crawl your site. Today, we're making this tool available to everyone. You can access this tool from the Diagnostic tab. If you'd like Googlebot to slow down the crawl of your site, simply choose the Slower option.
If we feel your server could handle the additional bandwidth, and we can crawl your site more, we'll let you know and offer the option for a faster crawl.If you request a changed crawl rate, this change will last for 90 days. If you liked the changed rate, you can simply return to webmaster tools and make the change again.
Enhanced image search
You can now opt into enhanced image search for the images on your site, which enables our tools such as Google Image Labeler to associate the images included in your site with labels that will improve indexing and search quality of those images. After you've opted in, you can opt out at any time.
Number of URLs submittedRecently at SES San Jose, a webmaster asked me if we could show the number of URLs we find in a Sitemap. He said that he generates his Sitemaps automatically and he'd like confirmation that the number he thinks he generated is the same number we received. We thought this was a great idea. Simply access the Sitemaps tab to see the number of URLs we found in each Sitemap you've submitted.
As always, we hope you find these updates useful and look forward to hearing what you think.
7 comments:
Wouldn't it be nice to show a sum over all links in all sitemaps? So i.e. it would be easier to compare this count and the count of the "site:"-query.
best regards, mark
Is Crawl Rate Broken? - I had a "Normal" crawl rate for my site for several months and was getting a good number of crawls from googlebot. However, I changed my crawl rate to "Faster" on 1/18/08 and my site has not be crawled since...almost a month now. It just stopped indexing my site.
Sitemap is still downloaded by Google regularly but the bot is not reading my site...
www.profiletech.net
Anybody else experience this? Question is, do I switch it back to Normal or will it delay it again?
rojozak...
I've seen the same issue. The Crawl rate activity has not been updated.
Mine has not updated since Feb 26, 2008.
firetech.blogspot.com
my site hasn't been crawled since feb 22, 2008...really frustrating, as it was about a day old when that happened...most of the pages have been replaced and only the old ones come up on a search. I\'ve put in for them to be removed, but they are still pending...and the new ones haven't been indexed....have a sitemap...and nothing!
Ok. Here's the problem. First, I signed up for trafficblazer at go daddy. What it showed me was that I had a boatload of invalid internal links.
Apparently, no one told me not to use apostrophe's in the page names...it made the site uncrawlable...
Hi everyone,
Since over a year has passed since we published this post, we're closing the comments to help us focus on the work ahead. If you still have a question or comment you'd like to discuss, free to visit and/or post your topic in our Webmaster Help Group.
Thanks and take care,
The Webmaster Central Team
Post a Comment