Google Webmaster Central Blog - Official news on crawling and indexing sites for the Google index

Tell us what you think!

Wednesday, June 24, 2009 at 2:17 PM

(Cross-posted on the Google Product Ideas Blog)

The Webmaster Central team does our best to support the webmaster community via Webmaster Tools, the Webmaster Central Blog, the Webmaster YouTube Channel, Help Center, our forum, and a fellow named Matt Cutts.

If you've got ideas and suggestions for Webmaster Central - features you want, things we can do better - tell us. From now until Friday, July 24, 2009, Product Ideas for Webmaster Central will be open for feedback. Every suggestion you add will be seen not only by the Webmaster Central team, but by other users and webmasters. We'll review every submission, and we'll update you regularly with our progress and feedback.

The more feedback the better, so get started now.

Posted by Sagar Kamdar, Product Manager, Webmaster Tools
The comments you read here belong only to the person who posted them. We do, however, reserve the right to remove off-topic comments.

33 comments:

g1smd said...

Check the filenames for downloaded External Links and for HTML Suggestions. There isn't a consistent format for the name.

Some use site_type_date, others type_site_date. Can we have SiteName_DateTime_ReportType as the naming for all of them please?

With SiteName_DateTime_ReportType they will alpha sort into date order for each site, with sites being alpha sorted.

szury said...

One feature: tell the site owner before you penalize his site. I still don't know why my first site got penalized 2 years ago.

Errioxa (Spanish speaker) said...

-more than 50,000 urls in each sitemaps

-We can tell Google when to crawl.

-We can configure our web language, not by location

-Option that we exclude certain folders or subdomains on Google News

Tweb said...

Tell us what is creating a penalty that has lasted over 4 years plus so that we can resolve it once and for all and not keep shooting blanks in the dark, meanwhile, destroying our commerce and making us detest Google.

http://www.travel-ascending.com

Fokker said...

Same problem here, tell us how and why are you penalizing a site.

brandonrichards said...

Definitly better error reporting with the sitemaps section. "There was a problem..." simply isn't enough information to debug.

The option like google analytics has to add another user to administrate the account.

The analytics app and the webmaster tools would be nice to have in one location (app) and one verification, instead of two apps and two verifications.

Mo said...

I am a permanent reader of your Content. I like it much, most the Video Tutorials.

But sometimes I feel lost, when I can't find specific information. This is like a big journey through to many small pages with less content.

For example: technical informations, specifications. These infors are poor, sometimes (I mean, there are no information)

Olivier said...

Just give us insight into whether or not we have a penalty and what the cause is. Legit websites are not getting the information they need because you're afraid to feed blackhatters. That's not fair.

manfmnantucket said...

absolutely agree with many above requests for transparency about penalties. Microsoft provides a binary 'blocked' flag. To refuse to do so just because you can (because goog controls search and webmasters must obey it) - thats anticompetitive behavior. Such secrecy costs small businesses disproportionately to large ones, who can afford $$ to diagnose penalties, which inherently involve subjective judgement. Goog Quality rating is very much like a Credit rating and should be regulated.

sbrinkmann said...

Two thinks would be great:

1. I would like to delete content from the index faster (takes some days today) and easier. We block some urls with robots.txt AND deleted them via the webmasters tools, but Googlebot still tries to get these files. :-(

2. A daily or weekly report of the error messages, that the Googlebot generates so that I don't have to download the list.

Thanks!
Sebastian

manfmnantucket said...

Another thing that would help: provide access to *historical* rankings /keywords info. This would permit diagnosis of sudden traffic drops by allowing us to compare top search terms from N weeks/months ago. Especially useful for those of us who dont usually track those things closely. I think the historical data was provided in an early version of the new GWT release, needs to be there for keywords and historical backlinks as well. Otherwise how can you know whether traffic halt is due to linkscape change or penalty or...?

Web Design said...

They can't tell you exactly why a site is being penalized, can't you see that people would abuse this information to pollute the index?

I would really like to see a function for recommending or setting "seasonal" sitelinks. I know we have some control but being able to specify specific subpages would be very and sometimes, especially at increasing relevance for you guys and conversion for us.

manfmnantucket said...

Usability: provide standard 'paging' at bottom of long lists. For large site with 100K backlinks its impossible to single-page thru list... should have the usual:

<< < 1 2 3..n > >>

Dan said...

A feature to export landing pages & terms that are getting impressions and click through rates.

Thanks
Dan

manfmnantucket said...

re @Webdesign: They can't tell you exactly why a site is being penalized, can't you see that people would abuse this information to pollute the index?

A: they dont need to tell 'exactly' why, just yes/no.

B: Its not about protecting goog's index. If there were a diverse search ecosystem, goog's notion of quality would only matter to some sites thus gamers would not impact much.

GOOG controls income of many and can 'fine' us by taking traffic away. What if the IRS could fine/penalize and take your income -without even telling you what you are accused of? Similar situation here... another form of Net Neutrality needs to be ensured.

BTW Im not saying any of this is intentional on goog's part. One consequence of growing so large is you cant see the ants you crush.
With size/power comes responsibility. We all should be communicating about this.

Jim Gaudet said...

For sure we need a better way to check for "bad neighborhoods" and GOOG penalties. Sometime I am not sure why Discus allows a comment on my blog, and I think that some of those may be causing issues on one of my sites, which hurts all my sites since they are interconnected.Uncool, help us fix this. I have to use other people's tools, but who knows what you do besides you?

Thanks for this opportunity!

Sagar Kamdar said...

Thanks everyone for your suggestions. It would be great if you could put them on our ideas list so others can vote for them: http://productideas.appspot.com/#16/e=1bb11

Therockchurchfb said...

I would just like to see a better diagnosis of problems/errors. Education, like this blog and that guy name mr. cutts.

Keep up the good work and I really like the new layout.

-luzie- said...

Hi Sagar,

see that translation gadget on the right side of each blogpost on Webmastercentral? Would be nice if instead of translate.google.com it could call the corresponding blogpost (if available) in the language choosen. Or why not have a list of little flags there for the same purpose? This should be search engine friendly also, as very related documents link to each other ;-)

-luzie-

kevin said...

In addition to sorting external links by total (which is awesome), let us sort them alphabetically again so we can find specific urls easier.

AJuly said...

It would be helpful to know why the site is being penalized and warned before it happens. The major reason we use Webmaster Tools is to try to make sure the sites we manage are OK with Google. To our best knowledge we have been/are following "Webmasters guidelines" yet still got penalized. Contacting Google through Webmaster Tools yields no response or results. When submitting reconsideration request webmasters are supposed to acknowledge they've done a "bad thing" although in many cases (as it seems) they have no idea what that is (which has happed to us even after religiously checking the site against "Webmasters guidelines").

wayne said...

After years of using Google Ifind it is now useless, anytime I type in something I get the sites I am looking for but when I click-on a site I get redirected to some ad site and I have to shut down the browser because the back arrow just keeps me at the ad site. I have had to use another search engine, and I just wonder why this is happening just when MS is releasing Bing. HMMMMMMMMMMM.

Jeff said...

While I like the new interface, two things that you have changed really affect my ability to service clients. 1) the accuracy of the inbound link data is off. 2) forcing us to verify both the www and non-www versions of the site in GWT and not providing a consolidated view is really cumbersome. I had been pulling certain reports out of your interface that now require a lot more leg work to compile.

pratik said...

I have submited my site http://www.travelnepal.0fees.net more than a couple of weeks but my site isn't indexed yet by google why?

I am feeling very sad why google doesn't indexed and gives any suggestions to my site.........

Mikes said...

maybe top search queries be made more real time. it's just too late!

g1smd said...

I like the fact that links to www and the links to non-www are listed separately. This makes the job of looking for stray links just that one step easier.

I already register both with WMT, and had seen Google attempting to crawl the non-canonical (usually non-www version) URL on occasions, even though the non-www to www redirect was in place the same day the domain was registered, and weeks before there was any site live on the web.

Fresh Standard said...

For each domain in Webmaster Tools dashboard there should be a single verification not twice (it's too congested otherwise). Also if you remove a verification file it takes Google sometimes a very long time to see this in order to reverify. This could be seen as a security issue for a great many site owners who may have removed staff etc.

For Geotargeting there was a consensus that currently learning, and commerce practically stops at the border. Setting a country preference takes upwards of a month for results which just isn't realistic in a busy business world. Having to build almost redundant sites with almost entirely the same content for different regions does not make sense for a lot of sites/businesses. By adding continents or having the ability to highlight countries in a list we can narrow down our target market substantially. In the ajax pulldown for this feature we could have it warn people with a "What is this," with docs explaining geotargeting etc. It's better to have people doing accurate geotargeting than a lot of sites out there not being able to hit the international market. If their results are pertinent then they should in fact show up based on the content of the searchers content. I think most people can agree it's important to share information, and right now there are some simple interface issues in Webmaster tools that definitely limit this.

Currently for geotargeting one of the largest factors of being ranked in a region is by the ip. For most people spending a fortune on hosting is ridiculous when there's much cheaper alternatives available in other regions. The problem is if we want to rank locally for top ranking we almost have to use these local hosts. I think the fix to the geotargeting interface in Webmaster Tools might fix this. You could even have it by city to specify where the business or site is centrally located for even more accurate results.

Leor said...

I have no where else to go. my Gmail account along with manyyyyyyy others has nto been able to send messages for the past 2 days. It just says "loading" at the top of the page and that no text is entered into the message. you need to correct this, many people are upset... check the blog for Q's&A's for gmail. Thank you

marketraisecorp said...

Thanks Google for 1st time to allow us for the suggestion.
-Well 1st i would like that Google should have more transparency in their help that they provide of webmaster and analytics as for any newbie person the reports they diagnose are not as easy to understand and as help doesn't helped them much they have to go to forums for the answers which in turn resulting into many unwanted results..
-In bound Out bound links report should be more clear.
the query link:http://www.mydomain.com which show the backlink should be accurate with the data been shown in webmaster.
-SERP result should be shown for all the keywords which are been showing
- Actual Page rank apart from the toolbar one should be shown in the webmaster
-Merging webmaster and analytics As someone above also have suggested that both should coincide into one is the great suggestion as one account would provide us the complete information

webmaster said...

The old webmaster tools "home" page had a really nice feature that showed whether or not a site had a sitemap, and if it did, how many errors were found in the sitemap.

As I have over 100 different sites on my account this ability to quickly see which sites had sitemap errors was a great tool.

So my question is, does the redesigned webmaster tools offer a way to quickly check hundreds of sites for sitemap errors without having to individually open each sites dashboard?

If not, I would suggest that this feature is added.

Thanks!
-Philip

Kumar said...

Links to the site
This is showing the external links pointing to the purticular site including the Inner pages also.Ther previous version webmaster too displayd total number (Sum of 301 redirecte URL's links) of extarnal links for the corresponding URL. But the new Beta version shows the individual URL's external links even the it was redirected. comparing to this old one was most helpful. I suggest to to show count as old version.

Penalty Intimation and Error Reason
Please inform us why our site is being penalized. If you give the intimation before Google Bane the site, that will be very helpful to fix the errors.

And last one Create an option to mention our site convenient time crawl our site . or give some periodic option as Daily, weekly, 2 weekes or monthly like. This will be most beneficial.

SMALA P2-85 said...

Please check the search fo "jual rumah surabaya", "rumah surabaya", "properti surabaya" or "surabaya property", you'll find low quality website. Have you ever compared with Yahoo ? I think there is something wrong with your aligarithm.

Aaron said...

I want to know how many clickthroughs actually occurred. The percent is useful, but the actual numbers would be great.

Many thanks.
http://aaronsreality.blogspot.com