Tuesday, January 13, 2009 at 5:12 AM
It's been well over three years since we initially announced the Python Sitemap generator in June 2005. In this time, we've seen lots of people create great third-party Sitemap generators to help webmasters create better Sitemap files. While most Sitemap generators either crawl websites or list the files on a server, we have created a different kind of Sitemap generator that uses several ways to find URLs on your website and then allows you to automatically create and maintain different kinds of Sitemap files.
Our new open-source Google Sitemap Generator finds new and modified URLs based on your webserver's traffic, its log files, or the files found on the server. By combining these methods, Google Sitemap Generator can be very fast in finding these URLs and calculating relevant metadata, thereby making your Sitemap files as effective as possible. Once Google Sitemap Generator has collected the URLs, it can create the following Sitemap files for you:
In addition, Google Sitemap Generator can send a ping to Google Blog Search for all of your new or modified URLs. You can optionally include the URLs of the Sitemap files in your robots.txt file as well as "ping" the other search engines that support the sitemaps.org standard.
Sending the URLs to the right Sitemap files is simple thanks to the web-based administration console. This console gives you access to various features that make administration a piece of cake while maintaining a high level of security by default.
Google Sitemap Generator is a server plug-in that can be installed on both Linux/Apache and Microsoft IIS Windows-based servers. As with other server-side plug-ins, you will need to have administrative access to the server to install it. You can find detailed information for the installation in the Google Sitemap Generator documentation.
We're excited to release Google Sitemap Generator with the source code and hope that this will encourage more web hosters to include this or similar tools in their hosting packages!
Do you have any questions? Feel free to drop by our Help Group for Google Sitemap Generator or ask general Sitemaps question in our Webmaster Help Forum.
About Google Sitemap Generator
Our new open-source Google Sitemap Generator finds new and modified URLs based on your webserver's traffic, its log files, or the files found on the server. By combining these methods, Google Sitemap Generator can be very fast in finding these URLs and calculating relevant metadata, thereby making your Sitemap files as effective as possible. Once Google Sitemap Generator has collected the URLs, it can create the following Sitemap files for you:
- XML Sitemaps for Web Search according to the sitemaps.org standard
- Mobile Sitemaps for mobile-friendly websites
- Code Search Sitemaps for source code that you make available to users
In addition, Google Sitemap Generator can send a ping to Google Blog Search for all of your new or modified URLs. You can optionally include the URLs of the Sitemap files in your robots.txt file as well as "ping" the other search engines that support the sitemaps.org standard.
Sending the URLs to the right Sitemap files is simple thanks to the web-based administration console. This console gives you access to various features that make administration a piece of cake while maintaining a high level of security by default.
Getting started
Google Sitemap Generator is a server plug-in that can be installed on both Linux/Apache and Microsoft IIS Windows-based servers. As with other server-side plug-ins, you will need to have administrative access to the server to install it. You can find detailed information for the installation in the Google Sitemap Generator documentation.
We're excited to release Google Sitemap Generator with the source code and hope that this will encourage more web hosters to include this or similar tools in their hosting packages!
Do you have any questions? Feel free to drop by our Help Group for Google Sitemap Generator or ask general Sitemaps question in our Webmaster Help Forum.
63 comments:
only a tip: you can update the google to do same this site (can chance in preferences)?
http://www.blackle.com/
or
http://www.godark.us/
help to save energy??
sorry post here, I don't know were I can send a mail.
This is a helpful tool. I hope it will help get new sites crawled more quickly.
Do I always sumbit a new sitemap contain all links of my sites, or only a update webpage links sitemap?
Do Google services like Blogger automatically generate sitemaps? Can the Google Sitemap Generator be set up to work in conjunction with them as end users don't have access to the server?
Most of the normal user doesnt have access to their server other than ftp and control panel
@KL: I would suggest submitting all URLs - it's easier to maintain. With "last modification date" in the Sitemap, we'll find new URLs quickly.
@Ben of AusMedWeb: Yes, Blogger automatically submits RSS feeds for Sitemaps (and you can't submit them any other way). I assume it's similar for most online content management systems.
@sunil By making it open-source we hope that providers of hosting that traditionally only provide FTP/control-panel access will be able to implement it (or similar tools) in their control panel software.
@dark_steybow You might want to check out http://googleblog.blogspot.com/2007/08/is-black-new-green.html & http://www.google.com/intl/en/earthhour/
How can i access this tool to design a google sitemap for my website?
please help me.
will this tool help my sitemap get fully indexed, in some of my projects, we have generated sitemaps following sitemap.org best practices, but when comparing indexed URLs to the ones on the sitemap, a lot of URLs from the sitemap are not getting indexed and URLs that are not on the sitemap are getting organically indexed (this is great by the way).
But if this is happening why do I really want to spend too much time and effort on generating sitemaps if I'm going to have better results from organic crawling?
It seems that this tool is really going in-depth of web server logs, which I feel is great. Thanks Google for this tool
So I see Linux... any plans to support BSD or will it already be supported? Linux is Unix so I don't see why not, Apache being the primary concern anyway.
What you said about blogger submitting sitemaps - does that mean that when my Webmaster Tools Panel says that I have not yet submitted a sitemap for my Blogger blog, I can ignore it because Blogger has already done so?
You can optionally include the URLs of the Sitemap files in your robots.txt file..........
This is news to me. Can someone explain this? I was under an impression that robots.txt file is used primarily to direct visiting robots, one such directive being where sitemap.xml file is. I didnt know I could actually list the URLs in the robots.txt file.
After installation, I receive the Service Unavailable error :(
Here are the couple of errors I see in the event viewer:
The HTTP Filter DLL C:\Program Files\Google\Google Sitemap Generator\\IIS6_Filter_Win32.dll failed to load. The data is the error.
Could not load all ISAPI filters for site/service. Therefore startup aborted.
Why can't Google offer a simple online sitemap generator?
While Google has a list of recommended online tools (built by others), at any one time, most are either broken, offline, or simply Not Very Good.
Not every webmaster has server access - what about the Little Guy?
@Rash:
This is caused by too-strict-file-access-control:
http://groups.google.com/group/google-sitemap-generator/browse_thread/thread/623feb100ce531c1
@Adam Audette:
FreeBSD support is in planning:
http://groups.google.com/group/google-sitemap-generator/browse_thread/thread/bd38c015ba130cf8
@RKA:
URL of sitemaps can be included in robots.txt, like:
Sitemap: http://example.com/sitemap.xml
@Andrew:
It's a limitation of this tool.
This tool is opensourced, we encourage host providers to integrate this feature in their system.
And please contribute your ideas about online tool in our google-group. We may make it better!
Thanks.
@Jolly Martin:
Can your make your question more clear and post it in our forum?
Thanks.
@Anna:
Yes.
It's great that this tool has been released as open source for deployment by hosting companies but for me either an online generator tool (built by Google) or a sitemap generation script that I can download from Google Code would be more useful right now :-)
Me again. You can definitely get Google Webmaster Tools to generate your sitemap for you with Blogger and it doesn't seem to do so by default (at least it doesn't show in GWT).
I found an easy way to do it is from Statistics --> Subscriber Stats then add one. Not sure what difference if any that will make but hopefully it will remove the annoying message that I haven't generated a sitemap for the Blog yet.
@Ben of AusMedWeb: If you're using Blogger, you don't have to submit a Sitemap at all -- it's done for you automatically. You can see the reference in your robots.txt file, it has a line for "Sitemaps:". At the moment, these Sitemaps are not visible in Webmaster Tools, but they're used just the same. If you want to list on in Webmaster Tools, I'd recommend using the same URL that is listed in your robots.txt file.
@Chaoley Check out the tools at http://code.google.com/p/sitemap-generators/wiki/SitemapGenerators -- it's a good collection of all sorts of Sitemap generators, many of which you can run either online or on your local computer. There are a lot of good tools out there.
why it is always difficult to install
most webmasters does not have access to server because of sharing.
why not Google give a script that can be installed just by FTP and be more simple like other alternatives?!
Which one of you commenting about this tool has access to their server? Most of us don't. A usful tool would be an online one where most can use for sites other than blogging.
in which language this google sitemap generator (beta) is developed?
hi:
we are still on windows Server 2000with IIS 5... will the sitemap generator work on this platform??
thanks,
rahul
@Equitymaster
Google Sitemap Generator has been tested on the following (Windows) platforms:
Microsoft Windows 2003 Server (32 bit or 64 bit) with Internet Information Service (IIS) 6.0
Microsoft Windows 2008 Server (32 bit or 64 bit) with IIS 7.0
...from the page http://googlesitemapgenerator.googlecode.com/svn/trunk/doc/gsg-installation.html
Thanks you very much for the beneficial information .
I wonder why you did not include video in the sitemap? I see that you guys have mentioned how to create video sitemaps but I have had a rather difficult time in creating one. I thought it would be rather easy for you guys to include this in this new sitemap. Is there a specific reason video was left out?
Thanks You
http://www.yourchippewavalleyhome.com
This is great. Now i think everyone uses this
The URL of the location has numbers after com i.e. .com:1234/...
Where you enter the sitemap url you are unable to get the url in correctly.
How to I get past this problem?
How to build sitemap for blog at blogspot ?
thanks
I Still comfuse to add sitemap using my RSS. My RSS using Feedburner :
http://feeds2.feedburner.com/Ponselzoner
i was submit my blogspot sitemap with atom format(many tutotial said they accept RDF format like RSS or Atom) but... google search engine didn't crawl at all. whats wrong?
I am using blogger (http://newsblog1st.blogspot.com) and everytim i try to submit a sitemap, i always got erros saying site map is not available for this link. I submit http://newsblog1st.blogspot.com/rss.xml and /atom.xml. and it doesn't work. please help! how can i make google crawl my site soonest?
So I see Linux... any plans to support BSD or will it already be supported? Linux is Unix so I don't see why not, Apache being the primary concern anyway.
dlilalquds
hello
i use site map but my traffic from google is very low please help me for traffic
http://adsensetips4money.blogspot.com
I am using this site map generator from google on both my sites. It is a brilliant tool and denitley helps that you site gets crawled by google much quicker. I just have one problem at the moment and i hope someone can help me.
On my one site www.aspigon.co.za the sitemap is ok everytime i load it but on www.drivingdirect.co.za i keep getting warnings to say that the sitemap has set the same priority for all my pages. It has infact got my index page at priority 1.o and all my other pages on the site at o.80.
What are the implications if i don't get this fixed and HOW DO I GET IT FIXED ????
Great tool, wish I'd had this years ago.
how can i use sitemap as this style:
http://aramnet.blogspot.com/atom.xml
?
http://komputerinside.blogspot.com/2009/12/my-link77.html
create own site map
great sir..
nice step for SEO our blog..
thanks
Is there an Indonesian version?
How can I create a sitemap for blospot blog
Is there anyway to create a site map for blospot..?
Thank you very much. that was wery useable tool i ever know.
its useless unless google provide xml file uploading features to blogger , what is the use of generating sitemap file when you cant upload it
hi. i am using a sitemap generator recommended by google webmaster for my blog, but i am having a problem uploading the sitemaps generated. i keep geting this error massage, "blogger failed to uload your sitemap, there needs to be at least one skin, and in this case we found 0". pliz help me rectify this problem. i am compt language illeterate. thank you.
For blogger user I use Google Web master tools to subscribe my blogger site and that's work yet ^_^
How can i change my google sitemap generator password, i haven't used it since long time, i have checked the documentation but it is not clear where do i have to put those codes, please help
still learn how to use this.. in my feeds/default/post have X label.... what its that means????
how can i add a sitemap for my blog?
Wow! This is very helpful tool for my blog.
Please can somebody inform me of what kind of sitemap is working for Blogger ? How do I solve this ?
i think i make a wrong sitemap on my website www.polarizednightdrivingglasses.com,woorank tool can't find it
i want to submite sitemap for my blogspot site.... http://v1pic.blogspot.com/
Help me what to do?
yes site map is most important
as
sitemap.xml
and sitemap.xml.gz
i have http://getacho.com/sitemap.xml
not gz
Can any one help me with sitemap for my website www.surexconsulting.com
any advise
Thank
Anurag
Hi everyone,
Since over a year has passed since we published this post, we're closing the comments to help us focus on the work ahead. If you still have a question or comment you'd like to discuss, free to visit and/or post your topic in our Webmaster Central Help Forum.
Thanks and take care,
The Webmaster Central Team
Post a Comment