This post is primarily for webmasters, so I apologize to my non web-savvy readers.
As site owners we are concerned with having our sites quickly and completely indexed by search engines. There is plenty of argument on the subject of which search engine is best, but Google is certainly the biggest. Google, like other engines, sends out its spiders on a regular basis and looks for new sites and new pages within sites.
Google will find your site by one of the following methods:
It follows links from other known sites to yours. That’s why people are always asking you to link to their site, and why you should be asking others for the same favor.
It crawls URL’s that are submitted by webmasters like yourself.
It crawls sitemaps that are created and submitted by webmasters.
Allowing Google to find your site through it’s normal crawl process can take a very long time, possibly months. If you don’t really care about your listing in Google this is certainly the easiest way to go, but if it matters to you at all the other two options are better.
Submitting your url to Google will speed things up a bit, but you still are not assured that Google will find every page on your site. If you are a blogger, and you probably are if you are reading this on my site, each of your posts represents a new and different page that is searchable by google users. Having all of those pages properly indexed by the search engines will direct more people to your site.
The best way to get your site listed completely and quickly (quickly is relative to the months you might have to wait otherwise) is to submit a sitemap to Google. A sitemap is a file that is generated by you, or by some software that you initiate as the webmaster. Google likes it sitemaps in XML format. Explaining XML is beyond the scope of this post, but if you are interested, you can start here.
Generating an XML sitemap by hand is possible, but would be tedious and painful. Thankfully there are numerous programs out there that will do the job for you with the click of a button. You can search Google for “site map generator” and find about 14,300,000 references. There are a lot of good tools out there. You can pay for them if you like pretty buttons and graphics, but this is a huge waste of money in my opinion since so many are free.
I have used several free sitemap generators. All of them have limitations on the number of pages they will index for you. Some are limited to a few hundred, others to a few thousand. This is probably more than enough for most bloggers, but if you have any business related sites it is not unheard of to have 5,000 pages or more. I have had sites with 11,000 pages.
I found a free web based sitemap generator this morning that has a limit of 50,000 indexed pages. Only the most insane of you will find this limit frustrating. This java program runs right from your browser and will save a .xml file right to your computer where you can FTP it to your site. FTP is another topic completely and again is beyond the scope of this post. If you don’t know FTP, you probably are not ready to start worrying about sitemaps anyway.
AuditMyPC.com hosts the tool I found this morning. Just click on the graphic icon, enter your URL, and VoilĂ ! It really is an easy tool to use, and the best I have found. If you like this or if you have found something better, leave a comment to share with other readers.
Again, the tool can be found at http://www.auditmypc.com/free-sitemap-generator.asp

Tags: Blog Help, Computers and The Internet by Jeffrey
2 Comments »