I try to take Google’s advice to focus on users instead of search engines, but without traffic, there are no users. Given that Google can generate a lot of traffic for a new website, its important to know how sites are added to the Google index and what can affect where it appears in the search results for a user inquiry.

The problem is that not everyone wants to take the time (myself included) to learn how best to present a website to Google and other search engines so that its content and quality is accurately reflected.

During my experience as a web master, I’ve learned to do the following things when published websites to ensure that they are included in search engines:

  • Examine robots.txt to make sure that search engines are allowed to crawl and index the site
  • Make sure that the webserver isn't trying to set cookies or start sessions for the web crawlers
  • Use descriptive language in links
  • Use Google Webmaster tools
  • Use a sitemap

This list just scratches the surface though. The “fine art” of web publishing and promotion is constantly changing and evolving.