Seed Sites for Search Engine Web Crawls

Social Sites as Seed Sites

Would search engines be better if they started web crawls from sites like Twitter or Facebook? Wikipedia or Mahalo? DMOZ or the Yahoo Directory?

Seed sites are the pages that search engines start crawls upon. If those are diverse enough, they make it more likely that search results will provide a diverse and more complete set of search results.

The Web refreshes at an incredible rate, with new pages added, old pages removed, and words pouring out from blogs, news sites, and other genres of pages. Ecommerce sites showcase new products and eliminate old ones. New sites launch and old domains expire. Because of this quick rate of change, finding good seed sites on a regular basis may be a wise thing to do

Search engines attempt to keep their indexes of the Web as fresh as possible, and send out crawling programs to find the new, update changes, and explore disappearances. Failure to do so means outdated search engines that deliver people to deleted pages, overwritten content, and stale indexes that miss out on new sites.

When a search engine starts crawling the Web, it often begins by following URLs from chosen seed sites to explore other pages and other domains. But how does a search engine choose those seed sites that it starts at?

Continue reading “Seed Sites for Search Engine Web Crawls”

New Reason to Submit Businesses to Google Maps: Google Navigator and Personal Information Management Integration?

If you have a business where you want customers to visit in person, and you haven’t added and/or verified that business in Google Maps, you may want to consider doing so. You can do this regardless of whether you have a web site or not.

The Google Navigator system that Google has developed for mobile phones allows people to navigate to destinations in their cars, and even search for types of nearby businesses rather than specific businesses at specific addresses. So, if you want to find a nearby Thai restaurant, you can type in “Thai restaurant” and Google will either show you the nearest one it knows about, or provide a list of restaurants that you can choose from.

A new patent application from Google hints at even more features from such a navigation system that can associate information from your personal information management software into the Google navigation system, from programs such as contact lists, calendars, and task lists.

For instance, you set up a task list on your smart phone to visit a new client, and then pick up stamps and mail out letters, drop off drycleaning, and go grocery shopping. You’ve also added the new client’s address to your personal information system contact list and calendar.

Continue reading “New Reason to Submit Businesses to Google Maps: Google Navigator and Personal Information Management Integration?”