Long Tail Studies by Web Search Researchers

Microsoft researchers are starting to take a closer look at search queries that are common and compare them to those that appear more rarely, in Heads and Tails: Studies of Web Search with Common and Rare Queries.

The paper immediately had me thinking of the writings of Chris Anderson, who started online marketers and ecommerce site owners thinking about products offered on the Web differently, in an article that he wrote for Wired Magazine called The Long Tale.

The article became a book, and led to a blog by its author, and has inspired many folks to look at ecommerce while paying attention to the long tail.

EBay was also taken the idea of the long tail enough to file a patent application that works on using it in the context of keywords. The patent filing has the incredibly long name Computer-Implemented method and System for Combining Keywords into Logical Clusters That Share Similar Behavior with Respect to a Considered Dimension.

An image from the patent application:

graph showing head and tail keyword terms

The Microsoft paper asks some interesting questions:

  • Do users behave differently on rare queries than on common ones?
  • What portion of rare queries represent rare informational goals, versus atypical means of specifying common goals?
  • How might answers to such questions guide research toward enhancing Web search experiences?

Some interesting answers to those questions, too. For instance:

The data suggests that search engines are less effective on tail queries than on non-tail queries in that users are less likely to click results and more likely to reformulate, and that such reformulations are common.

5 thoughts on “Long Tail Studies by Web Search Researchers”

  1. Hi Shor,

    Excellent point, with some query types displaying answers in the search results. Question Answering and definition results do away with having to click through any results, too.

  2. Aside from the findings (esp. concerning using full PLSA – good luck getting personal data!), the paper reminded me that there are 3 potential actions following a search query. Besides a query reformulation or click-through there is also an ‘end session’ action.

    For certain query types, the searcher’s answer is right there in the SERP and there is no need to click-through. With a move to universal search (images/videos/richer media), I’m assuming this ‘end session’ % will keep increasing.

    Again, great find Bill!

  3. Pingback: This Week In SEO - 7/27/07 - TheVanBlog
  4. Interesting study. I also read once that users who search using those more specific long tail queries show a higher conversion rate – for signups as well as for sales.

  5. Hi Robert,

    I believe there’s a good chance that when people use longer queries, and more specific terms within those, there is a good chance that if they find a relevant page in response, and if it’s a good match for the informational or situational need behind their search, that it can lead to conversions.

    More general searches might result in returning pages that just may not be a good fit for that need from searchers.

Comments are closed.