Does Bing Time Shift Search Results?

The meaning behind search queries can shift over time, with some results being more relevant at different times of the year, and others becoming meaningful seemingly out of nowhere.

Search for “Independence Day,” around July 4th and chances are you want to learn about the holiday in the United States. Do the same search around August 15th, and you may be more likely to want to learn about the holiday in India. The same search back on July 3, 1996 might have been about the Will Smith movie of the same name.

An earthquake in one part of the world might quickly trigger many searches for more information around the globe.

Search engines tend to be oblivious to those types of changes, or at least they used to be. We’re seeing more “news” items making their way into Web search results pages for topics that are timely and reported upon in the media.

A Microsoft patent application describes how their search engine might pay more attention when query terms or phrases change in meaning over time, and how they might adapt search results to cover those shifts.

This might mean showing links to news articles in search results, it may also mean offering timely and topical query suggestions to use, and it could mean the search engine might rerank search results in response to changes in meanings for terms. These changes on search result pages would happen in an automated manner.

The Microsoft patent application is:

Search Queries with Shifting Intent
Inventors: Alan Dale Halverson, Krishnaram Kenthapadi, Nina Mishra, Aleksandrs Slivkins, and Umar Ali Syed
Assigned to Microsoft Corporation
US Patent Application 20100257164
Published October 7, 2010
Filed: April 7, 2009

Abstract

Techniques and systems are disclosed for returning temporally-aware results from an Internet-based search query. To determine if a query is temporally-based one or more query features are collected and input into a trained classifier, yielding a temporal classification for the query.

Further, if a query is classified as temporal, the query results are shifted by determining an alternate set of results for the query, and returning one or more alternate results to one or more users. Based on user interactions with the one or more alternate results, the classifier can be updated, for example, by changing the query to a non-temporal query if the user interactions identify it as such.

While the patent provides a fair amount of detail, I’m going to provide a very high level overview of how temporal queries might be identified, and how those might change to be classified as non-temporal.

Alternative search results might be created for queries that have been classified as temporal. So, for example, the term “independence day” might be identified as temporal, and search results in early August might include web pages about Indepence Day in India. Search results in late June and early July may focus more about Independence Day in the United States.

Classfying and Declassifying Queries as Temporal

To decide that a query has become temporal, the search engine might look for the following kinds of things:

  • Searchers start to rewrite their queries more frequently after looking at the search results. For instance, people searching for “independence day,” start reformulating their queries to something like “independence day India.”
  • Increases in the frequency of searches for certain queries can indicate a temporal nature, especially if they seem to happen around certain dates.
  • Increases in mentions of certain terms that appear as queries can indicate a temporal nature. These can include an increased frequency of mentions in news articles, in blogs and microblogging services, and even in increased updates to Articles within online encyclopedias, such at the article on India’s Independence Day in Wikipedia.
  • Other indications of burstiness, a sudden increased frequency focused upon a particular query term at certain times and/or in certain geographical locations, can indicate that a query has a temporal nature. These can include user interactions such as a sudden increase in searches, in click-through rates, in abandonment of search results, and in the reformation of queries.

The way people respond to alternative search results based upon the classification of a query as temporal may result in the classification being amended. Here are some things the search engine might look for to change a classification from temporal to non-temporal:

  • Searchers don’t choose the alternative results presented because of the temporal classification.
  • Searchers click upon results for pages that haven’t been added based upon the temporal classification.
  • Searchers switch over to a different search engine after seeing alternative temporal-based results.
  • Searchers click upon query refinement suggestions that haven’t been altered based upon a temporal designation.
  • Searchers don’t click upon query refinement suggestions that have been changed because of the temporal classification.

The “query features” mentioned above are only some examples of what the search engine might look for to determine if a query is temporal, or if it should be reclassified as being non-temporal.

The machine learning system that would make that decision would likely look at more than just one of those features to make those determinations.

As part of this process, the search engine might sometimes show alternative results to a number of searchers to see how they interact with the results. Their responses could determine whether or not the search engine continues to show alternative search results based upon a temporal classification.

Conclusion

It’s not unusual to see news items for some queries in all of the major search results these days. But, the idea of changing suggested query refinements, and shifting web pages in search results in response to timely and topical events is something that may not be as noticeable as those news results.

Bing is showing news articles about the toxic Red sludge flowing in some Hungarian waterways this morning, and offering “Red Hungary,” and “Hungary Sludge” as related search suggestions. The third “organic” result on the search results page for that query is a BBC article, “Criminal negligence inquiry into Hungary sludge…” but it’s not being presented as a news item, but rather as a web page.

It looks like Bing is identifying “Hungary” as a temporal query today, and is changing the search results we see to focus upon the environmental disaster taking place in that Country.

Chances are, they may be using the kinds of information that I’ve listed above to have classified that query as temporal. The “query features” that I’ve listed from the patent are examples of features Microsoft might be using, though it’s possible that they might not be using all of those signals, and may be using some other ones as well.

Share

20 thoughts on “Does Bing Time Shift Search Results?”

  1. If this is the case, I think it makes Bing strong and more relevant. I can’t say Bing is ahead of the game when it comes to search engines, but they must be doing something right. I mean, with Google pretty much making a similar change every time Bing makes a change.

  2. Pingback: » On Google’s blue triangle and other search engine news
  3. This can only be good news. Make that terrific. Never feel comfortable in a web-autocracy. Bill G admitted in 2003 “…we mistakenly didn’t apply a lot of our advanced ideas to do a Web-scale search engine. We were relying on an outside supplier for part of our search. That’s our mistake. There’s lots of need for improvement and I think you’ll see us innovate. We didn’t make it as much of a priority as we should have…” (understatement of the decade, if you ask me). So Microsoft really messed up and Google took advantage like if there was no tomorrow. But it seems Microsoft is crawling back indeed. Which in the end, should benefit all the zillions of us.

  4. At least we now know that search engines shift together with what’s most talked about during a particular time or season. This somehow assures us that whatever comes up as a search engine result is appropriate and can meet a particular query need or question.

  5. Very interesting – it goes back to the idea of search engines trying to “read minds” Obviously it can never be perfect, but search results being more time relevant is a big step towards a search engine truly “understanding” a search request. Thanks for the post!

  6. As an online marketer I am thrilled with the constant innovation that the competition for dominance in the realm of online search has spawned. I can only drool at the prospects for search going forward. Still not a huge fan of Bing and think it very difficult for anyone to touch Google in the next 3 to 5 years but who knows – it is great to hear they are trying to make independent gains in quality themselves.

  7. I was quite excited to try Bing out when so many people recommended it to me but after looking at some of the results for searches I went straight back to Google. I think it is still early days for Bing and agree that they must be doing somethings right to turn Googles heads but there is a long way to go on the relevance front for Bing and certainly a long way to go on the quality of the sites they return in results as I found many poor quality sites towards the top of popular search terms which to me shows the distance between Google and Bing.

    Interesting post though so I will still keep my eyes on Bing as have not completely given up on it yet. Thanks for sharing.

  8. Hi Joe,

    It’s encouraging to see Bing being responsive in ways like this, where search results, query suggestions, and news items are reflective of very recent events. I think we’ve been seeing Google do things like this as well though.

    Google has made a few changes that seemed to be responsive to changes that took place at Bing, but they’ve also made a lot of changes that were independent of anything happening at other search engines. It’s hard to say whether Google was following Bing’s lead, or rather meeting what they perceived as expectations from searchers, but either way – it’s good to see changes happening that improve the experience of searching.

  9. Hi Jess,

    If Microsoft were to make search one of their prime focuses, and it’s possible that they may be, I think it only means good things for everyone, even Google and Yahoo. Bing hasn’t been the primary place I usually tend to go to when I search, but seeing how they respond to things like the Red Sludge leak in Hungary within their search results is very encouraging.

  10. Hi Andrew,

    The potential is definitely there, but regardless of how good search engines might be getting at capturing timely and topical content, and reflecting changes in meanings of tems based upon the day or season, they are still limited by whether or not that content is actually available on the Web.

    While many sources of timely information are available online, I hate seeing sites moving their content behind things like paywalls, and I think that’s going to happen with more sites in the future.

  11. Hi Michael,

    Thanks. I agree with you that this is an example of search moving from purely text-based matching to understanding the intent behind a query, and how that intent might change even though the terms in a query stay the same. I don’t think search engines are ever going to get to the mind-reading stage, but seeing them trying to make intelligent choices is a good step in the right direction.

  12. Hi Matthew,

    I think there’s a lot of potential for Bing to evolve and grow – fingers crossed that they do, and they and Google push each other to give us all something even better.

  13. Hi firebubble design,

    I think if you asked just about anyone at Google or Yahoo or Bing about how close they are to perfecting search, they would all say that search is still in its infancy, and has a lot of room for growth. It’s early days for Bing, but even after more than a decade, it’s still early days for Google as well.

Comments are closed.