Patent Filings from Google’s Acquisition of Apture and Katango: Highlighted Search, YouTube Sliders, and Intelligent Social Media Agents?

Sharing is caring!

Imagine being able to highlight any text on a web page and search the Web based upon that text? Or an easier way to embed videos or other content in windows that will appear and open up without launching a new browser window.

Now imagine that your Google Plus Circles could engage in friend relationship management, being better at self organizing by grouping people whom you add to your Google Plus Account by whether they are co-workers, or if they live nearby, or the kind of company they work for, or the school that they went to or many other ways that might make circle management smarter and a little more fun. Now imagine that the technology behind that involves the use of intelligent social media agents that keep an eye on the social activity of your contacts.

Google revealed last Thursday that they acquired a couple of companies, seemingly both for the expertise and knowledge of the people employed by those companies and the technology that they have developed. I found the patent filings that have been assigned to both companies to try to get a deeper glimpse at some of the technologies that both companies have developed.

One of the companies that Google acquired is Apture, a business started by Tristan Harris and Can Sar, a couple of Stanford students in 2007. The Apture Website notes that the Apture team will be joining Google’s Chrome Team. That makes sense since Apture specializes in making browser experiences richer by proving text boxes that pop-out when you click upon links on a page. Apture was supplying these types of features for a number of partner sites as well as a plugin that would work with Chrome, Firefox, and Safari.

This first image is the Apture homepage with the notice that they’ve been acquired by Google. I highlighted the word “Google” on the page, and a caption box appears above my highlighting with the caption “Learn More” appearing within it. Note that there are a couple of links on the page as well that have different kinds of icons in front of them, signifying that they will launch different types of boxes that display certain types of information. In front of the link with the anchor text “truly experience” is an icon that looks like an open book. Immediately before the anchor text “Chrome Team” is an icon that looks like a film strip.

Apture's homepage with the word Google highlighted, and special icons in front of anchor text appearing on the page.

When I clicked upon the “Learn More,” a information/search results window opens on the page without launching a new browser window. Note that the box has three tabs, with the first labeled “explore,” which includes an informational annotation followed by search results. The second tab is labeled “videos,” and shows a number of videos in response to the word that I highlighted. The third tab is labeled images, and includes a number of images in response to my highlighted search term.

In this third image, I’ve clicked upon the link with the anchor text “Chrome Team,” with the filmstrip icon in front of it. A YouTube video appears about Google Chrome.

The other company is Katango, and they published a note on a page which redirects from the page to an Amazon hosted page, that the company was acquired by Google and that they would be joining the Google Plus team. The chairman of the company is Yoav Shoham, a professor at Stanford University. The company was originally named CafeBots, and has described what they do in the past as Personal Crowd Control.

Google’s Bradley Horowitz, the Vice President of Product Management for Google+ also announced the Katango acquisition on November 10th.

Apture makes it easier to search from any page on the Web, and to more easily embed different types of content on web pages. Kantago could make managing your Circles on Google Plus much easier.

Here are the patent application filings that are available at the USTPO. It’s possible that both companies may have more filed that haven’t been published yet.

Apture Patent Applications

This patent application describes a layout manager for determining where an interactive window might appear upon a browser page.

System for intelligent automated layout and management of interactive windows
Invented by Can Sar, Jesse Young, and Tristan Harris
US Patent Application 20100011316
Published January 14, 2010
Filed: January 21, 2009


The present invention relates to the automated layout and scrolling of windows.

The patent filing description starts off by pointing out that the process described in this application differs from the embedding of videos or other objects into a page.

Creating first class objects from web resources
Invented by Can Sar, Jesse Young, and Tristan Harris
US Patent Application 20090199077
Published August 6, 2009
Filed: January 21, 2009


The present inventions are directed to apparatus and method for creating first class object representations from web pages that are not normally considered first class objects.

Annotations using intelligent windows might be added by visitors to a webpage. This could be limited to the owner of a page, or expanded to others who visit the page, in wiki like fashion.

Method of enabling the modification and annotation of a webpage from a web browser
Invented by Can Sar, Jesse Young, and Tristan Harris
US Patent Application 20090199083
Published August 6, 2009
Filed: January 21, 2009


The present invention relates to enabling the modification and annotation of any webpage from a web browser by any user (with appropriate privileges) without the need for custom plugins or browser extensions.

This patent application seems to describe something like the scrolling Youtube Slider box that appears on Google Plus Stream pages, and will scroll down a page as you do. When clicked upon that box provides a way to search Youtube videos. The Youtube slider on Google Plus Stream pages starts out as a box at the top right of the page:

If you click upon it, it expands so that you can search through YouTube videos:

The box slides down the side of the page, in contracted mode if you haven’t clicked upon it, and in expanded mode if you haven’t clicked to contract it again:

Independent Visual Element Configuration
Invented by Tristan Arguello Harris and Omer Faruk Nafiz Ates
US Patent Application 20110225487
Published September 15, 2011
Filed: March 10, 2011


A system and a method are disclosed for a configuration in which any user interface feature that would otherwise have been hidden while the user is interacting with the rest of the web page are made available at the top of the web page.

Katango Patent Application

What we’ve heard about Katango’s capabilities includes a friend management program that can make circle management easier. But this patent filing goes beyond that by introducing a social media agent that can act on behalf of someone to capture information about other people’s activities on multiple social networks, and perhaps present that information in dashboards. This agent would look beyond information located in profiles when helping manage circles, and could collect information based upon actions performed by your contacts on social networks to help suggest how you might organize those contacts.

Automated Agent for Social Media Systems
Invented by Yoav Shoham
US Patent Application 20110184886
Published July 28, 2011
Filed: June 22, 2010


A method to automatically process social media data includes capturing captured data, describing actions and/or context relating a user across multiple social media systems. The captured data is stored within a database. One or more interfaces are provided in order to provide access to the stored captured data. A rules database is configured to store multiple social media rules (e.g., behaviors) that may be associated with a user. A behavior engine is configured to perform autonomous activities, on behalf of a user with respect to multiple social media platforms, based on the social medial rules and/or the captured data.


Google has been pretty mum on some of the many acquisitions that they’ve made in the past year, rumored at roughly 50 or so. I’m not sure why they decided to announce these particular acquisitions except for the fact that both have customers that they may no longer support in the future. Katango was providing an iPhone app that helped organize Facebook Friends. Apture’s technology was being used by a good number of websites and as a plugin for Chrome, Firefox, and Safari.

The technologies are pretty interesting, and I do suspect that we will see them integrated into offerings from Google fairly soon. I don’t know if the YouTube slider on Google Plus streams were from Apture, but they do seem to be a good match for the last of the Apture patent filings.

There’s a pretty interesting interview between Robert Scoble and Yoav Shoham on Cruchbase that’s worth watching after you spend some time with the patent, since Yoav Shoham refers to much of the technology behind what they do as “magic” and it’s a little fun to have a some sense of what the magic might be.

A Google Plus post from Yee Lee of Katango notes that today was going to be his first day of work at Google.

Sharing is caring!

17 thoughts on “Patent Filings from Google’s Acquisition of Apture and Katango: Highlighted Search, YouTube Sliders, and Intelligent Social Media Agents?”

  1. This looks really interesting, thanks for sharing. I have to admit that I’m excited about the future possibilities of Google Plus – I hope they continue to market it and it doesn’t become one of Google’s failed products.

  2. I am always rabidly curious how many of these acquisitions are for engineer land grabs, where much of what they are going for are the engineers talents, without much need for the patents themselves. I know they are in high regard, but would engineers have solely (or almost) solely create an acquisition event? Of course, if they were talented enough to cause said event, they probably created something pretty great. But perhaps that “pretty great” is only something that amounts to a 20% project in Google’s eyes.

  3. Thanks Bill for this note. Pretty interesting indeed. Things go fast. The interview on cruchbase was a bit harder to understand but it gives a pretty good taste of what is going to come….

  4. I actually just started using G+ this week, I hadn’t paid much attention to it for a while because it hadn’t really caught on yet. Good to see these tips for kicking it off and getting some traction here, I’ll be figuring this thing out from scratch. Feels like my first Facebook account!

  5. I agree with Jenni–It will be interesting to see how Google+ develops, especially in the context of possible automated friend/contact sorting.

  6. Hi Jenni,

    I’m excited about the future of Google Plus, too.

    Google has has some failures when it comes to social networks, but I think they’ve learned some lessons from most of them that they’ve been integrating into Google Plus. They’ve also made an effort to incorporate Google Plus more into services like Web search, with Google author profiles and shares and plusses showing up in those results. I think that may make a difference.

  7. Hi Jessica,

    I’ve seen the term acquihire used in situations like that, and I’ve wondered the same thing myself. These two transactions seem to be equally for the talent and the technology.

    Google does seem to be more actively purchasing patents where available that seem to cover technologies that they are interested in, but they’ve been pretty quiet about many of the acquisitions they’ve made over the past couple of years. I’m curious as to whether those were made as a way to acquire the technologies involved, or to hire the people behind them.

    I do have to say that some of Google’s 20% projects have ended up being some of the major services that Google offers, such as GMail.

  8. Hi Sylvain,

    You’re welcome. Google is introducing a lot of new changes. Hopefully for them, not so many that they start alienating Google users.

    I thought the Crunchbase interview added something, but I think it is more interesting if you try to go through the patent first. Especially since it gives you an idea of the technology that Yoav Shoham is somewhat elusive about when it refers to it as Katango’s intellectual property that he can’t disclose too much about.

  9. Hi Chris,

    I signed up soon after Google Plus launched, and I’m happy that I’m one of the early adopters in this case.

    Good point about it feeling like your first Facebook account. I have a little better sense of how I want to interact with people on Google Plus because of Facebook.

  10. Hi Kentaro Roy,

    I’m thinking that Google will be introducing friend sorting sometime soon, but it’s going to be really interesting seeing how they do.

  11. To say the truth i don’t think Google plus has made an impact in the social media world… Being part of a Brand like Google any site would get some prominence but then again, Facebook still is doing a lot better… I’d say Google needs to really think out of the Box with its regional approach.

  12. Google is failing in the social world and simply acquiring patents isn’t going to change that. FaceBook has stepped up the game and has matched all of Google’s innovations. Will be an interesting social future.

  13. Hi Usman,

    Google Plus has had many tens of millions join in a fairly short period of time, and author profiles and social sharing from Google Plus have been integrated into Google’s Web search, which is one of the most popular websites on the planet. I think it may have a future.

    I’m not quite sure that it’s a good idea to compare Facebook and Google directly – it’s a little like comparing apples and oranges.

  14. Hi Dave,

    Google has been doing much more than acquiring patents and technologists from other companies, but I think it’s one indicator (like a canary in a coalmine) of Google’s ambition and drive to succeed that they are busy building new and innovative features internally, and looking for new technologies from others outside of Google.

    If you watched the video from Robert Scoble that I linked to towards the end of my post, he seems pretty impressed with Katango’s technology.

    Until Facebook builds a search engine, I’m not sure that it’s fair to compare Google and Facebook. Google has too many advantages.

  15. Pingback: The Future of Social Search | Google Social Search - WhiteFireSEO

Comments are closed.