Yesterday, Google’s CEO Larry Page announced that Andy Rubin would no longer be in charge of the mobile platform Android at Google,, but would be moving on to new challenges at the company. In the announcement, Page urged the entrepreneur and inventor to take “more moonshots please.” Andy Rubin brought Android to Google in 2004, but I’ve been wondering since yesterday’s announcement if we would see a different kind of Android delivered by his hands.
Rubin does have a history of enjoying tinkering with robots, and that seems to be an area that Google is quietly focusing upon. Regardless of whether or not the former Android chief is involved, do we need to add robots to the list of science fiction type endeavors Google is working upon?
I mentioned robots in the post, Inside the Google House of Ideas: 2 Lens Glass, Google Robots, and Smartwatches, a few weeks back after Google was granted 2 patents that involved providing instructions for robots, and enabling robots to make their own decisions (as if the patent covered Asimov’s three rules of robotics). Last October I also wrote about a paper to be presented this May that describes how robots might use an object recognition search from databases located in the Cloud to learn how to handle objects while doing their daily chores.
Yesterday Google was granted another patent that can help identify the location of a robot. Before I go into that, lets look a little more about robotics at Google.
Did you know that there was a Cloud Robotics team at Google? They gave the following presentation at Google at I/O 11 in San Francisco in 2011:
In it we learn about the Android Open Accessory API, which could be used to create an Android App that can “physically interact with the world.” The importance of cloud-based object recognition for robots is also stressed, telling us that not only is the ability to come across new things and recognize them is important, but so are instructions that come back from databases in the cloud that tell robots how they can interact with those objects.
Other cloud based services that not only benefit people, but could also benefit robots are mapping and navigation, voice recognition, optical character recognition, translation, and other things that can lead to smarter robots. A robot doesn’t need to be smart by itself – it just needs to connect to the cloud to figure out problems. A favorite moment for me in the video is a comparison of robots built a year apart folding towels, and how much better they’ve gotten at it. I also enjoyed a section on how a home-based robot could be used like a streetview car to index the contents of your house for a home-based search engine. A turtlebot finding a cupcake is priceless.
Google is also home to the HomeBrew Robotics Club. While Andy Rubins isn’t officially a member of the club, he has made sure that they have had Android devices in the past to work with.
Why Would Robots Use the Cloud?
The newest Google patent on robots was granted a couple of days ago, and describes how the location of a robot can be identified not by the use of sensors from the robot itself, but rather from images seen by the robot, and location recognition of the objects seen within those images:
Methods and systems for estimating a location of a robot
Invented by Ryan Hickman
Assigned to Google
US Patent 8,396,254
Granted March 12, 2013
Filed: August 17, 2012
Abstract
Methods and systems for estimating a location of a robot are disclosed. In one embodiment, the method comprises a robot capturing range images indicating distances from the robot to a plurality of objects in an environment. The method further comprises transmitting to a server a query based on the range images, receiving from the server a mapping of the environment and, based on the distances and the mapping, estimating a location of the robot.
In another embodiment, the method comprises receiving from a robot range images of an environment and, based on the range images, determining an inventory of objects in the environment. The method further comprises, based on the inventory, identifying the environment and transmitting to the robot a mapping of the environment.
So why use object recognition to locate a robot instead of sensors? According to the video, tasks performed in the cloud are relatively inexpensive, while installing things like servers and sensors in a robot can be costly. To make home based robots affordable, their costs need to be minimalized.
Another use for robots is to allow for a mobile video conferencing experience in the form of telepresense devices. Imagine being able to sit down in an office in New York, and use a robot to visit a building in San Francisco, and move within the building? In Telepresence Robots Roam the Halls of My Office Building (pdf), we see a Google researcher involved in studying this use of robots.
Again, Andy Rubin may or may not be aiming at the moon with robots, but Google is.
Making these cloud based also puts the privacy and data collections right up front. If you buy a cloud based robot all expectations of privacy should be checked at the door.
Hi Mike,
Exactly! In addition, having robots actively using visual queries from something like Google Goggles means that a lot more data is being thrown at those services, so object recognition, location recognition, landmark recognition, and the other types of visual queries that can be performed will only grow better for anyone who uses them, regardless of whether they are a person or a robot.
The Google whitepaper, The Unreasonable Effectiveness of Data (pdf) tells us that having lots and lots of data can help overcome even weak algorithms.
Re: using a robot to sit in at a meeting for you, while you’re half way across the world is a possibility I hadn’t even considered. I can see people coming to rely on the role of robots in the workplace very heavily and very quickly. No wonder google is concentrating its effort in this area.
Similar to video conferencing, I can see potential for these robots in real estate. These could eventually replace virtual tours for listings, meaning that buyers could control what they’re viewing in a home for sale. Most of our buyers are relocating from other parts of the country, so being able to tour homes remotely would be a big benefit.
With cloud integration with robots and the city wide security cameras that are popping up, physical crime would be almost obsolete. Smart cameras that recognize when a crime is taking place would have to be developed, they see a crime, they report it to a robot cop nearby, robocop goes and uses his taser on the criminal, human cop comes and arrests him.
I like the idea of using a robot to sit in a meeting.
I saw a programme on the Japanese channel NHK the other day in which a University in Japan has developed a human like robot that is the exact image of the professor, even the facial expressions are amazing.
It makes you wonder where we could be in 20 years. Maybe the film ‘Surrogates’ wasn’t so stupid after all.
Recently I have been reading more and more on why Apple is not innovating enough or coming up with anything groundbreaking, they are getting some bad press because of it. Google is aware you can’t come up with attention grabbing inventions overnight and a lot of what I see from them lately is paving the way for some wow factor future technology to steel the headlines. I think it’s about building and maintaining credibility by impressing people with new tech. It could also be a bit of smoke and mirrors; “Look over here, so you don’t notice us steeling your personal info over there”.
That would be quite a reallocation of resources if Andy Rubin were to be put in charge of the “robot team”. I can’t see that at this point, but one never knows with Google? If they think they’re close to some sort of major breakthrough to take the project to the next level, I suppose it’s possible. Pretty amazing stuff!
Though google is reluctant to openly admit it, being the king of search is simply not enough. I remember in the days when GMail was originally launched, people wondered why the search giant wanted a foot in the email industry. But today google has gone way past that and almost revolutionized the mobile communication industry through Android.
Times have certainly changed when google, a search company, is now dabbling in hitherto unheard technology such as street view, google goggles and now – Artificial Intelligence!