A couple of weeks ago, a federal bankruptcy judge approved the sale of Kodak’s patent portfolio to a group of companies that joined together to buy them at a discounted price. The group included Apple, Google, Facebook, and others. There were more than 1,000 patents involved, related to photography, storing photos, and sharing photos.
It makes sense for Google to have been interested in those patents, considering their involvement in smartphones with cameras, and their work on Google Glass, where taking pictures and recording video will likely be one of its strengths.
I was very much surprised tonight to run across another acquisition of patents by Google from a company that I’ve seen a lot of in the past when searching for search-related patents. The company has been regularly featured as one of the “US Patent Top 50” since 2006 and is one of the most innovative companies in the world. According to the USPTO assignment database, they have close to 6,000 published pending and granted patents in the United States Patent and Trademark Office. Google acquired 269 granted patents and one pending patent application. The image above is from the pending patent application, “Modular Camera and Printer.”
The assignment of these patent filings took place on August 31, 2012, and they were officially recorded with the USPTO on January 21, and January 22 of 2013. I didn’t see them in the USTPO assignment database until this evening.
The focus of most of these patents appears to be on printers and digital cameras and different photographic effects. Silverbrook Research and founder Kia Silverbrook have been extremely prolific in a number of different fields. Over the past few years, I’ve seen the Silverbrook name spring up fairly frequently while exploring search-related patents.
There is one patent describing facial recognition, and another patent that detects where eyes within photos are looking, so that focus can be shifted to what is being looked at. Here’s the title and abstract from that patent:
Utilising eye detection methods for image processing in a digital image camera
Abstract
A method of processing an image taken with a digital camera including an eye position sensing means said method comprising the step of utilizing the eye position information within the sensed image to process the image in a spatially varying sense, depending upon said location information. The utilizing step can comprise utilizing the eye position information to locate an area of interest within said sensed image. The processing can include the placement of speech bubbles within said image.
This patent acquisition seems to indicate that Google still believes that people like to print out pictures that they take, but they aren’t always ordinary photos as we know them. For instance, there are a few patents that provide ways for both images and audio to be printed out at the same time.
A number of the Silverbrook patents involve variations of taking pictures on a “mobile communications device” that is tied in some way to a printer. Other photographic effects are described as well that could alter the look of an image.
Some of the patents also involve taking pictures of clothing and using a “garment” printer to print them out.
I’ve listed and linked to them below to make it easier for you to click through any that you think might be interesting. I’ve read the abstracts and titles for all of them but didn’t have time to read through the patents themselves.
Patent Application (1)
Granted Patents (269)
- Re-writeable optical card reader/writer unit using ink dots for data storage
- Utilizing of brush stroking techniques in the generation of computer images
- Portable camera with an ink jet printer and cutting blade
- Pseudo-3D stereoscopic images and output device
- De-curling print media in a digital instant printing camera
- Paper guide system in a print on demand digital camera system
- Print roll having an ink return tray
- Low cost disposable digital instant printing camera system
- Reusable camera system which authenticates a refill station
- Camera picture printing user interface and method
- Inkjet print head recapping mechanism
- Data addition to optical storage cards using ink dots
- Sticker printing camera device
- Arrangement of a power supply in a recyclable, digital camera
- System for high volume printing of optical storage cards using ink dots
- Printhead ink supply system
- Artcard for the administration of the operation of a camera device
- Digital photograph storage using ink jet printing
- Recycling of multi–use digital instant printing camera systems
- Encoded data card reading system
- Utilization of image tiling effects in photographs
- Camera system including digital audio message recording on photographs
- Brush stroke palette feedback method for automatic digital ‘painting’ effects
- Vending machine for the production of customized photos and artcards including a set of instructions for a manipulation of an image
- Prints remaining indicating for camera with variable length print capability
- Binocular glasses with an integral printer device
- Print media roll and ink replaceable cartridge
- Authentication system for camera print rolls
- Digital image region detection method and apparatus
- Power drive system for a print on demand digital camera system
- Method for transforming a gamut of a color image to produce an artistic effect
- High quality image copier with exact reproduction of digitally halftoned images
- Arrangement of usage indicator in a recyclable, digital camera
- Target detection for dot region alignment in optical storage systems using ink dots
- Method and apparatus for information storage in a portable print roll
- Miniature color printer using ink and paper cartridges
- Dot center tracking in optical storage systems using ink dots
- Digital camera print roll with periodic anisotropic stiffness
- Image transformation means including user interface
- Bump map compositing for simulated digital painting effects
- Method and apparatus for fault tolerant data storage on photographs
- Cartridge for a sticker printing digital camera device
- Print on demand camera system incorporating a detachable printing unit
- Adaptive tracking of dots in optical storage system using ink dots
- Memory module for compact printer system
- Orientation detection for digital cameras
- Integrated camera circuit including image sensor, image processing, and printer drive circuits
- Image sensing apparatus including a microcontroller
- Cascading image modification using multiple digital cameras incorporating image processing
- Digital image warping system
- Cartridge for a sticker printing digital camera device
- Garment design and fabric printing system utilizing digitally encoded design cards
- Reader to decode sound and play sound encoded in infra-red ink on photographs
- Method and apparatus for fault tolerant storage of photographs
- Artcard for the control of the operation of a camera device
- Dot adjacency compensation in optical storage systems using ink dots
- Method and apparatus for rotating Bayer images
- Image production utilizing text editing including complex character sets
- Utilising eye detection methods for image processing in a digital image camera
- Utilizing autofocus information for image processing in a digital camera
- Low-cost disposable camera including print media carrying indication of postage paid
- Digital instant printing camera with image processing capability
- Programmable camera system with software interpreter
- Method and apparatus for up-interpolating a bayer image
- Digital print media output with reduced residual curl
- Data distribution mechanism in the form of ink dots on cards
- Digital camera with integral color printer and modular replaceable print roll
- Camera with detachable printer
- Method and apparatus for producing print from a bayer image
- Method and apparatus for sharpening an image
- Camera module for compact printer system
- Identifying card
- Preprinted print rolls for use in an image processing device
- Image texture mapping camera
- Method and apparatus for fault tolerant data storage on photographs
- Arrangement of ink in a low-cost disposable camera
- Digital camera system containing a VLIW vector processor
- Personal digital assistant with integrated printer
- Producing automatic ‘painting’ effects in images
- Timer module for compact printer system
- Curl resistant print media
- Handheld mobile communications device with a color image sensor and a color printer
- Data distribution mechanism in the form of ink dots on cards
- Method and apparatus for fault tolerant data storage on photographs
- Printed card based user interface system
- Data structure encoded on a surface of an object
- Print media cartridge with integral print media and ink supplies
- Effects processor for effects module
- Camera with processor for up-interpolating a bayer image
- Effects module for compact printer system
- Hand held mobile communications device with an image sensor and a printer including a capping mechanism
- Camera exchange system and method
- Method and apparatus for image conversion
- Print media cartridge with an integral print media transport mechanism and ink supply
- Photographic prints having magnetically recordable media
- Hand held mobile communications device with an image sensor, a printer and a display moveable between first and second positions
- Arrangement of print media in a low-cost disposable camera
- Data distribution mechanism in the form of ink dots on cards
- Camera system with computer language interpreter
- Camera and printer combination using up-interpolation of Bayer image
- Method and apparatus for bayer mosaic image conversion
- Curl resistant media
- Card having coded data and visible information, for operating a device
- Arrangement for reading coded data printed on a card
- Redundantly encoded data structure for encoding a surface
- Camera for printing on media provided on print roll
- Image processing and printing apparatus
- Hand held mobile communications device with an image sensor and a printer
- Image manipulation device
- Printing cartridge for a camera and printer combination including an authentication device
- Hand held mobile communications device with an image sensor, a printer and a print media slot
- Hand held mobile communications device with an image sensor, a printer and an interface for interrogating an authentication mechanism of a cartridge inserted into the receptacle
- Method of data distribution using ink dots on cards
- Print media cartridge with integral print media transport mechanism
- Digital camera system having motion deblurring means
- Print roll for use in a camera imaging system
- Method for bayer mosaic image conversion
- Effects module for a compact printer system
- Audio playback device that reads data encoded as dots of infra-red ink
- Preprinted print rolls for postal use in an image processing device
- Hand held mobile communications device with an image sensor, a printer and a receptacle for receiving an ink cartridge
- Hand held mobile communications device with an image sensor, a printer and a business-card sized slot
- Method of processing a stored image
- Camera for capturing and resampling non-linear Bayer image
- Print medium with anisotropic bending properties
- Camera for printing manipulated images on media
- Apparatus for sharpening an image using a luminance channel
- Printer and image sensor in a mobile communication device
- Device which processes images in accordance with coded data on card
- Device for image capture and processing
- Data storage device incorporating a two-dimensional code
- Data card reader
- Data storage on photographs
- Method and apparatus for fault tolerant program and data storage on photograph
- Modifying digital images utilizing auto focus information
- Gender changer module with a data and power bus
- Camera with eye position detector
- Effects module for manipulation of an image
- Substrate including digital photographic image and coded image data
- Utilization of color transformation effects in photographs
- Photograph including coded image data
- Cascading image modification using multiple digital cameras incorporating image processing
- Device for controlling the taking of multiple images
- Card reader
- Monolithic integrated circuit having a number of programmable processing elements
- Optical data card reader
- Method of sharpening image using luminance channel
- Print medium with one side defined by a rib-like structure
- Method of automatic image processing
- Digital photo album with image modification and internal printing
- Method of image processing in a camera module
- Hand-held postcard printer
- Method of capturing and processing sensed images
- Camera control print medium
- Postcard printing system including postage paid print roll
- Print roll for postcard printer
- Method of pre-processing an image to be printed in a hand-held camera
- Forming a manipulated image using a printed medium having an image manipulation instruction
- Print media roll and ink supply cartridge
- Camera and print unit with detachable interface
- Camera having socket for receiving detachable printer unit
- Camera and detachable printer unit
- Digital camera utilizing autofocus settings for image manipulation
- Camera and printer having slidably detachable interface
- Image sensing apparatus including a microcontroller
- Portable hand held camera
- Image sensor and printer in a mobile communications device
- Digital camera that incorporates an authentication arrangement for application to consumable print rolls
- Print media cartridge with integral print media and ink storage
- Camera for printing manipulated images
- Disposable camera with destructive casing
- Method of processing an image in a camera module to produce L*a*b* form image
- Hand held camera assembly with an effects module
- Modular printer effects module with a triplet of actuators
- Platen unit for a disposable camera having a printer
- Postcard generator
- Data distribution method
- Device for storing and printing images
- Camera and controlling processing system
- Image processing apparatus for applying effects to a stored image
- Portable camera with inbuilt printer device
- Pivotal camera module for compact printer system
- Print roll assembly
- Garment creation system
- Printed media with machine readable markings
- Digital photographic duplication system with image quality restoration
- Image capture and processing device for a print on demand digital camera system
- Digital camera with integrated inkjet printer
- Compact camera module and printer system
- Device that reads data encoded as dots
- Processing of digital images using autofocus settings for image enhancement
- Digital camera with ancillary data capture
- Refillable ink supply cartridge for a postcard printing camera system
- Ink supply mechanism for a disposable camera printing system
- Camera with swipe printer
- Image processor having an application specific integrated circuit for camera module
- Modular camera and printer system
- Manipulation of digital camera images utilizing stored autofocus settings
- Digital image camera using autofocus information for image enhancement
- Image data manipulation system
- Photographic prints having magnetically recordable media
- Digital camera with integrated inkjet printer having removable cartridge containing ink and media substrate
- Integrated circuit for a digital camera system
- Digital camera with printing assembly
- Method of operating a camera timing module
- Digital duplication of images using encoded data
- System for recording and playing audio signals provided on a photograph
- Cylindrical camera module with pivot assembly
- Printer CPU with VLIW processor
- Print roll for a camera having an internal printer
- Apparatus for adding user-supplied text to a digital still image
- De-blurring in a digital image system
- Camera device incorporating a color printer with ink validation apparatus
- Method of storing and displaying photos on a digital photo frame
- Camera for encoding audio signals
- Image processing method in a camera module for converting non-linear RGB image data to L*a*b* image data
- Mobile phone with camera and printer
- Digital camera having functionally interconnected image processing elements
- Print roll unit incorporating pinch rollers
- Correction of distortions in digital images
- Digital camera using exposure information for image processing
- Method of processing digital image to correct for flash effects
- Digital camera having printhead and magnetic recorder
- Image manipulation method for camera
- Card based image manipulation method for camera
- Modular, multimedia pen having a camera module and a printer module
- VLIW image processor
- Handheld mobile communications device incorporating a pagewidth printer apparatus
- Multimedia pen with image processing module to convert captured images for printing by a printer module
- Digital camera system incorporating VLIM image processor
- Image manipulation camera
- Camera printer operation method with media pull sensing
- Recyclable printing device with tamper protection
- Camera unit configured to distort captured images
- Mobile communications device incorporating a printing mechanism
- Image processing method using sensed eye position
- Printed photograph with high capacity encoded audio
- Method of operating camera timing module
- Image storing and printing device with replaceable casing
- Modular pen-like device having camera, effects and printer modules
- Infra-red data structure printed on a photograph
- Camera system for with velocity sensor and de-blurring processor
- Image transformation device
- Mobile phone with printer and media feed path defined through mobile phone
- Camera unit incoporating program script scanner
- Card based image manipulation method with card skew correction
- Handheld mobile communications device incorporating pagewidth printer apparatus
- Image sensing and printing device
- Digital camera having interconnected image processing units
- Method for creating a garment
- Image processing apparatus having card reader for applying effects stored on a card to a stored image
- Digital camera system for simultaneous printing and magnetic recording
- Digital photograph duplication apparatus
- Pen-shaped modular camera assembly
- Image processing method for converting non-linear RGB image data to L*a*b* image data
- Device for reading encoded data interspersed in a printed image
- Surface having optically readable printed tags
- Method of processing images captured by digital camera to reduce distortion
- Print media cartridge with ink supply manifold
- Method for playing audio signals provided on a photograph
- Multi-module device including a printer module
- Pen-shaped modular camera assembly having an effects module
- Digital camera with card reader for reading program script
- Camera module with device independent data transfer
- Camera with printhead for printing images with encoded audio data
- Print media cartridge incorporating print media and ink storage
- Interconnected camera module and printer module
- Camera module outputting images in device independent color space
- System for creating garments using camera and encoded card
“Utilising eye detection methods for image processing in a digital image camera” or a Google Glass ?
Good for Kia ! Kia Silverbrook is the most brilliant and prolific inventor I’ve ever met — with an unbelievably deep understanding of physics at a microscopic level. John Michaelis and I investigated his MemJet technology (when we were with the RRD Technology Center) as a possible way to design digital presses at production offset press sizes and speeds. At that time Kia was focused on micro-electro-mechanical devices – MEMs chips — where 1000s of tiny ink droplet catapults were arrayed on a small chip (roughly an inch square.) We failed to convince our management to make the investment. Hopefully Google can make good use of a very unique patent portfolio.
Hi Glenn,
I’m trying to make some kind of sense of what happened between Kia Silverbrook and his US investor running Memjet these days. Silverbrook supposedly ended up assigning a lot of their patents to Memjet, though that’s not reflected at the USTPO at this point. I don’t know where these 270 patent filings fit into that.
As I mentioned in the post, it’s been hard avoiding Silverbrook Research during patent searches. Kia Silverbrook is an incredibly prolific inventor. Most of the patents involved in the assignment to Google seem to be related more to cameras and photography, and less towards patents involving just printers, but there are a few of those. It does look like the Memjet technology brought something new and innovative to what people had thought was a fairly mature technology. Shame that management from your company didn’t get involved.
I couldn’t help but think about what we’ve seen with Project Glass, and people taking lots of pictures and video with the devices. If you’re going to start a gold rush, why not be the guys selling the picks and shovels, too. 🙂
Hi Renaud,
There are a few patents in there that stood out to me as possibly being very useful for something like Google Glass. For instance, this one seems to make a lot of sense for a camera that someone wears as a pair of glasses:
Camera system for with velocity sensor and de-blurring processor
If you’re taking photos while walking or running or driving or even skydiving (like in the presentation where Google demo’ed Google Glass for the first time live, and had skydivers wearing them), that might just be useful.
I don’t see Google building a printer into Google Glass, but I could see them building a printer accessory that could plug into Android phones and Google Glass.
Bill – I haven’t seen or heard from Kia in years, so I can’t fill in those blanks. But I have similar stories regarding an early e-ink prototype, early barcode-to-cellphone technologies, etc. 🙂 Inertia in the face of change is a powerful thing.
Phones that print photographs… Am I missing something?
They will print tiny photos (with our without audio) that must surely be of little use to anyone other than kids just messing around.
I take that back. Maybe you need a passport photo, in a hurry and cant find a photo booth!
Either more money than sense, or they just dont want all these combined patents getting into competitors hands.
“Binocular glasses with an integral printer device” => It is definitely for the Google’s glasses, I think it’s obvious!
I definitely understand that Google has big plans for this new product, it seems to be a very hot topic at the HQ. However, I don’t get the point as I am not sure to see people with permanent glasses on their nose one day.
But why not?
These are “First Class” patents. Who has the money now, it will do so in the future after the acquisition of such patents!
Many patents could strengthen the quality of Google smartphones compared to its competitors.
I initially was thinking why someone would need a camera in a phone? Then again who thought we ever needed the ipad? let alone the mini? They obviously know something that yours truly doesnt!
Who knows when a certain patent will come in handy. Printing from your smartphone will certainly be very useful. I’m often looking for soft copies of documents and if I can photograph them and print them out I’d be most gratified!
People seem to be getting a little patent crazy. I mean “Method of sharpening image using luminance channel”? I don’t know. With all the lawsuits going around, its become a business in itself.
I can see how possessing patents for technology could prove valuable. But I can’t help wondering how much wasted time, creative talent, and money patent suits have cost. Plus. how much more do we pay for technology because before anything can be brought to market a fortune must be spent to first research potenital patent infringements, and then file an iron clad patent to protect the new poduct.
Hi Bill
I have seen Google acquiring lots of company in last one year.If I am correct Google acquired around 119 companies and lots of patent in the last one year.Is Google trying to eliminate every possible competition from the market?
The second thing is how this particular patent is helpful for Google.Google does not have a particular platform where this particular patent can be useful except picasa.
So the next generations of smart phones could well be having a printer in them? Wouldn’t be suprised if they manage to do so.