Abstract:
Image data, such as from a mobile phone camera, is analyzed to determine a colorfulness metric (e.g., saturation) or a contrast metric (e.g., Weber contrast). This metric is then used in deciding which of, or in which order, plural different image recognition processes should be invoked in order to present responsive information to a user. A great number of other features and arrangements are also detailed.
Abstract:
A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.
Abstract:
Cell phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Others relate to processing of image data. Still others concern metadata generation, processing, and representation. Yet others relate to coping with fixed focus limitations of cell phone cameras, e.g., in reading digital watermark data. Still others concern user interface improvements. A great number of other features and arrangements are also detailed.
Abstract:
Cell phones and other portable devices are equipped with a variety of technologies by which existing functionality is improved, and new functionality is provided. Some aspects relate to imaging architectures, in which a cell phone's image sensor is one in a chain of stages that successively act on instructions/data, to capture and later process imagery. Other aspects relate to distribution of processing tasks between the device and remote resources (“the cloud”). Elemental image processing, such as filtering and edge detection—and even some simpler template matching operations—may be performed on the cell phone. Other operations are referred out to remote service providers. The remote service providers can be identified using techniques such as a reverse auction, through which they compete for processing tasks. Other aspects of the disclosed technologies relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Still others concern metadata generation, processing, and representation. A great number of other features and arrangements are also detailed.
Abstract:
A variety of haptic improvements useful in mobile devices are detailed. In one, a smartphone captures image data from a physical object, and discerns an object identifier from the imagery (e.g., using watermark, barcode, or fingerprint techniques). This identifier is sent to a remote data structure, which returns data defining a distinct haptic signature associated with that object. This smartphone then renders this haptic signal to the user. (Related embodiments identify the object using other means, such as location, or NFC chip.) In another arrangement, haptic feedback signals social network information about a product or place (e.g., the user's social network friends “Like” a particular brand of beverage). In yet another arrangement, the experience of watching a movie on a television screen is augmented by tactile effects issued by a tablet computer on the viewer's lap. In still another arrangement, commercial vendors bid for rights to employ different ones of a library of haptic signals on one or more users' smartphones, e.g., to alert such user(s) to their products/services. A great variety of other features and arrangements are also detailed.
Abstract:
Methods and arrangements involving portable devices, such as smartphones and tablet computers, are disclosed. Exemplary arrangements utilize the camera portions of such devices to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some of the detailed technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.
Abstract:
Directional albedo of a particular article, such as an identity card, is measured and stored. When the article is later presented, it can be confirmed to be the same particular article by re-measuring the albedo function, and checking for correspondence against the earlier-stored data. The re-measuring can be performed through us of a handheld optical device, such as a camera-equipped cell phone. The albedo function can serve as random key data in a variety of cryptographic applications. The function can be changed during the life of the article. A variety of other features are also detailed.
Abstract:
First and second patterns are formed on a substrate. A spatial offset between the patterns is determined, and stored for later use in authenticating the substrate. (One or both of the patterns may convey steganographic information. One pattern may be printed, while the other may be embossed.) A smartphone can sense these patterns, determine the spatial offset, and check whether the determined offset matches the earlier-stored offset, to judge whether the substrate is authentic. Another arrangement effects serialization of product packaging by use of paired patterns (at least one of which is typically a watermark pattern) applied in a manner causing a spatial offset between the patterns to progressively vary along a length of a printed web. Still other arrangements involve substrates conveying patterns that degrade over time, e.g., indicating freshness or pressurization condition. A great variety of other features and arrangements are also detailed.
Abstract:
Many of the detailed technologies are useful in enabling a smart phone to respond to a user's environment, e.g., so it can serve as an intuitive hearing and seeing device. A few of the detailed arrangements involve optimizing division of shared processing tasks between the phone and remote devices; using a phone GPU for exhaustive speculative execution and machine vision purposes (including facial recognition); novel device architectures involving abstraction layers that facilitate substitution of different local and remote services; interactions with private networks as they relate to audio/image processing; adapting the orders in which operations are executed, and the types of data that are exchanged with remote servers, in accordance with current context; reconfiguring networks based on sensed social affiliations among users and in accordance with predictive models of user behavior; etc. A great variety of other features and arrangements are also detailed.
Abstract:
In one particular arrangement, a smartphone camera is moved by a user to capture dermatologic imagery from a variety of viewpoints. When the user thereafter holds the phone in a particular pose (e.g., with the display inclined upwardly, and with a display edge oriented substantially horizontally), the device switches to a display mode—presenting information derived from the earlier-captured dermatologic imagery. The device thus switches automatically between data collection and data presentation modes, based on pose and motion. A great variety of other features and arrangements are also detailed.