Abstract:
Arrangements involving portable devices (e.g., smartphones and tablet computers) are disclosed. One arrangement enables a content creator to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. Another utilizes a device camera to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.
Abstract:
Audio sounds are captured from a subject's body, e.g., using a smartphone or a worn array of microphones. Plural features are derived from the captured audio, and serve as fingerprint information. One such feature may be a time interval over which a threshold part of spectral energy in the audio is expressed. Another may be a frequency bandwidth within which a second threshold part of the spectral energy is expressed. Such fingerprint information is provided to a knowledge base that contains reference fingerprint data and associated metadata. The knowledge base matches the fingerprint with reference fingerprint data, and provides associated metadata in return—which can comprise diagnostic information related to the captured sounds. In some arrangements, an audio signal or pressure waveform stimulates the body at one location, and is sensed at another, to discern information about the intervening transmission medium. A great variety of other features and arrangements are also detailed.
Abstract:
The present technology concerns cell phones and other portable devices, and more particularly concerns use of such devices in connection with media content (electronic and physical) and with other systems (e.g., televisions, digital video recorders, and electronic program directories). One particular aspect of the technology concerns complementing primary content viewed on one screen (e.g., a television screen) with auxiliary content displayed on a second screen (e.g., a cell phone screen). Different auxiliary content can be paired with the primary content, depending on the profile of the user (e.g., age, location, etc.). Some embodiments make use of location information provided by the primary screen device. Other embodiments make use of content identification data provided by the primary screen device. A great number of other features and arrangements are also detailed.
Abstract:
Reference imagery of dermatological conditions is compiled in a crowd-sourced database (contributed by clinicians and/or the lay public), together with associated diagnosis information. A user later submits a query image to the system (e.g., captured with a smartphone). Image-based derivatives for the query image are determined (e.g., color histograms, FFT-based metrics, etc.), and are compared against similar derivatives computed from the reference imagery. This comparison identifies diseases that are not consistent with the query image, and such information is reported to the user. Depending on the size of the database, and the specificity of the data, 90% or more of candidate conditions may be effectively ruled-out, possibly sparing the user from expensive and painful biopsy procedures, and granting some peace of mind (e.g., knowledge that an emerging pattern of small lesions on a forearm is probably not caused by shingles, bedbugs, malaria or AIDS). A great number of other features and arrangements are also detailed.
Abstract:
The present technology concerns cell phones and other portable devices. One claim recites a method employing a portable device including a processor, microphone and an interface to receive user inputs, the portable device also including a display screen. The method comprises: receiving a first user request, through the interface, for processing audio content captured with the microphone; processing the audio to yield fingerprint data; communicating the fingerprint data and portable device location information to a remote computer system; in response to said communicating, receiving information including a title associated with the audio content; presenting the title on the display screen; in response to a second user request, through the interface, displaying information associated with audio content captured by other portable devices in an area associated with the portable device location information. Of course, other claims and combinations are provided too.
Abstract:
A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.
Abstract:
A cell phone is used to sense information, such as digital watermark data or RF ID data, from a physical object (e.g., a product package). Thereafter, a user of the cell phone engages in a transaction (e.g., downloading content from the internet). Normally, a charge may be assessed for this transaction. However, the user is spared this charge by reason of said earlier sensing of information from the physical object. A great number of other features and arrangements are also detailed.
Abstract:
A decade from now, a visit to the supermarket will be a very different experience than the familiar experiences of decades past. Product packaging will come alive with interactivity—each object a portal into a rich tapestry of experiences, with contributions authored by the product brand, by the store selling the product, and by other shoppers. The present technology concerns arrangements for authoring and delivering such experiences. A great variety of other features and technologies are also detailed.
Abstract:
A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.
Abstract:
In one aspect, a retail store includes a multitude of cameras, including a plurality of 3D cameras, and a plurality of other cameras. Certain of the cameras provide imagery from which a shopper's track through the store is monitored, and certain of the cameras are positioned to detect removal of items from store shelves. The store also includes a computer system that provides a database of information about store layout, indicating stock locations of different items. The computer system receives imagery from the cameras (or information derived from such imagery) and uses this data, together with information from the database and information derived from other sensors in the store, to produce a probabilistic tally of items selected by a store shopper. This tally includes an item bearing a barcode, but is produced without reading the barcode. Each item on the tally is associated with a confidence score that meets a computer system-determined threshold. A great number of other features and arrangements are also detailed.