Abstract:
This disclosure provides systems, methods and apparatus for touch and gesture recognition, using a field sequential color display. The display includes a processor, a lighting system, and an arrangement for spatial light modulation that includes an array of light modulators. Each light modulator is switchable between an open position that permits transmittance of light from the lighting system through a respective aperture and a shut position that blocks light transmission through the respective aperture. The processor switches the light modulators in accordance with a first modulation scheme to render an image and in accordance with a second modulation scheme to selectively pass object illuminating light through at least one of the respective apertures. A light sensor receives light resulting from interaction of the object illuminating with an object and outputs a signal to the processor. The processor recognizes, from the output of the light sensor, a characteristic of the object.
Abstract:
Techniques disclosed herein utilize a vision sensor that integrates a special-purpose camera with dedicated computer vision (CV) computation hardware and a dedicated low-power microprocessor for the purposes of detecting, tracking, recognizing, and/or analyzing subjects, objects, and scenes in the view of the camera. The vision sensor processes the information retrieved from the camera using the included low-power microprocessor and sends “events” (or indications that one or more reference occurrences have occurred, and, possibly, associated data) for the main processor only when needed or as defined and configured by the application. This allows the general-purpose microprocessor (which is typically relatively high-speed and high-power to support a variety of applications) to stay in a low-power (e.g., sleep mode) most of the time as conventional, while becoming active only when events are received from the vision sensor.
Abstract:
Systems, methods, and apparatus for recognizing user interactions with an electronic device are provided. Implementations of the systems, methods, and apparatus include surface and air gesture recognition and identification of fingertips or other objects. In some implementations, a device including a plurality of detectors configured to receive signals indicating interaction of an object with the device at or above a detection area, such that a low resolution image can be generated from the signals, is provided. The device is configured to obtain low resolution image data from the signals and obtain a first reconstructed depth map from the low resolution image data. The first reconstructed depth map may have a higher resolution than the low resolution image. The device is further configured to obtain a second reconstructed depth map from the first reconstructed depth map. The second reconstructed depth map may provide improved boundaries and less noise within the object.
Abstract:
This disclosure provides systems, methods and apparatus for touch and gesture recognition, using a field sequential color display. The display includes a processor, a lighting system, and an arrangement for spatial light modulation that includes an array of light modulators. Each light modulator is switchable between an open position that permits transmittance of light from the lighting system through a respective aperture and a shut position that blocks light transmission through the respective aperture. The processor switches the light modulators in accordance with a first modulation scheme to render an image and in accordance with a second modulation scheme to selectively pass object illuminating light through at least one of the respective apertures. A light sensor receives light resulting from interaction of the object illuminating with an object and outputs a signal to the processor. The processor recognizes, from the output of the light sensor, a characteristic of the object.
Abstract:
Techniques disclosed herein utilize a vision sensor that integrates a special-purpose camera with dedicated computer vision (CV) computation hardware and a dedicated low-power microprocessor for the purposes of detecting, tracking, recognizing, and/or analyzing subjects, objects, and scenes in the view of the camera. The vision sensor processes the information retrieved from the camera using the included low-power microprocessor and sends “events” (or indications that one or more reference occurrences have occurred, and, possibly, associated data) for the main processor only when needed or as defined and configured by the application. This allows the general-purpose microprocessor (which is typically relatively high-speed and high-power to support a variety of applications) to stay in a low-power (e.g., sleep mode) most of the time as conventional, while becoming active only when events are received from the vision sensor.
Abstract:
Techniques disclosed herein utilize a vision sensor that integrates a special-purpose camera with dedicated computer vision (CV) computation hardware and a dedicated low-power microprocessor for the purposes of detecting, tracking, recognizing, and/or analyzing subjects, objects, and scenes in the view of the camera. The vision sensor processes the information retrieved from the camera using the included low-power microprocessor and sends “events” (or indications that one or more reference occurrences have occurred, and, possibly, associated data) for the main processor only when needed or as defined and configured by the application. This allows the general-purpose microprocessor (which is typically relatively high-speed and high-power to support a variety of applications) to stay in a low-power (e.g., sleep mode) most of the time as conventional, while becoming active only when events are received from the vision sensor.
Abstract:
This disclosure provides systems, methods and apparatus for touch and gesture recognition, using a field sequential color display. The display includes a processor, a lighting system, and an arrangement for spatial light modulation that includes an array of light modulators. Each light modulator is switchable between an open position that permits transmittance of light from the lighting system through a respective aperture and a shut position that blocks light transmission through the respective aperture. The processor switches the light modulators in accordance with a first modulation scheme to render an image and in accordance with a second modulation scheme to selectively pass object illuminating light through at least one of the respective apertures. A light sensor receives light resulting from interaction of the object illuminating with an object and outputs a signal to the processor. The processor recognizes, from the output of the light sensor, a characteristic of the object.
Abstract:
Apparatuses, methods, and systems are presented for sensing scene-based occurrences. Such an apparatus may comprise a vision sensor system comprising a first processing unit and dedicated computer vision (CV) computation hardware configured to receive sensor data from at least one sensor array comprising a plurality of sensor pixels and capable of computing one or more CV features using readings from neighboring sensor pixels. The vision sensor system may be configured to send an event to be received by a second processing unit in response to processing of the one or more computed CV features by the first processing unit. The event may indicate possible presence of one or more irises within a scene.
Abstract:
Apparatuses, methods, and systems are presented for sensing scene-based occurrences. Such an apparatus may comprise a vision sensor system comprising a first processing unit and dedicated computer vision (CV) computation hardware configured to receive sensor data from at least one sensor array comprising a plurality of sensor pixels and capable of computing one or more CV features using readings from neighboring sensor pixels. The vision sensor system may be configured to send an event to be received by a second processing unit in response to processing of the one or more computed CV features by the first processing unit. The event may indicate possible presence of one or more irises within a scene.
Abstract:
This disclosure provides systems, methods and apparatus related to touch and gesture recognition with an electronic interactive display. The interactive display has a front surface that includes a viewing area, a planar light guide disposed proximate to and behind the front surface, a light source, and at least one photo sensing element coupled with the first planar light guide. The planar light guide is configured to receive scattered light, the received scattered light resulting from interaction between light emitted by the light source and an object in optical contact with the front surface. The photo sensing element is configured to detect at least some of the received scattered light and to output, to a processor, image data. The processor is configured to recognize, from the image data, one or both of a contact pressure and a rotational orientation of the object.