Abstract:
An electronic device is described. The electronic device includes a camera configured to capture an image of a scene. The electronic device also includes an image segmentation mapper configured to perform segmentation of the image based on image content to generate a plurality of image segments, each of the plurality of image segments associated with spatial coordinates indicative of a location of each segment in the scene. The electronic device further includes a memory configured to store the image and the spatial coordinates. The electronic device additionally includes a LIDAR (light+radar) unit, the LIDAR unit steerable to selectively obtain depth values corresponding to at least a subset of the spatial coordinates. The electronic device further includes a depth mapper configured to generate a depth map of the scene based on the depth values and the spatial coordinates.
Abstract:
Exemplary embodiments are directed to configurable demodulation of image data produced by an image sensor. In some aspects, a method includes receiving information indicating a configuration of the image sensor. In some aspects, the information may indicate a configuration of sensor elements and/or corresponding color filters for the sensor elements. A modulation function may then be generated based on the information. In some aspects, the method also includes demodulating the image data based on the generated modulation function to determine chrominance and luminance components of the image data, and generating the second image based on the determined chrominance and luminance components.
Abstract:
An electronic device for selecting a transform is described. The electronic device includes at least one image sensor, a memory, and a processor coupled to the memory and to the at least one image sensor. The processor is configured to obtain at least two images from the at least one image sensor. The processor is also configured to characterize structural content of each of the at least two images to produce a characterization for each image that is relevant to transform performance. The processor is further configured to select at least one transform from a set of transforms based on the characterization. The processor is additionally configured to apply the at least one transform to at least one of the images to substantially align the at least two images.
Abstract:
Systems and methods for error correction in structured light are disclosed. In one aspect, a method includes receiving, via a receiver sensor, a structured light image of at least a portion of a composite code mask encoding a plurality of codewords, the image including an invalid codeword. The method further includes detecting the invalid codeword. The method further includes generating a plurality of candidate codewords based on the invalid codeword. The method further includes selecting one of the plurality of candidate codewords to replace the invalid codeword. The method further includes generating a depth map for an image of the scene based on the selected candidate codeword. The method further includes generating a digital representation of a scene based on the depth map. The method further includes outputting the digital representation of the scene to an output device.
Abstract:
A method operational on a transmitter device is provided for projecting a composite code mask. A composite code mask on a tangible medium is obtained, where the composite code mask includes a code layer combined with a carrier layer. The code layer may include uniquely identifiable spatially-coded codewords defined by a plurality of symbols. The carrier layer may be independently ascertainable and distinct from the code layer and includes a plurality of reference objects that are robust to distortion upon projection. At least one of the code layer and carrier layer may be pre-shaped by a synthetic point spread function prior to projection. At least a portion of the composite code mask is projected, by the transmitter device, onto a target object to help a receiver ascertain depth information for the target object with a single projection of the composite code mask.
Abstract:
Techniques are disclosed for depth map generation in a structured light system where an optical transmitter is tilted relative to an optical receiver. The optical transmitter has a transmitter optical axis around which structured light spreads, and the optical receiver has a receiver optical axis around which a reflection of the structured light can be captured. The transmitter optical axis and the receiver optical axis intersect one another. A processing circuit compensates for the angle in the tilt in the reflected pattern to generate the depth map.
Abstract:
A method and electronic device for selectively obtaining depth information at locations within a scene are described. Image content analysis is performed on a received image of the scene. Locations within the image to obtain depth information within the scene are determined based on the image analysis. The locations are provided to a LIDAR (light+radar) unit to selectively obtain depth information at the scene locations. The depth information is received from the LIDAR unit and a second image analysis is performed on a second image. The second image analysis is based on the image content of the second image and the received depth information. Updated locations based on the second image analysis may be provided to the LIDAR unit to obtain updated depth information.
Abstract:
Aspects of the present disclosure relate to systems and methods for time-of-flight ranging. An example time-of-flight system includes a transmitter including a plurality of light emitters for transmitting focused light, the plurality of light emitters including a first group of light emitters for transmitting focused light with a first field of transmission and a second group of light emitters for transmitting focused light with a second field of transmission. The first field of transmission at a depth from the transmitter is larger than the second field of transmission at the depth from the transmitter. The time-of-flight system also includes a receiver to receive reflections of the transmitted light.
Abstract:
Client calibration can include: (a) instructing a host to display a first desired target, (b) imaging the first displayed target, (c) determining a second desired target based on the imaging, (d) instructing the host to display a second desired target, and (e) adjusting a calibration parameter based on one or more images of the second desired target. The second desired target can be determined (e.g., selected, dynamically generated) based on the first desired target.
Abstract:
Systems and methods for controlling structured light laser systems are disclosed. One aspect is a structured light system. The system includes a memory device configured to store a depth map. The system further includes an image projecting device including a laser system configured to project codewords. The system further includes a receiver device including a sensor, the receiver device configured to sense the projected codewords reflected from an object. The system further includes a processing circuit configured to retrieve a portion of the depth map and calculate expected codewords from the depth map. The system further includes a feedback system configured to control the output power of the laser system based on the sensed codewords and the expected codewords.