Multiplexed exposure sensor for HDR imaging

    公开(公告)号:US11075234B2

    公开(公告)日:2021-07-27

    申请号:US15943140

    申请日:2018-04-02

    Abstract: Optimizations are provided for a high dynamic range (HDR) sensor. This sensor is a spatially multiplexed image sensor that includes at least two sets of red, green, and blue (RGB) pixels. Each red pixel in the second set of RGB pixels is positioned proximately and sometimes, adjacently, to at least one red pixel in the first set of RGB pixels. Each green pixel in the second set of RGB pixels is positioned proximately to at least one green pixel in the first set of RGB pixels. Each blue pixel in the second set of RGB pixels is positioned proximately to at least one blue pixel in the first set of RGB pixel. This spatially multiplexed image sensor is able to generate a digital image with reduced motion blurring artifacts.

    IPD correction and reprojection for accurate mixed reality object placement

    公开(公告)号:US10948726B2

    公开(公告)日:2021-03-16

    申请号:US16593176

    申请日:2019-10-04

    Abstract: Optimizations are provided for generating passthrough visualizations for Head Mounted Displays. The interpupil distance of a user wearing a head-mounted device is determined and a stereo camera pair with a left and right camera is used to capture raw images. The center-line perspectives of the images captured by the left camera have non-parallel alignments with respect to center-line perspectives of any images captured by the right camera. After the raw images are captured, various camera distortion corrections are applied to the images to create corrected images. Epipolar transforms are then applied to the corrected images to create transformed images having parallel center-line perspectives. Thereafter, a depth map is generated of the transformed images. Finally, left and right passthrough visualizations are generated and rendered by reprojecting the transformed left and right images.

    OPTIMIZED EXPOSURE CONTROL FOR IMPROVED DEPTH MAPPING

    公开(公告)号:US20210065392A1

    公开(公告)日:2021-03-04

    申请号:US16555660

    申请日:2019-08-29

    Abstract: Disclosed herein are optimized techniques for controlling the exposure time or illumination intensity of a depth sensor. Invalid-depth pixels are identified within a first depth map of an environment. For each invalid-depth pixel, a corresponding image pixel is identified in a depth image that was used to generate the first depth map. Multiple brightness intensities are identified from the depth image. Each brightness intensity is categorized as corresponding to either an overexposed or underexposed image pixel. An increased exposure time or illumination intensity or, alternatively, a decreased exposure time or illumination intensity is then used to capture another depth image of the environment. After a second depth map is generated based on the new depth image, portion(s) of the second depth map are selectively merged with the first depth map by replacing the invalid-depth pixels of the first depth map with corresponding valid-depth pixels of the second depth map.

    Machine-learned depth dealiasing
    67.
    发明授权

    公开(公告)号:US10929956B2

    公开(公告)日:2021-02-23

    申请号:US16460321

    申请日:2019-07-02

    Abstract: Techniques for de-aliasing depth ambiguities included within infrared phase depth images are described herein. An illuminator emits reference light towards a target object. Some of this light is reflected back and detected. A phase image is generated based on phase differences between the reference light and the reflected light. The phase differences represent changes in depth within overlapping sinusoidal periods of the reference and reflected light. The phase image also includes ambiguities because multiple different depths within the phase image share the same phase difference value, even though these depths actually correspond to different real-world depths. The phase image is fed as input to a machine learning (“ML”) component, which is configured to de-alias the ambiguities by determining, for each pixel in the phase image, a corresponding de-aliasing interval. A depth map is generated based on the phase image and any de-aliasing intervals generated by the ML component.

    Automatic permissions for virtual objects

    公开(公告)号:US10762219B2

    公开(公告)日:2020-09-01

    申请号:US15983408

    申请日:2018-05-18

    Abstract: Optimizations are provided to control access to virtual content included within a three-dimensional (3D) mesh. Specifically, after the 3D mesh is accessed, then objects represented by the 3D mesh are segmented so that they are distinguishable from one another. Once segmented, then a permissions is assigned to each object or even to groups of objects. For instance, all of the objects that are associated with a particular sub-space (e.g., a bedroom or a living room) may be assigned the same permissions. By assigning permissions to objects, it is possible to control which requesting entities will have access to the objects as well as how much access each of those requesting entities is afforded.

    Selectively alerting users of real objects in a virtual environment

    公开(公告)号:US10607083B2

    公开(公告)日:2020-03-31

    申请号:US16040518

    申请日:2018-07-19

    Abstract: A computer-implemented technique is described herein for discriminatively apprising the user of the existence of some, but not necessarily all, physical objects in a physical environment in the course of the user's interaction with a virtual environment. In operation, the technique allows the user to selectively identify one or more objects-of-interest, such as people, walls, computing devices, etc. The technique then uses a scene analysis component to automatically detect the presence of the selected objects-of-interest in the physical environment, while the user interacts with the virtual environment. The technique provides alert information which notifies the user of the existence of any objects-of-interest that it detects. By virtue of the above-summarized strategy, the technique can apprise the user of objects-of-interest in the user's vicinity without cluttering the user's virtual experience with extraneous information pertaining to the physical environment.

    Deformation detection and automatic calibration for a depth imaging system

    公开(公告)号:US10560679B2

    公开(公告)日:2020-02-11

    申请号:US15252129

    申请日:2016-08-30

    Abstract: Disclosed are an apparatus and a method for detecting deformation of a structured light depth imaging system and automatic re-calibration for the depth imaging system. In one embodiment, a depth imaging device includes a light projector, a camera and a processor. The light projector emits light corresponding to a projected pattern image having a plurality of features with known locations in the projected pattern image. The camera captures the light reflected by an environment of the depth imaging device and generates a reflected pattern image as a two-dimensional (2D) projection of the environment. The reflected pattern image includes a plurality of features that correspond to the features of the projected pattern image. The processor detects a misalignment for a distance or an orientation between the light projector and the camera based on a relationship between the features in the projected pattern image and the features in the reflected pattern image.

Patent Agency Ranking