SYSTEMS AND METHODS FOR SELECTIVELY MODIFYING GATING RATE IN SINGLE PHOTON AVALANCHE DIODES

    公开(公告)号:US20230123494A1

    公开(公告)日:2023-04-20

    申请号:US17505507

    申请日:2021-10-19

    Abstract: A system for selectively modifying gating rate in a single photon avalanche diode (SPAD) is configurable to access first frame metadata associated with a first image frame. The first image frame is captured by performing a first plurality of gate operations to configure the SPAD array to enable photon detection over a frame capture time period. The first plurality of gate operations is performed at a first gating rate such that the first plurality of gate operations comprises a first quantity of gate operations performed over the frame capture time period. The system is further configurable to define a second gating rate based on the first frame metadata and capture a second image frame by performing a second plurality of gate operations to configure the SPAD array to enable photon detection at the second gating rate.

    LOW MOTION TO PHOTON LATENCY RAPID TARGET ACQUISITION

    公开(公告)号:US20230076331A1

    公开(公告)日:2023-03-09

    申请号:US17986445

    申请日:2022-11-14

    Abstract: Techniques for updating a position of overlaid image content using IMU data to reflect subsequent changes in camera positions to minimize latency effects are disclosed. A “system camera” refers to an integrated camera that is a part of an HMD. An “external camera” is a camera that is separated from the HMD. The system camera and the external camera generate images. These images are overlaid on one another and aligned to form an overlaid image. Content from the external camera image is surrounded by a bounding element in the overlaid image. IMU data associated with both the system camera and the external camera is obtained. Based on that IMU data, an amount of movement that the system camera and/or the external camera have moved since the images were originally generated is determined. Based on that movement, the bounding element is shifted to a new position in the overlaid image.

    SYSTEMS AND METHODS FOR LOW COMPUTE HIGH-RESOLUTION DEPTH MAP GENERATION USING LOW-RESOLUTION CAMERAS

    公开(公告)号:US20220335637A1

    公开(公告)日:2022-10-20

    申请号:US17235159

    申请日:2021-04-20

    Abstract: A system for low compute high-resolution depth map generation using low-resolution cameras is configured to obtain a stereo pair of images and generate a depth map by performing stereo matching on the stereo pair of images. The system is also configured to obtain a first image comprising first texture information for the environment that has a first image resolution that is higher than an image resolution of images of the stereo pair of images. The system is further configured to generate a reprojected first image by reprojecting the first image to correspond to an image capture perspective associated with the depth map. The reprojection of the first image is based on depth information from the depth map and includes reprojected first texture information for the environment. The system is also configured to generate an upsampled depth map based on the depth map.

    MOTION COMPENSATION FOR A SPAD ARRAY CAMERA

    公开(公告)号:US20220222906A1

    公开(公告)日:2022-07-14

    申请号:US17147378

    申请日:2021-01-12

    Abstract: Examples are disclosed that relate to motion compensation on a single photon avalanche detector (SPAD) array camera. One example provides a method enacted on an imaging device comprising a SPAD array camera and a motion sensor, the SPAD array camera comprising a plurality of pixels. The method comprises acquiring a plurality of subframes of image data. Each subframe of image data comprises a binary value for each pixel. Based upon motion data from the motion sensor, the method further comprises determining a change in pose of the imaging device between adjacent subframes, applying a positional offset to a current subframe based upon the motion data to align a location of a stationary imaged feature in the current subframe with a location of the stationary imaged feature in a prior subframe to create aligned subframes, summing the aligned subframes to form an image, and outputting the image.

    SYSTEMS AND METHODS FOR CORRECTING ROLLING SHUTTER ARTIFACTS

    公开(公告)号:US20210392316A1

    公开(公告)日:2021-12-16

    申请号:US17319553

    申请日:2021-05-13

    Abstract: Systems having rolling shutter sensors with a plurality of sensor rows are configured for compensating for rolling shutter artifacts that result from different sensor rows in the plurality of sensor rows outputting sensor data at different times. The systems compensate for the rolling shutter artifacts by identifying readout timepoints for the plurality of sensor rows of the rolling shutter sensor while the rolling shutter sensor captures an image of an environment and identifying readout poses each readout timepoint, as well as obtaining a depth map based on the image. The depth map includes a plurality of different rows of depth data that correspond to the different sensor rows. The system further compensates for the rolling shutter artifacts by generating a 3D representation of the environment while unprojecting the rows of depth data into 3D space using the readout poses.

Patent Agency Ranking