-
公开(公告)号:US12229977B2
公开(公告)日:2025-02-18
申请号:US17529527
申请日:2021-11-18
Applicant: Snap Inc.
Inventor: Georgios Evangelidis , Branislav Micusik , Sagi Katz
Abstract: A method for AR-guided depth estimation is described. The method includes identifying a virtual object rendered in a first frame that is generated based on a first pose of an augmented reality (AR) device, determining a second pose of the AR device, the second pose following the first pose, identifying an augmentation area in the second frame based on the virtual object rendered in the first frame, and the second pose, determining depth information for the augmentation area in the second frame, and rendering the virtual object in the second frame based on the depth information.
-
公开(公告)号:US20240292122A1
公开(公告)日:2024-08-29
申请号:US18657082
申请日:2024-05-07
Applicant: Snap Inc.
Inventor: Sagi Katz , Netanel Kligler , Gilad Refael
IPC: H04N25/57
CPC classification number: H04N25/57
Abstract: A method for increasing a dynamic range of a dual-pixel image sensor is described. The method includes detecting an intensity level of a full pixel from a plurality of pixels of an optical sensor, one or more full pixels of the plurality of pixels includes at least two sub-pixels, detecting an intensity level of one or more sub-pixels, detecting that the intensity level of the full pixel of the optical sensor has reached a saturation level of the full pixel, and in response to detecting that the intensity level of the full pixel of the optical sensor has reached the saturation level of the full pixel, computing an extrapolated intensity level of the full pixel based on the intensity level of the one or more sub-pixels.
-
公开(公告)号:US12073536B2
公开(公告)日:2024-08-27
申请号:US17883602
申请日:2022-08-09
Applicant: Snap Inc.
Inventor: Sagi Katz , David Ben Ezra
IPC: H04N13/239 , G06T5/10 , G06T5/50 , G06T7/00 , G06T7/593 , G06T7/90 , H04N13/00 , H04N13/128 , H04N13/332
CPC classification number: G06T5/50 , G06T5/10 , G06T7/0002 , G06T7/593 , G06T7/90 , G06T7/97 , H04N13/128 , H04N13/239 , H04N13/332 , G06T2207/30168 , H04N2013/0077 , H04N2013/0081
Abstract: Systems and method for correcting images including artifacts due to dirty camera lenses of electronic device are disclosed. Correction of images by the systems and methods includes obtaining a first raw pixel image of a scene captured with a first camera, obtaining a second raw image of the scene captured with a second camera separate from the first camera in a camera baseline direction, rectifying the first and second raw pixel images to create respective first and second rectified pixel images, determining disparity correspondence between corresponding image pixel pairs of the first and second rectified images in the camera baseline direction, mapping first and second rectified images into the same domain using the determined disparity, detect image artifact regions within each domain mapped image by comparing corresponding regions of the domain mapped images, determining correction factors for each detected image artifact region, and correcting the rectified first and second images by applying the determined correction factors.
-
公开(公告)号:US12010286B2
公开(公告)日:2024-06-11
申请号:US17942863
申请日:2022-09-12
Applicant: Snap Inc.
Inventor: Sagi Katz
IPC: H04N13/122 , H04N13/128 , H04N13/239 , H04N13/271 , H04N13/344
CPC classification number: H04N13/122 , H04N13/128 , H04N13/239 , H04N13/271 , H04N13/344
Abstract: Systems and methods for determining disparity between two images are disclosed. Such systems and methods include obtaining a first pixel image of a scene from a first viewpoint, obtaining a second pixel image of the scene from a second viewpoint (e.g., separate from the first viewpoint in a camera baseline direction such as horizontal or vertical), modifying the first and second pixel images using component-separated correction to create respective first and second corrected pixel images maintaining pixel scene correspondence in the camera baseline direction from between the first and second pixel images to between the first and second corrected pixel images, determining pixel pairs from corresponding pixels between the first and second corrected pixel images in the camera baseline direction, and determining disparity correspondence for each of the determined pixel pairs from pixel locations in the first and second pixel images corresponding to respective pixel locations of the pixel pairs in the first and second corrected pixel images.
-
公开(公告)号:US11671718B1
公开(公告)日:2023-06-06
申请号:US17653751
申请日:2022-03-07
Applicant: Snap Inc.
Inventor: Sagi Katz , Netanel Kligler , Gilad Refael
IPC: H04N25/57
CPC classification number: H04N25/57
Abstract: A method for increasing a dynamic range of a dual-pixel image sensor is described. The method includes detecting an intensity level of a full pixel from a plurality of pixels of an optical sensor, one or more full pixels of the plurality of pixels includes at least two sub-pixels, detecting an intensity level of one or more sub-pixels, detecting that the intensity level of the full pixel of the optical sensor has reached a saturation level of the full pixel, and in response to detecting that the intensity level of the full pixel of the optical sensor has reached the saturation level of the full pixel, computing an extrapolated intensity level of the full pixel based on the intensity level of the one or more sub-pixels.
-
公开(公告)号:US11570425B2
公开(公告)日:2023-01-31
申请号:US16887052
申请日:2020-05-29
Applicant: SNAP INC.
IPC: H04N13/327 , H04N13/344 , G06T15/20 , G06T7/80
Abstract: Three-dimensional image calibration and presentation for stereoscopic imaging systems such as eyewear including a first camera and a second camera is described. The calibration and presentation includes obtaining a calibration offset using vanishing points obtained from images captured by a first camera and a second camera to accommodate rotation of the first and second cameras with respect to one another, adjusting a three-dimensional rendering offset by the obtained calibration offset, and presenting the stereoscopic images using the three dimension rendering offset.
-
公开(公告)号:US11461883B1
公开(公告)日:2022-10-04
申请号:US17145963
申请日:2021-01-11
Applicant: Snap Inc.
Inventor: Sagi Katz , David Ben Ezra
IPC: H04N13/239 , H04N13/00 , G06T5/50 , G06T7/00 , G06T7/90 , G06T7/593 , H04N13/332 , G06T5/10 , H04N13/128
Abstract: Systems and method for correcting images including artifacts due to dirty camera lenses of electronic device are disclosed. Correction of images by the systems and methods includes obtaining a first raw pixel image of a scene captured with a first camera, obtaining a second raw image of the scene captured with a second camera separate from the first camera in a camera baseline direction, rectifying the first and second raw pixel images to create respective first and second rectified pixel images, determining disparity correspondence between corresponding image pixel pairs of the first and second rectified images in the camera baseline direction, mapping first and second rectified images into the same domain using the determined disparity, detect image artifact regions within each domain mapped image by comparing corresponding regions of the domain mapped images, determining correction factors for each detected image artifact region, and correcting the rectified first and second images by applying the determined correction factors.
-
公开(公告)号:US20220078391A1
公开(公告)日:2022-03-10
申请号:US17526136
申请日:2021-11-15
Applicant: Snap Inc.
Inventor: Sagi Katz , Matan Zohar , Ilya Levin
IPC: H04N13/111 , G02B27/01 , H04N13/271 , G06T3/00 , G06T7/521
Abstract: A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.
-
公开(公告)号:US11178375B1
公开(公告)日:2021-11-16
申请号:US16658370
申请日:2019-10-21
Applicant: Snap Inc.
Inventor: Sagi Katz , Matan Zohar , Ilya Levin
IPC: H04N13/00 , H04N13/111 , G02B27/01 , H04N13/271 , G06T3/00 , G06T7/521
Abstract: A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.
-
公开(公告)号:US20200090300A1
公开(公告)日:2020-03-19
申请号:US16558777
申请日:2019-09-03
Applicant: Snap Inc.
IPC: G06T3/00 , H04N13/239 , H04N13/207 , G06F3/01 , H04N13/332 , H04N13/398
Abstract: A virtual shockwave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual shockwave creation system to generate, for each of multiple initial depth images, a respective shockwave image by applying a transformation function to the initial three-dimensional coordinates. The virtual shockwave creation system creates a warped shockwave video including a sequence of the generated warped shockwave images. The virtual shockwave creation system presents, via an image display, the warped shockwave video.
-
-
-
-
-
-
-
-
-