-
公开(公告)号:US20250008068A1
公开(公告)日:2025-01-02
申请号:US18883717
申请日:2024-09-12
Applicant: Snap Inc.
Inventor: Olha Borys , Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: H04N13/128 , G06T7/73 , H04N13/00 , H04N13/239
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for misaligned vantage point mitigation for computer stereo vision. A misaligned vantage point mitigation system determines whether vantage points of the optical sensors are misaligned from an expected vantage point and, if so, determines an adjustment variable to mitigate the misalignment based on the location of matching features identified in images captured by both optical sensors.
-
公开(公告)号:US12210672B2
公开(公告)日:2025-01-28
申请号:US18116511
申请日:2023-03-02
Applicant: Snap Inc.
Inventor: Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: G06F3/01 , G06F3/038 , H04L67/131
Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.
-
公开(公告)号:US20230177708A1
公开(公告)日:2023-06-08
申请号:US18061775
申请日:2022-12-05
Applicant: Snap Inc.
Inventor: Erick Mendez Mendez , Isac Andreas Müller Sandvik , Qi Pan , Edward James Rosten , Andrew Tristan Spek , Daniel Wagner , Jakob Zillner
Abstract: A depth estimation system to perform operations that include: receiving image data generated by a client device, the image data comprising a depiction of an environment; identifying a set of image features based on the image data; determining a pose of the client device based on the set of features; generating a depth estimation based on the image data and the pose of the client device; and generating a mesh model of the environment based on the depth estimation.
-
公开(公告)号:US20250093948A1
公开(公告)日:2025-03-20
申请号:US18970124
申请日:2024-12-05
Applicant: Snap Inc.
Inventor: Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: G06F3/01 , G06F3/038 , H04L67/131
Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.
-
公开(公告)号:US11961251B2
公开(公告)日:2024-04-16
申请号:US17747592
申请日:2022-05-18
Applicant: Snap Inc.
Inventor: Olha Borys , Ilteris Kaan Canberk , Daniel Wagner , Jakob Zillner
IPC: H04N13/128 , G06T7/593 , G06T7/73 , G06T15/00 , H04N13/204 , H04N13/00
CPC classification number: G06T7/593 , G06T7/73 , G06T15/00 , H04N13/128 , H04N13/204 , G06T2207/10012 , H04N2013/0081
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for continuous surface and depth estimation. A continuous surface and depth estimation system determines the depth and surface normal of physical objects by using stereo vision limited within a predetermined window.
-
公开(公告)号:US20220377306A1
公开(公告)日:2022-11-24
申请号:US17747564
申请日:2022-05-18
Applicant: Snap Inc.
Inventor: Olha Borys , Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: H04N13/128 , G06T7/73 , H04N13/239
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for misaligned vantage point mitigation for computer stereo vision. A misaligned vantage point mitigation system determines whether vantage points of the optical sensors are misaligned from an expected vantage point and, if so, determines an adjustment variable to mitigate the misalignment based on the location of matching features identified in images captured by both optical sensors.
-
公开(公告)号:US20220375112A1
公开(公告)日:2022-11-24
申请号:US17747592
申请日:2022-05-18
Applicant: Snap Inc.
Inventor: Olha Borys , Ilteris Kaan Canberk , Daniel Wagner , Jakob Zillner
IPC: G06T7/593 , G06T7/73 , G06T15/00 , H04N13/128 , H04N13/204
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for continuous surface and depth estimation. A continuous surface and depth estimation system determines the depth and surface normal of physical objects by using stereo vision limited within a predetermined window.
-
公开(公告)号:US20240355079A1
公开(公告)日:2024-10-24
申请号:US18305887
申请日:2023-04-24
Applicant: Snap Inc.
Inventor: Lien Le Hong Tran , Olha Borys , Ilteris Kaan Canberk , Tobias Maier , Jakob Zillner
CPC classification number: G06T19/20 , G06T5/20 , G06T19/006 , G06V10/44 , G06V10/761 , G06T2219/2004
Abstract: A system is disclosed, including a processor and a memory. The memory stores instructions that, when executed by the processor, configure the system to perform operations. Surface plane information is obtained, defining a surface plane passing through a surface location and oriented according to a surface normal. An edge is detected in an image. Virtual content is presented, having a virtual position based on an orientation of the edge and the surface plane information.
-
公开(公告)号:US20230401796A1
公开(公告)日:2023-12-14
申请号:US17893723
申请日:2022-08-23
Applicant: Snap Inc.
Inventor: Georgios Evangelidis , Branislav Micusik , Jakob Zillner , Nathan Jacob Litke
CPC classification number: G06T19/006 , G06T19/20 , G06V20/20 , G06T7/74 , G06T2207/10028 , G06T2207/30244 , G06T2219/024
Abstract: A method for aligning coordinate systems from separate augmented reality (AR) devices is described. In one aspect, the method includes generating predicted depths of a first point cloud by applying a pre-trained model to a first single image generated by a first monocular camera of a first augmented reality (AR) device, and first sparse 3D points generated by a first SLAM system at the first AR device, generating predicted depths of a second point cloud by applying the pre-trained model to a second single image generated by a second monocular camera of the second AR device, and second sparse 3D points generated by a second SLAM system at the second AR device, determining a relative pose between the first AR device and the second AR device by registering the first point cloud with the second point cloud.
-
公开(公告)号:US20230205311A1
公开(公告)日:2023-06-29
申请号:US18116511
申请日:2023-03-02
Applicant: Snap Inc.
Inventor: Georg Halmetschlager-Funek , Matthias kALKGRUBER , Daniel Wolf , Jakob Zillner
IPC: G06F3/01 , G06F3/038 , H04L67/131
CPC classification number: G06F3/012 , G06F3/038 , H04L67/131 , G06F2203/0383
Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.
-
-
-
-
-
-
-
-
-