-
公开(公告)号:US11854231B2
公开(公告)日:2023-12-26
申请号:US17589523
申请日:2022-01-31
Applicant: Snap Inc.
Inventor: Maria Jose Garcia Sopo , Qi Pan , Edward James Rosten
CPC classification number: G06T7/75 , G06T19/006 , G06T2207/30244
Abstract: Determining the position and orientation (or “pose”) of an augmented reality device includes capturing an image of a scene having a number of features and extracting descriptors of features of the scene represented in the image. The descriptors are matched to landmarks in a 3D model of the scene to generate sets of matches between the descriptors and the landmarks. Estimated poses are determined from at least some of the sets of matches between the descriptors and the landmarks. Estimated poses having deviations from an observed location measurement that are greater than a threshold value may be eliminated. Features used in the determination of estimated poses may also be weighted by the inverse of the distance between the feature and the device, so that closer features are accorded more weight.
-
公开(公告)号:US11810316B2
公开(公告)日:2023-11-07
申请号:US17714720
申请日:2022-04-06
Applicant: Snap Inc.
Inventor: Patrick Fox-Roberts , Richard McCormack , Qi Pan , Edward James Rosten
CPC classification number: G06T7/70 , G06T3/0093 , G06T5/006 , G06T2207/20216
Abstract: The pose of a wide-angle image is determined by dewarping regions of the wide-angle image, determining estimated poses of the dewarped regions of the wide-angle image and deriving a pose of the wide-angle image from the estimated poses of the of the dewarped regions. The estimated poses of the dewarped regions may be determined by comparing features in the dewarped regions with features in prior dewarped regions from one or more prior wide-angle images, as well as by comparing features in the dewarped regions with features in a point cloud.
-
公开(公告)号:US20230326033A1
公开(公告)日:2023-10-12
申请号:US18205353
申请日:2023-06-02
Applicant: Snap Inc.
Inventor: Piers Cowburn , David Li , Isac Andreas Müller Sandvik , Qi Pan , Andrew Tristan Spek
CPC classification number: G06T7/11 , G06T7/12 , G06T7/143 , G06T7/174 , G06T7/194 , G06T2207/10016 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084
Abstract: Methods, systems, and devices for generating a persistent world-space ground (or floor) segmentation map (or “texture”) for use in augmented or virtual reality 3D experiences.
-
公开(公告)号:US20230186377A1
公开(公告)日:2023-06-15
申请号:US18097619
申请日:2023-01-17
Applicant: Snap Inc.
Inventor: Itamar Berger , Amar Boghani , Maria Jose Garcia Sopo , Qi Pan
IPC: G06Q30/0601 , G06V20/10 , G06Q10/087 , G06Q50/00 , G06T19/00
CPC classification number: G06Q30/0643 , G06Q10/087 , G06Q30/0623 , G06Q30/0631 , G06Q50/01 , G06T19/006 , G06V20/10 , G06K7/1413
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving, from a client device of a first user, a request from the first user to engage in an AR shopping experience curated by a store; identifying a first real-world product available for purchase from the store; receiving an image of a real-world environment of the first user; generating a first AR item that represents the first real-world product; comparing visual attributes of the first AR item to physical layouts of a plurality of real-world objects depicted in the image of the real-world environment; and overlaying the first AR item on a first real-world object of the plurality of real-world objects in the image responsive to comparing the visual attributes of the first AR item to the physical layouts of the plurality of real-world objects.
-
公开(公告)号:US20230177708A1
公开(公告)日:2023-06-08
申请号:US18061775
申请日:2022-12-05
Applicant: Snap Inc.
Inventor: Erick Mendez Mendez , Isac Andreas Müller Sandvik , Qi Pan , Edward James Rosten , Andrew Tristan Spek , Daniel Wagner , Jakob Zillner
Abstract: A depth estimation system to perform operations that include: receiving image data generated by a client device, the image data comprising a depiction of an environment; identifying a set of image features based on the image data; determining a pose of the client device based on the set of features; generating a depth estimation based on the image data and the pose of the client device; and generating a mesh model of the environment based on the depth estimation.
-
公开(公告)号:US11663736B2
公开(公告)日:2023-05-30
申请号:US16729078
申请日:2019-12-27
Applicant: Snap Inc.
Inventor: Piers Cowburn , David Li , Isac Andreas Müller Sandvik , Qi Pan , Matan Zohar
CPC classification number: G06T7/74 , G06F3/011 , G06T19/006 , G06T2207/30204 , G06T2219/004 , G06T2219/024
Abstract: Method for creating marker-based shared augmented reality (AR) session starts with initializing a shared AR session by a first device and by a second device. The first device displays on a display a marker. The second device detects the marker using a camera included in the second device and captures an image of the marker using the camera. The second device determines a transformation between the first device and the second device using the image of the marker. A common coordinate frame is then determined using the transformation, the shared AR session is generated using the common coordinate frame, and the shared AR session is caused to be displayed by the first device and by the second device. Other embodiments are described herein.
-
公开(公告)号:US20220366616A1
公开(公告)日:2022-11-17
申请号:US17876941
申请日:2022-07-29
Applicant: Snap Inc.
Inventor: David Li , Piers George Cowburn , Isac Andreas Müller Sandvik , Qi Pan
Abstract: Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.
-
公开(公告)号:US11488368B2
公开(公告)日:2022-11-01
申请号:US17329435
申请日:2021-05-25
Applicant: Snap Inc.
Inventor: Piers Cowburn , Isac Andreas Müller Sandvik , Qi Pan , David Li
Abstract: A crowd-sourced modeling system to perform operations that include: receiving image data that comprises image attributes; accessing a 3D model based on at least the image attributes of the image data, wherein the 3D model comprises a plurality of parts that collectively depict an object or environment; identifying a change in the object or environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts; and generating an update to the part of the 3D model based on the image attributes of the image data.
-
公开(公告)号:US11488358B2
公开(公告)日:2022-11-01
申请号:US16782874
申请日:2020-02-05
Applicant: Snap Inc.
Inventor: Piers Cowburn , David Li , Isac Andreas Müller Sandvik , Qi Pan , Matan Zohar
IPC: G06T19/00 , G06T7/73 , H04L65/1069 , H04L65/1089 , G06V40/10
Abstract: Methods and systems are disclosed for creating a shared augmented reality (AR) session. The methods and systems perform operations comprising: receiving, by a second device, a request to join an AR session initialized by a first device; in response to receiving the request, detecting a body corresponding to a user of the first device in one or more images captured by a camera of the second device; identifying a body part of the detected body corresponding to the user of the first device; determining, by the second device, a transformation in the AR session between the first device and the second device using the identified body part; and causing the AR session to be displayed by the second device based on the determined transformation.
-
公开(公告)号:US11481932B2
公开(公告)日:2022-10-25
申请号:US17373035
申请日:2021-07-12
Applicant: Snap Inc.
Inventor: David Li , Piers George Cowburn , Isac Andreas Müller Sandvik , Qi Pan
IPC: G06T11/00 , G06T15/04 , G06F3/04845
Abstract: Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.
-
-
-
-
-
-
-
-
-