公开(公告)号：US12033253B2

公开(公告)日：2024-07-09

申请号：US17528981

申请日：2021-11-17

申请人： Snap Inc.

发明人： Piers Cowburn ,  Qi Pan ,  Eitan Pilipski

IPC分类号： G06K9/00 ,  G06T7/11 ,  G06T11/60 ,  G06V20/20 ,  G06V20/62 ,  G06V30/10

CPC分类号： G06T11/60 ,  G06T7/11 ,  G06V20/20 ,  G06V20/63 ,  G06V30/10

摘要： Disclosed are augmented reality (AR) personalization systems to enable a user to edit and personalize presentations of real-world typography in real-time. The AR personalization system captures an image depicting a physical location via a camera coupled to a client device. For example, the client device may include a mobile device that includes a camera configured to record and display images (e.g., photos, videos) in real-time. The AR personalization system causes display of the image at the client device, and scans the image to detect occurrences of typography within the image (e.g., signs, billboards, posters, graffiti).

公开(公告)号：US20240193168A1

公开(公告)日：2024-06-13

申请号：US18582831

申请日：2024-02-21

申请人： Snap Inc.

发明人： Jennica Pounds ,  Qi Pan ,  Brent Michael Barkman ,  Ozi Egri

IPC分类号： G06F16/2457 ,  G06F16/2458 ,  G06F16/248 ,  G06F16/29 ,  G06T19/00

CPC分类号： G06F16/24578 ,  G06F16/2477 ,  G06F16/248 ,  G06F16/29 ,  G06T19/006

摘要： Various embodiments provide for a registry for augmented reality (AR) objects, which can provide AR objects to a client device to support various software or hardware applications. For instance, some embodiments provide for an AR object registry that facilitates or enables registration of one or more AR objects in association with one or more locations across a planet.

公开(公告)号：US20240153049A1

公开(公告)日：2024-05-09

申请号：US18415293

申请日：2024-01-17

申请人： Snap Inc.

发明人： Richard McCormack ,  Qi Pan

IPC分类号： G06T5/80 ,  G06T19/00 ,  H04W4/021 ,  H04W4/029

CPC分类号： G06T5/80 ,  G06T19/006 ,  H04W4/021 ,  H04W4/029 ,  G06T2207/10028 ,  G06T2207/30184

摘要： An Augmented-Reality which performs operations that include: accessing a data object that comprises image data, location data, and orientation data; applying a transformation to the data object to produce a rectified data object; generating a point cloud based on the rectified data object; assigning the point cloud to a location based on at least the location data of the data object; detecting a client device at the location; and loading the point cloud to the client device in response to the detecting the client device at the location.

公开(公告)号：US11978112B2

公开(公告)日：2024-05-07

申请号：US18097619

申请日：2023-01-17

申请人： Snap Inc.

发明人： Itamar Berger ,  Amar Boghani ,  Maria Jose Garcia Sopo ,  Qi Pan

IPC分类号： G06Q30/0601 ,  G06Q10/087 ,  G06Q50/00 ,  G06T19/00 ,  G06V20/10 ,  G06K7/14 ,  G06Q20/12

CPC分类号： G06Q30/0643 ,  G06Q10/087 ,  G06Q30/0623 ,  G06Q30/0631 ,  G06Q50/01 ,  G06T19/006 ,  G06V20/10 ,  G06K7/1413 ,  G06Q20/1235 ,  G06Q30/0633 ,  G06T2200/24 ,  G06T2219/024

摘要： Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving, from a client device of a first user, a request from the first user to engage in an AR shopping experience curated by a store; identifying a first real-world product available for purchase from the store; receiving an image of a real-world environment of the first user; generating a first AR item that represents the first real-world product; comparing visual attributes of the first AR item to physical layouts of a plurality of real-world objects depicted in the image of the real-world environment; and overlaying the first AR item on a first real-world object of the plurality of real-world objects in the image responsive to comparing the visual attributes of the first AR item to the physical layouts of the plurality of real-world objects.

公开(公告)号：US20230368476A1

公开(公告)日：2023-11-16

申请号：US18221179

申请日：2023-07-12

申请人： Snap Inc.

发明人： Qi Pan ,  Edward James Rosten ,  Andrew Tristan Spek ,  Supannee Tanathong

IPC分类号： G06T19/00 ,  G06T7/70

CPC分类号： G06T19/006 ,  G06T7/70

摘要： An augmented reality device generates an updated position and orientation (pose) value by initially determining, using image-based processing, a pose estimate from a current image frame, a previous image frame and a previous pose. An IMU pose is then obtained from data generated by an inertial measurement unit including motion sensors, and transformation between the pose estimate and the IMU pose is determined. The transformation is applied to the pose estimate to generate a pose update. Media content is applied to a position within an image, the position being based on the pose update.

公开(公告)号：US11798243B2

公开(公告)日：2023-10-24

申请号：US17948813

申请日：2022-09-20

申请人： Snap Inc.

发明人： Piers Cowburn ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  David Li

IPC分类号： G06T7/00 ,  G06T19/00 ,  G06T19/20 ,  G06F16/51 ,  G06F16/54 ,  H04L51/224 ,  H04L67/51 ,  H04L67/01

CPC分类号： G06T19/006 ,  G06F16/51 ,  G06F16/54 ,  G06T7/97 ,  G06T19/20 ,  H04L51/224 ,  H04L67/51 ,  G06T2219/024 ,  H04L67/01

摘要： A crowd-sourced modeling system to perform operations that include: receiving image data that comprises image attributes; accessing a 3D model based on at least the image attributes of the image data, wherein the 3D model comprises a plurality of parts that collectively depict an object or environment; identifying a change in the object or environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts; and generating an update to the part of the 3D model based on the image attributes of the image data.

公开(公告)号：US11721072B2

公开(公告)日：2023-08-08

申请号：US17876941

申请日：2022-07-29

申请人： Snap Inc.

发明人： David Li ,  Piers George Cowburn ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC分类号： G06T19/00 ,  G06T11/00 ,  G06T15/04 ,  G06T19/20 ,  G06F3/04845

CPC分类号： G06T19/00 ,  G06T11/00 ,  G06T15/04 ,  G06T19/006 ,  G06T19/20 ,  G06F3/04845 ,  G06T2200/24

摘要： Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.

公开(公告)号：US11687150B2

公开(公告)日：2023-06-27

申请号：US17361857

申请日：2021-06-29

申请人： Snap Inc.

发明人： Piers Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC分类号： G06T19/00 ,  G06F3/01 ,  G06T7/90 ,  H04W4/30 ,  H04W4/021 ,  H04L51/222 ,  G06V10/40 ,  G06V20/20

CPC分类号： G06F3/011 ,  G06T7/90 ,  G06T19/006 ,  G06V10/40 ,  G06V20/20 ,  H04L51/222 ,  H04W4/021 ,  H04W4/30

摘要： An occlusion detection system to perform operations that include: capturing image data that depicts an environment at a client device, the environment including a target object at a position within the environment; causing display of a presentation of the environment at the client device, the presentation of the environment including a display of the target object at the position within the environment; detecting a first attribute of the display of the target object at the client device; performing a comparison of the first attribute of the display of the target object and a second attribute associated with the target object; and detecting an occlusion based on the comparison.

公开(公告)号：US20220156976A1

公开(公告)日：2022-05-19

申请号：US17589523

申请日：2022-01-31

申请人： Snap Inc.

发明人： Maria Jose Garcia Sopo ,  Qi Pan ,  Edward James Rosten

IPC分类号： G06T7/73 ,  G06T19/00

摘要： Determining the position and orientation (or “pose”) of an augmented reality device includes capturing an image of a scene having a number of features and extracting descriptors of features of the scene represented in the image. The descriptors are matched to landmarks in a 3D model of the scene to generate sets of matches between the descriptors and the landmarks. Estimated poses are determined from at least some of the sets of matches between the descriptors and the landmarks. Estimated poses having deviations from an observed location measurement that are greater than a threshold value may be eliminated. Features used in the determination of estimated poses may also be weighted by the inverse of the distance between the feature and the device, so that closer features are accorded more weight.

公开(公告)号：US20210390729A1

公开(公告)日：2021-12-16

申请号：US16897749

申请日：2020-06-10

申请人： Snap Inc.

发明人： Patrick Fox-Roberts ,  Richard McCormack ,  Qi Pan ,  Edward James Rosten

IPC分类号： G06T7/70 ,  G06T5/00 ,  G06T3/00

摘要： The pose of a wide-angle image is determined by dewarping regions of the wide-angle image, determining estimated poses of the dewarped regions of the wide-angle image and deriving a pose of the wide-angle image from the estimated poses of the of the dewarped regions. The estimated poses of the dewarped regions may be determined by comparing features in the dewarped regions with features in prior dewarped regions from one or more prior wide-angle images, as well as by comparing features in the dewarped regions with features in a point cloud.