Localizing an augmented reality device

    公开(公告)号:US11854231B2

    公开(公告)日:2023-12-26

    申请号:US17589523

    申请日:2022-01-31

    Applicant: Snap Inc.

    CPC classification number: G06T7/75 G06T19/006 G06T2207/30244

    Abstract: Determining the position and orientation (or “pose”) of an augmented reality device includes capturing an image of a scene having a number of features and extracting descriptors of features of the scene represented in the image. The descriptors are matched to landmarks in a 3D model of the scene to generate sets of matches between the descriptors and the landmarks. Estimated poses are determined from at least some of the sets of matches between the descriptors and the landmarks. Estimated poses having deviations from an observed location measurement that are greater than a threshold value may be eliminated. Features used in the determination of estimated poses may also be weighted by the inverse of the distance between the feature and the device, so that closer features are accorded more weight.

    CUSTOMIZED VIRTUAL STORE
    84.
    发明公开

    公开(公告)号:US20230186377A1

    公开(公告)日:2023-06-15

    申请号:US18097619

    申请日:2023-01-17

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving, from a client device of a first user, a request from the first user to engage in an AR shopping experience curated by a store; identifying a first real-world product available for purchase from the store; receiving an image of a real-world environment of the first user; generating a first AR item that represents the first real-world product; comparing visual attributes of the first AR item to physical layouts of a plurality of real-world objects depicted in the image of the real-world environment; and overlaying the first AR item on a first real-world object of the plurality of real-world objects in the image responsive to comparing the visual attributes of the first AR item to the physical layouts of the plurality of real-world objects.

    Crowd sourced mapping system
    88.
    发明授权

    公开(公告)号:US11488368B2

    公开(公告)日:2022-11-01

    申请号:US17329435

    申请日:2021-05-25

    Applicant: Snap Inc.

    Abstract: A crowd-sourced modeling system to perform operations that include: receiving image data that comprises image attributes; accessing a 3D model based on at least the image attributes of the image data, wherein the 3D model comprises a plurality of parts that collectively depict an object or environment; identifying a change in the object or environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts; and generating an update to the part of the 3D model based on the image attributes of the image data.

    Augmented reality session creation using skeleton tracking

    公开(公告)号:US11488358B2

    公开(公告)日:2022-11-01

    申请号:US16782874

    申请日:2020-02-05

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for creating a shared augmented reality (AR) session. The methods and systems perform operations comprising: receiving, by a second device, a request to join an AR session initialized by a first device; in response to receiving the request, detecting a body corresponding to a user of the first device in one or more images captured by a camera of the second device; identifying a body part of the detected body corresponding to the user of the first device; determining, by the second device, a transformation in the AR session between the first device and the second device using the identified body part; and causing the AR session to be displayed by the second device based on the determined transformation.

Patent Agency Ranking