Determining gaze direction to generate augmented reality content

    公开(公告)号:US12282597B2

    公开(公告)日:2025-04-22

    申请号:US18436322

    申请日:2024-02-08

    Applicant: Snap Inc.

    Inventor: Kyle Goodrich

    Abstract: The subject technology determines a gaze direction in a field of view of a user using an eyewear device. The subject technology generates an anchor point in the field of view based at least in part on the determined gaze direction. The subject technology identifies a surface corresponding to a ground plane in the field of view. The subject technology determines a distance from the identified surface to the anchor point. The subject technology generates AR content based at least in part on the determined distance. The subject technology renders the generated AR content in the field of view for display by the eyewear device.

    AUGMENTED REALITY CONTENT GENERATORS INCLUDING 3D DATA IN A MESSAGING SYSTEM

    公开(公告)号:US20250086909A1

    公开(公告)日:2025-03-13

    申请号:US18955887

    申请日:2024-11-21

    Applicant: Snap Inc.

    Abstract: The subject technology generates a segmentation mask based on first image data. The subject technology applies the segmentation mask on first depth data to reduce a set of artifacts in a depth map based on the first depth data. The subject technology generates a packed depth map based at least in part on the depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels. The subject technology applies, to the first image data and the first depth data, a first augmented reality content generator corresponding to a selected first selectable graphical item, the first image data and the first depth data being captured with a camera. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.

    RENDERING 3D CAPTIONS WITHIN REAL-WORLD ENVIRONMENTS

    公开(公告)号:US20240362873A1

    公开(公告)日:2024-10-31

    申请号:US18763468

    申请日:2024-07-03

    Applicant: Snap Inc.

    CPC classification number: G06T19/006 G06T15/00

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.

    SHOOTING INTERACTION USING AUGMENTED REALITY CONTENT IN A MESSAGING SYSTEM

    公开(公告)号:US20240265652A1

    公开(公告)日:2024-08-08

    申请号:US18638273

    申请日:2024-04-17

    Applicant: Snap Inc.

    Abstract: The subject technology receives a set of frames. The subject technology detect a first gesture correspond to an open trigger finger gesture. The subject technology receives a second set of frames. The subject technology detects from the second set of frames, a second gesture correspond to a closed trigger finger gesture. The subject technology detects a location and a position of a representation of a finger from the closed trigger finger gesture. The subject technology generates a first virtual object based at least in part on the location and the position of the representation of the finger. The subject technology renders a movement of the first virtual object along a vector away from the location and the position of the representation of the finger within a first scene. The subject technology provides for display the rendered movement of the first virtual object along the vector within the first scene.

    VIRTUAL OBJECT MANIPULATION WITH GESTURES IN A MESSAGING SYSTEM

    公开(公告)号:US20240185548A1

    公开(公告)日:2024-06-06

    申请号:US18436818

    申请日:2024-02-08

    Applicant: Snap Inc.

    Abstract: The subject technology detects a first gesture and a second gesture, each gesture corresponding to an open trigger finger gesture. The subject technology detects a third gesture and a fourth gesture, each gesture corresponding to a closed trigger finger gesture. The subject technology, selects a first virtual object in a first scene. The subject technology detects a first location and a first position of a first representation of a first finger from the third gesture and a second location and a second position of a second representation of a second finger from the fourth gesture. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology modifies a set of dimensions of the first virtual object to a different set of dimensions.

    VIRTUAL OBJECT MANIPULATION WITH GESTURES IN A MESSAGING SYSTEM

    公开(公告)号:US20240087264A1

    公开(公告)日:2024-03-14

    申请号:US17941435

    申请日:2022-09-09

    Applicant: Snap Inc.

    Abstract: The subject technology detects a first gesture and a second gesture, each gesture corresponding to an open trigger finger gesture. The subject technology detects a third gesture and a fourth gesture, each gesture corresponding to a closed trigger finger gesture. The subject technology, selects a first virtual object in a first scene. The subject technology detects a first location and a first position of a first representation of a first finger from the third gesture and a second location and a second position of a second representation of a second finger from the fourth gesture. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology modifies a set of dimensions of the first virtual object to a different set of dimensions.

Patent Agency Ranking