SKELETAL TRACKING USING PREVIOUS FRAMES

    公开(公告)号:US20210248373A1

    公开(公告)日:2021-08-12

    申请号:US17240457

    申请日:2021-04-26

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.

    MARKER-BASED SHARED AUGMENTED REALITY SESSION CREATION

    公开(公告)号:US20210201530A1

    公开(公告)日:2021-07-01

    申请号:US16729078

    申请日:2019-12-27

    Applicant: Snap Inc.

    Abstract: Method for creating marker-based shared augmented reality (AR) session starts with initializing a shared AR session by a first device and by a second device. The first device displays on a display a marker. The second device detects the marker using a camera included in the second device and captures an image of the marker using the camera. The second device determines a transformation between the first device and the second device using the image of the marker. A common coordinate frame is then determined using the transformation, the shared AR session is generated using the common coordinate frame, and the shared AR session is caused to be displayed by the first device and by the second device. Other embodiments are described herein.

    Side-by-side character animation from realtime 3D body motion capture

    公开(公告)号:US12243173B2

    公开(公告)日:2025-03-04

    申请号:US18100080

    申请日:2023-01-23

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.

    Mirror-based augmented reality experience

    公开(公告)号:US12217453B2

    公开(公告)日:2025-02-04

    申请号:US18231025

    申请日:2023-08-07

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.

    BROWSING-BASED AUGMENTED REALITY TRY-ON EXPERIENCE

    公开(公告)号:US20240273613A1

    公开(公告)日:2024-08-15

    申请号:US18107856

    申请日:2023-02-09

    Applicant: Snap Inc.

    CPC classification number: G06Q30/0643 G06F16/986 G06T19/006 G06T2210/16

    Abstract: Aspects of the present disclosure involve a system for providing a browsing-based augmented reality (AR) try-on experience. The system displays a graphical user interface (GUI) comprising a set of fashion items. The system receives a real-time video feed from a camera of the device, the real-time video feed depicting a person. The system retrieves a first AR fashion item corresponding to a first fashion item in the set of fashion items included in the GUI. The system modifies the real-time video feed based on application of the first AR fashion item to the depiction of the person in the real-time video feed. The system presents the modified real-time video feed together with the GUI comprising the set of fashion items.

    Controlling interactive fashion based on body gestures

    公开(公告)号:US12056832B2

    公开(公告)日:2024-08-06

    申请号:US18138269

    申请日:2023-04-24

    Applicant: Snap Inc.

    CPC classification number: G06T19/006

    Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.

Patent Agency Ranking