CONTROLLING INTERACTIVE FASHION BASED ON BODY GESTURES

    公开(公告)号:US20240338913A1

    公开(公告)日:2024-10-10

    申请号:US18746866

    申请日:2024-06-18

    Applicant: Snap Inc.

    CPC classification number: G06T19/006

    Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.

    LIGHT AND RENDERING OF GARMENTS
    4.
    发明申请

    公开(公告)号:US20230116652A1

    公开(公告)日:2023-04-13

    申请号:US17498475

    申请日:2021-10-11

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.

    3D UPPER GARMENT TRACKING
    5.
    发明申请

    公开(公告)号:US20230103125A1

    公开(公告)日:2023-03-30

    申请号:US17490167

    申请日:2021-09-30

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.

    Augmented reality session creation using skeleton tracking

    公开(公告)号:US11488358B2

    公开(公告)日:2022-11-01

    申请号:US16782874

    申请日:2020-02-05

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for creating a shared augmented reality (AR) session. The methods and systems perform operations comprising: receiving, by a second device, a request to join an AR session initialized by a first device; in response to receiving the request, detecting a body corresponding to a user of the first device in one or more images captured by a camera of the second device; identifying a body part of the detected body corresponding to the user of the first device; determining, by the second device, a transformation in the AR session between the first device and the second device using the identified body part; and causing the AR session to be displayed by the second device based on the determined transformation.

    GARMENT SEGMENTATION
    7.
    发明申请

    公开(公告)号:US20220327709A1

    公开(公告)日:2022-10-13

    申请号:US17301690

    申请日:2021-04-12

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a user wearing a garment; generating a segmentation of the garment worn by the user in the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the garment worn by the user to provide a smoothed segmentation of the garment worn by the user; and applying one or more visual effects to the monocular image based on the smoothed segmentation of the garment worn by the user.

    BODY ANIMATION SHARING AND REMIXING

    公开(公告)号:US20220157000A1

    公开(公告)日:2022-05-19

    申请号:US16951921

    申请日:2020-11-18

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.

    MARKER-BASED SHARED AUGMENTED REALITY SESSION CREATION

    公开(公告)号:US20250095203A1

    公开(公告)日:2025-03-20

    申请号:US18970043

    申请日:2024-12-05

    Applicant: Snap Inc.

    Abstract: Method for creating marker-based shared augmented reality (AR) session starts with initializing a shared AR session by a first device and by a second device. The first device displays on a display a marker. The second device detects the marker using a camera included in the second device and captures an image of the marker using the camera. The second device determines a transformation between the first device and the second device using the image of the marker. A common coordinate frame is then determined using the transformation, the shared AR session is generated using the common coordinate frame, and the shared AR session is caused to be displayed by the first device and by the second device. Other embodiments are described herein.

    Personalized avatar real-time motion capture

    公开(公告)号:US12169890B2

    公开(公告)日:2024-12-17

    申请号:US17818539

    申请日:2022-08-09

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.

Patent Agency Ranking