公开(公告)号：US20210390745A1

公开(公告)日：2021-12-16

申请号：US16946413

申请日：2020-06-19

Applicant: Snap Inc.

Inventor： Olha Rykhliuk ,  Jonathan Solichin ,  Aleksei Stoliar

IPC: G06T11/60 ,  G06K9/62 ,  G06K9/34 ,  G06K9/46

Abstract: Systems and methods herein describe receiving an image via an image capture device, using a machine learning model, generating an image augmentation decision, accessing an augmentation reality content item, associating the generated image augmentation decision with the augmentation reality content item, modifying the received image using the augmentation reality content item and the associated image augmentation decision, and causing presentation of the modified image on a graphical user interface of a computing device.

公开(公告)号：US12226001B2

公开(公告)日：2025-02-18

申请号：US18609698

申请日：2024-03-19

Applicant: Snap Inc.

Inventor： Christine Barron ,  Virginia Drummond ,  Jean Luo ,  Alek Matthiessen ,  Celia Nicole Mourkogiannis ,  Jonathan Solichin ,  Olesia Voronova

IPC: A45D44/00 ,  G06F3/04817 ,  G06F3/04842 ,  G06Q30/0601 ,  G06T11/00 ,  G09B19/00

Abstract: Systems, methods, and computer readable media for augmented reality beauty product tutorials are disclosed. Methods disclose displaying on a first portion of a screen a beauty product tutorial including pre-recorded images of a presenter applying a beauty product to a body part of the presenter and determining first effects indicating changes to make to live images of a user to simulate applying the beauty product to the body part of the user, where the first effects are determined based on second effects indicating changes to the pre-recorded images from applying the beauty product to the body part of the presenter. Methods further disclose processing the live images of the user to add the first effects and indications of motion of the beauty product and displaying the processed live images of the user on a second portion of the screen.

公开(公告)号：US20240354555A1

公开(公告)日：2024-10-24

申请号：US18481932

申请日：2023-10-05

Applicant: Snap Inc.

Inventor： Jacob Knipfing ,  Alex Meckes ,  Jonathan Solichin

IPC: G06N3/0455 ,  G06T19/00

CPC classification number: G06N3/0455 ,  G06T19/006

Abstract: Methods and systems are disclosed for operating an extended reality (XR) experience using one or more machine learning models. The methods and systems accessing, by an interaction application, an XR application and receive, by the interaction application, a query that defines one or more attributes of the XR application. The methods and systems generate a prompt for a generative machine learning model using the query and process the prompt using the generative machine learning model to generate one or more data objects that match the one or more attributes defined by the query. The methods and systems generate, using the XR application, one or more XR objects based on the one or more data objects generated by the generative machine learning model responsive to the prompt.

公开(公告)号：US20240248546A1

公开(公告)日：2024-07-25

申请号：US18625831

申请日：2024-04-03

Applicant: Snap Inc.

Inventor： Jonathan Solichin ,  Xinyao Wang

IPC: G06F3/01 ,  G06F3/0481 ,  G06F3/16 ,  G06T19/00 ,  G06V40/10

CPC classification number: G06F3/017 ,  G06F3/0481 ,  G06F3/16 ,  G06T19/006 ,  G06V40/11

Abstract: Systems and methods herein describe a multi-modal interaction system. The multi-modal interaction system, receives a selection of an augmented reality (AR) experience within an application on a computer device, displays a set of AR objects associated with the AR experience on a graphical user interface (GUI) of the computer device, display textual cues associated with the set of augmented reality objects on the GUI, receives a hand gesture and a voice command, modifies a subset of augmented reality objects of the set of augmented reality objects based on the hand gesture and the voice command, and displays the modified subset of augmented reality objects on the GUI.

公开(公告)号：US20240098211A1

公开(公告)日：2024-03-21

申请号：US18520255

申请日：2023-11-27

Applicant: Snap Inc.

Inventor： Amir Alavi ,  Olha Rykhliuk ,  Xintong Shi ,  Jonathan Solichin ,  Olesia Voronova ,  Artem Yagodin

IPC: H04N5/262 ,  G06F3/01 ,  G06T7/246 ,  G06T11/00 ,  G06V40/20 ,  H04N23/611 ,  H04N23/63

CPC classification number: H04N5/2621 ,  G06F3/017 ,  G06T7/251 ,  G06T11/00 ,  G06V40/28 ,  H04N23/611 ,  H04N23/631 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Systems and methods herein describe a method for capturing a video in real-time by an image capture device. The system provides a plurality of visual pose hints, identifies first pose information in the video while capturing the video, applies a first series of virtual effects to the video, identifies second pose information, and applies a second series of virtual effects to the video, the second series of virtual effects based on the first series of virtual effects.

公开(公告)号：US20230367397A1

公开(公告)日：2023-11-16

申请号：US17740567

申请日：2022-05-10

Applicant: Snap Inc.

Inventor： Jonathan Solichin ,  Xinyao Wang

IPC: G06F3/01 ,  G06T19/00 ,  G06F3/0481 ,  G06F3/16 ,  G06V40/10

CPC classification number: G06F3/017 ,  G06T19/006 ,  G06F3/0481 ,  G06F3/16 ,  G06V40/11

Abstract: Systems and methods herein describe a multi-modal interaction system. The multi-modal interaction system, receives a selection of an augmented reality (AR) experience within an application on a computer device, displays a set of AR objects associated with the AR experience on a graphical user interface (GUI) of the computer device, display textual cues associated with the set of augmented reality objects on the GUI, receives a hand gesture and a voice command, modifies a subset of augmented reality objects of the set of augmented reality objects based on the hand gesture and the voice command, and displays the modified subset of augmented reality objects on the GUI.

公开(公告)号：US11676354B2

公开(公告)日：2023-06-13

申请号：US17215697

申请日：2021-03-29

Applicant: Snap Inc.

Inventor： Christine Barron ,  Virginia Drummond ,  Jean Luo ,  Alek Matthiessen ,  Celia Nicole Mourkogiannis ,  Jonathan Solichin ,  Olesia Voronova

IPC: G06T19/20 ,  G06T19/00 ,  G06T7/20 ,  G06T7/90

CPC classification number: G06T19/20 ,  G06T7/20 ,  G06T7/90 ,  G06T19/006 ,  G06T2207/30201 ,  G06T2219/2012 ,  G06T2219/2016

Abstract: Systems, methods, and computer readable media for augmented reality beauty product tutorials. Methods disclose determining from live images of an augmented reality (AR) tutorial effects, the effects indicating changes to the live images of a presenter of the AR tutorial from a beauty product being applied to a body part of the presenter. The methods further comprising determining from the live images motion, the motion indicating motion of the beauty product from the beauty product being applied to the body part of the presenter and storing the effects and the motion.

公开(公告)号：US11464319B2

公开(公告)日：2022-10-11

申请号：US17301090

申请日：2021-03-24

Applicant: Snap Inc.

Inventor： Christine Barron ,  Virginia Drummond ,  Jean Luo ,  Alek Matthiessen ,  Celia Nicole Mourkogiannis ,  Jonathan Solichin ,  Olesia Voronova

IPC: A45D44/00 ,  G06F3/04817 ,  G06F3/04842 ,  G06Q30/06 ,  G06T11/00 ,  G09B19/00

Abstract: Systems, methods, and computer readable media for augmented reality beauty product tutorials are disclosed. Methods disclose displaying on a first portion of a screen a beauty product tutorial including pre-recorded images of a presenter applying a beauty product to a body part of the presenter and determining first effects indicating changes to make to live images of a user to simulate applying the beauty product to the body part of the user, where the first effects are determined based on second effects indicating changes to the pre-recorded images from applying the beauty product to the body part of the presenter. Methods further disclose processing the live images of the user to add the first effects and indications of motion of the beauty product and displaying the processed live images of the user on a second portion of the screen.

公开(公告)号：US20240314262A1

公开(公告)日：2024-09-19

申请号：US18668951

申请日：2024-05-20

Applicant: Snap Inc.

Inventor： Olha Rykhliuk ,  Jonathan Solichin ,  Olesia Voronova ,  Artem Yagodin

IPC: H04N5/262 ,  G06T7/246 ,  G06T7/73 ,  G06T11/00 ,  H04L51/10 ,  H04L51/18

CPC classification number: H04N5/2621 ,  G06T7/246 ,  G06T7/73 ,  G06T11/00 ,  H04L51/10 ,  H04L51/18 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Systems and methods are presented for capturing a video in real-time by an image capture device using a skeletal pose system. The skeletal pose system identifies first pose information in the video, applies a first virtual effect to the video in response to identifying the first pose information, identifies second pose information in the video, and applies a second virtual effect to the video in response to identifying the first pose information.

公开(公告)号：US12046037B2

公开(公告)日：2024-07-23

申请号：US18232680

申请日：2023-08-10

Applicant: Snap Inc.

Inventor： Christine Barron ,  Virginia Drummond ,  Jean Luo ,  Alek Matthiessen ,  Celia Nicole Mourkogiannis ,  Jonathan Solichin ,  Olesia Voronova

IPC: G06T19/00 ,  G06F16/732 ,  G06K7/10 ,  G06Q30/0601 ,  G06V20/40 ,  A61Q1/00

CPC classification number: G06V20/41 ,  G06F16/7335 ,  G06K7/10118 ,  G06Q30/0627 ,  G06T19/006 ,  G06V20/46 ,  A61Q1/00

Abstract: Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.