公开(公告)号：US11543929B2

公开(公告)日：2023-01-03

申请号：US17301529

申请日：2021-04-06

Applicant: Snap Inc.

Inventor： Yurii Monastyrshyn ,  Oleksandr Pyshchenko

IPC: G06F3/0481 ,  G06V40/16 ,  G06F3/01 ,  G06T19/00 ,  G06V10/25 ,  G06V20/20

Abstract: Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.

公开(公告)号：US11521362B2

公开(公告)日：2022-12-06

申请号：US17445549

申请日：2021-08-20

Applicant: Snap Inc.

Inventor： Artem Bondich ,  Menglei Chai ,  Oleksandr Pyshchenko ,  Jian Ren ,  Sergey Tulyakov

IPC: G06T19/00 ,  G06T7/246 ,  G06K9/62 ,  G06N3/04 ,  G06N3/08 ,  G06T17/00 ,  G06T19/20

Abstract: A messaging system performs neural network hair rendering for images provided by users of the messaging system. A method of neural network hair rendering includes processing a three-dimensional (3D) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. The method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. The method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.

公开(公告)号：US20210256750A1

公开(公告)日：2021-08-19

申请号：US17313388

申请日：2021-05-06

Applicant: Snap Inc.

Inventor： Artem Bondich ,  Oleksandr Pyshchenko

IPC: G06T11/60 ,  G06T5/00 ,  G06T11/20 ,  G06T11/00

Abstract: Systems and methods are provided for rendering hair. The systems and methods include receiving hair spline data comprising coordinates of a plurality of hair strands; selecting a first hair strand of the plurality of hair strands; retrieving coordinates of the first hair strand; identifying based on the respective coordinates of the plurality of hair strands a second hair strand that is adjacent to the first hair strand; storing a reference to the second hair strand in association with the coordinates of the first hair strand; and generating one or more additional hair strands between the first hair strand and the second hair strand based on the coordinates of the first hair strand and the reference to the second hair strand.

公开(公告)号：US20210223919A1

公开(公告)日：2021-07-22

申请号：US17301529

申请日：2021-04-06

Applicant: Snap Inc.

Inventor： Yurii Monastyrshyn ,  Oleksandr Pyshchenko

IPC: G06F3/0481 ,  G06F3/01 ,  G06K9/32 ,  G06K9/00 ,  G06T19/00

Abstract: Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.

公开(公告)号：US10567321B2

公开(公告)日：2020-02-18

申请号：US16237296

申请日：2018-12-31

Applicant: Snap Inc.

Inventor： Grygoriy Kozhemiak ,  Oleksandr Pyshchenko ,  Victor Shaburov ,  Trevor Stephenson ,  Aleksei Stoliar

IPC: G06F15/16 ,  H04L12/58 ,  H04L29/08

Abstract: Systems and methods are provided for receiving a first media content item associated with a first interactive object of an interactive message, receiving a second media content item associated with a second interactive object of the interactive message, generating a third media content item based on the first media content item and second media content item, wherein the third media content item comprises combined features of the first media content item and the second media content item, and causing display of the generated third media content item.