公开(公告)号：US11631276B2

公开(公告)日：2023-04-18

申请号：US17303875

申请日：2021-06-09

Applicant: Snap Inc.

Inventor： Maksim Gusarov ,  Igor Kudriashov ,  Valerii Filev ,  Sergei Kotcur

IPC: G06V40/16 ,  G06T13/40

Abstract: Systems, devices, media, and methods are presented for generating facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial landmarks within the portion of the face. The systems and methods determine one or more characteristics representing the portion of the face, in response to detecting the portion of the face. Based on the one or more characteristics and the set of facial landmarks, the systems and methods generate a representation of a face.

公开(公告)号：US20210295018A1

公开(公告)日：2021-09-23

申请号：US17303875

申请日：2021-06-09

Applicant: Snap Inc.

Inventor： Maksim Gusarov ,  Igor Kudriashov ,  Valerii Filev ,  Sergei Kotcur

IPC: G06K9/00 ,  G06T13/40

Abstract: Systems, devices, media, and methods are presented for generating facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial landmarks within the portion of the face. The systems and methods determine one or more characteristics representing the portion of the face, in response to detecting the portion of the face. Based on the one or more characteristics and the set of facial landmarks, the systems and methods generate a representation of a face.

公开(公告)号：US20190266390A1

公开(公告)日：2019-08-29

申请号：US16409390

申请日：2019-05-10

Applicant: Snap Inc.

Inventor： Maksim Gusarov ,  Igor Kudriashov ,  Valerii Filev ,  Sergei Kotcur

IPC: G06K9/00 ,  G06T13/40

Abstract: Systems, devices, media, and methods are presented for generating facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial landmarks within the portion of the face. The systems and methods determine one or more characteristics representing the portion of the face, in response to detecting the portion of the face. Based on the one or more characteristics and the set of facial landmarks, the systems and methods generate a representation of a face.

公开(公告)号：US20230384918A1

公开(公告)日：2023-11-30

申请号：US18232146

申请日：2023-08-09

Applicant: Snap Inc.

Inventor： Theresa Barton ,  Yanping Chen ,  Jaewook Chung ,  Christopher Crutchfield ,  Aymeric Damien ,  Sergei Kotcur ,  Igor Kudriashov ,  Sergey Tulyakov ,  Andrew Wan ,  Emre Yamangil

IPC: G06F3/04845 ,  G06F3/0482 ,  G06T7/11 ,  H04N5/265 ,  H04N5/262 ,  G06V20/40 ,  G06V40/16

CPC classification number: G06F3/04845 ,  G06F3/0482 ,  G06T7/11 ,  H04N5/265 ,  H04N5/2628 ,  G06V20/40 ,  G06V40/161 ,  G06F3/04817

Abstract: A system of machine learning schemes can be configured to efficiently perform image processing tasks on a user device, such as a mobile phone. The system can selectively detect and transform individual regions within each frame of a live streaming video. The system can selectively partition and toggle image effects within the live streaming video.

公开(公告)号：US11676412B2

公开(公告)日：2023-06-13

申请号：US17022350

申请日：2020-09-16

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Yurii Monastyrshyn ,  Oleksandr Pyshchenko ,  Sergei Kotcur

IPC: G06K9/00 ,  G06V40/10 ,  A63F13/837 ,  A63F13/213 ,  A63F13/22 ,  G06T7/73 ,  G06T7/90 ,  A63F13/655 ,  A63F13/428 ,  A63F13/52 ,  G06T7/77

CPC classification number: G06V40/11 ,  A63F13/213 ,  A63F13/22 ,  A63F13/428 ,  A63F13/52 ,  A63F13/655 ,  A63F13/837 ,  G06T7/73 ,  G06T7/77 ,  G06T7/90 ,  G06T2207/10024 ,  G06T2207/20072 ,  G06T2207/30196

Abstract: Systems, devices, and methods are presented for segmenting an image of a video stream with a client device by receiving one or more images depicting an object of interest and determining pixels within the one or more images corresponding to the object of interest. The systems, devices, and methods identify a position of a portion of the object of interest and determine a direction for the portion of the object of interest. Based on the direction of the portion of the object of interest, a histogram threshold is dynamically modified for identifying pixels as corresponding to the portion of the object of interest. The portion of the object of interest is replaced with a graphical interface element aligned with the direction of the portion of the object of interest.

公开(公告)号：US20210311618A1

公开(公告)日：2021-10-07

申请号：US17354520

申请日：2021-06-22

Applicant: Snap Inc.

Inventor： Theresa Barton ,  Yanping Chen ,  Jaewook Chung ,  Christopher Yale Crutchfield ,  Aymeric Damien ,  Sergei Kotcur ,  Igor Kudriashov ,  Sergey Tulyakov ,  Andrew Wan ,  Emre Yamangil

IPC: G06F3/0484 ,  G06F3/0482 ,  H04N5/265 ,  G06K9/00 ,  G06T7/11 ,  H04N5/262

Abstract: A system of machine learning schemes can be configured to efficiently perform image processing tasks on a user device, such as a mobile phone. The system can selectively detect and transform individual regions within each frame of a live streaming video. The system can selectively partition and toggle image effects within the live streaming video.

公开(公告)号：US11048916B2

公开(公告)日：2021-06-29

申请号：US16409390

申请日：2019-05-10

Applicant: Snap Inc.

Inventor： Maksim Gusarov ,  Igor Kudriashov ,  Valerii Filev ,  Sergei Kotcur

IPC: G06K9/00 ,  G06T13/40

Abstract: Systems, devices, media, and methods are presented for generating facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial landmarks within the portion of the face. The systems and methods determine one or more characteristics representing the portion of the face, in response to detecting the portion of the face. Based on the one or more characteristics and the set of facial landmarks, the systems and methods generate a representation of a face.

公开(公告)号：US20210182624A1

公开(公告)日：2021-06-17

申请号：US17189563

申请日：2021-03-02

Applicant: Snap Inc.

Inventor： Sergey Tulyakov ,  Sergei Korolev ,  Aleksei Stoliar ,  Maksim Gusarov ,  Sergei Kotcur ,  Christopher Yale Crutchfield ,  Andrew Wan

IPC: G06K9/62 ,  G06N3/08 ,  G06N3/04

Abstract: A compact generative neural network can be distilled from a teacher generative neural network using a training network. The compact network can be trained on the input data and output data of the teacher network. The training network train the student network using a discrimination layer and one or more types of losses, such as perception loss and adversarial loss.