公开(公告)号：US10991395B1

公开(公告)日：2021-04-27

申请号：US16277750

申请日：2019-02-15

Applicant: Snap Inc.

Inventor： Elena Shaburova ,  Yurii Monastyrshyn

IPC: G06K9/00 ,  G11B27/031 ,  G06K9/46 ,  G06K9/52 ,  G06T13/40 ,  G06T17/20 ,  G06T11/00 ,  G06T5/00 ,  G06T7/90 ,  G06T7/246 ,  G06T7/33 ,  G06F3/01 ,  G06T11/60 ,  H04N5/262 ,  H04N9/79 ,  G06T19/20 ,  G06N20/00

Abstract: A computer-implemented method for real time video processing for changing a color of an object in a video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising: providing an object in the video that at least partially and at least occasionally is presented in frames of the video; detecting the object in the video, wherein said detection comprises detecting feature reference points of the object; tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame; generating a set of node points on the created mesh based on a request for changing color, the set of node points defining an area the color of which is to be changed; and transforming the frames of the video in such way that the object's color is changed within the defined area when the object is presented in frames of the video.

公开(公告)号：US10950271B1

公开(公告)日：2021-03-16

申请号：US16298721

申请日：2019-03-11

Applicant: Snap Inc.

Inventor： Elena Shaburova ,  Victor Shaburov

IPC: G11B27/031 ,  G06K9/46 ,  G06K9/52 ,  G06T13/40 ,  G06T17/20 ,  G06T7/90 ,  G06T7/246 ,  G06T7/33 ,  G06T11/60 ,  G06T19/20 ,  H04N5/262 ,  H04N9/79 ,  G06N20/00 ,  G06K9/00 ,  G06T11/00 ,  G06T5/00 ,  G06F3/01

Abstract: A computer implemented method of triggering events in a video, the method comprising: providing a list of objects with their states and corresponding events in video such that each state from the list triggers at least one event of the corresponding events, wherein each object from the list has at least one state triggering at least one event of the corresponding events from the list in video; detecting at least one object from the list that at least partially and at least occasionally is presented in frames of the video; tracking the at least one object and its state; triggering at least one event of the corresponding events from the list in video in case the state of the at least one object matches with one of its states from the list.

公开(公告)号：US10566026B1

公开(公告)日：2020-02-18

申请号：US15921282

申请日：2018-03-14

Applicant: Snap Inc.

Inventor： Elena Shaburova

IPC: G06K9/36 ,  G06K9/20 ,  G11B27/031 ,  G06K9/00 ,  G06K9/46 ,  G06K9/52 ,  G06T13/40 ,  G06T17/20 ,  G06T19/20 ,  G06F3/01 ,  H04N9/79 ,  G06T11/60 ,  G06T7/33 ,  G06T7/246 ,  G06T7/90 ,  G06T5/00 ,  G06T11/00 ,  H04N5/262 ,  G06N20/00

Abstract: A method for real-time video processing for changing features of an object in a video, the method comprises: providing an object in the video, the object being at least partially and at least occasionally presented in frames of the video; detecting the object in the video; generating a list of at least one element of the object, the list being based on the object's features to be changed according to a request for modification; detecting the at least one element of the object in the video;tracking the at least one element of the object in the video; and transforming the frames of the video such that the at least one element of the object is modified according to the request for modification.

公开(公告)号：US10438631B2

公开(公告)日：2019-10-08

申请号：US14314334

申请日：2014-06-25

Applicant: Snap Inc.

Inventor： Elena Shaburova ,  Victor Shaburov

IPC: G06K9/36 ,  G06K9/00 ,  G11B27/031 ,  G06T5/00 ,  G06T11/00 ,  G06N20/00 ,  G06T13/40 ,  G06T17/20 ,  G06T19/20 ,  G06F3/01 ,  H04N5/262 ,  G06K9/46 ,  G06K9/52 ,  G06T11/60 ,  H04N9/79 ,  G06T7/33 ,  G06T7/246 ,  G06T7/90

Abstract: A method for real time video processing for retouching an object in a video is presented The method includes providing an object in the video steam, where the object is at least partially and at least occasionally presented in frames of the video. The method sets a degree of retouching and generates a list of at least one element of the object selected based on a request of retouching and the degree of retouching. The method detects the at least one element of the object in the video and parameters of the at least one element and calculates new parameters of the at least one element according to the degree of retouching. Characteristic points are detected for each of the at least one element of the object and a mesh is generated based on the characteristic points for each of the at least one element of the object. The at least one element of the object in the video is tracked by aligning the mesh for each of the at least one element with a position of the corresponding each of the at least one element. The frames of the video are transformed such that the at least one element of the object is modified by the application of the new parameters to the at least one element of the object using the mesh.

公开(公告)号：US09928874B2

公开(公告)日：2018-03-27

申请号：US14314324

申请日：2014-06-25

Applicant: Snap Inc.

Inventor： Elena Shaburova

IPC: G06K9/36 ,  G06K9/00 ,  G11B27/031 ,  G06T5/00 ,  G06T11/00 ,  G06T13/40 ,  G06T17/20 ,  G06T19/20 ,  G06F3/01 ,  G06N99/00 ,  H04N5/262 ,  G06K9/46 ,  G06K9/52 ,  G06T11/60 ,  H04N9/79 ,  G06T7/33 ,  G06T7/246 ,  G06T7/90

CPC classification number: G11B27/031 ,  G06F3/011 ,  G06K9/00261 ,  G06K9/00268 ,  G06K9/00281 ,  G06K9/00302 ,  G06K9/00335 ,  G06K9/00711 ,  G06K9/00744 ,  G06K9/46 ,  G06K9/4652 ,  G06K9/4661 ,  G06K9/52 ,  G06K2009/4666 ,  G06N99/005 ,  G06T5/005 ,  G06T7/246 ,  G06T7/251 ,  G06T7/33 ,  G06T7/90 ,  G06T11/001 ,  G06T11/60 ,  G06T13/40 ,  G06T17/20 ,  G06T19/20 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/10024 ,  G06T2207/20036 ,  G06T2207/30201 ,  H04N5/262 ,  H04N9/79

Abstract: A method for real-time video processing for changing features of an object in a video is presented. The method comprises providing an object in the video, where the object is at least partially and at least occasionally presented in frames of the video. The method detects the object in the video and generates a list of at least one element of the object. The list is based on the object's features to be changed according to a request for modification. The at least one element of the object is detected and tracked. The method transforms the frames of the video such that the at least one element of the object is modified according to the request for modification.