公开(公告)号：US10291678B2

公开(公告)日：2019-05-14

申请号：US15283292

申请日：2016-10-01

Applicant: Facebook, Inc.

Inventor： Hermes Germi Pique Corchs ,  Kirill A. Pugin ,  Razvan Gabriel Racasanu ,  Colin Todd Miller ,  Ragavan Srinivasan ,  Tomer Bar ,  Bryce David Redd

IPC: H04L29/06 ,  G06K9/00 ,  G06T11/60

Abstract: A video effects application executes on a client device having an image capture device and receives video data captured by the image capture device. The video effects application extracts information from the captured video data and stores the extracted information as metadata associated with the captured video data. For example, the video effects application identifies objects in the captured video data or identifies optical flow of the captured video data and stores the identified objects or identified optical flow as metadata associated with the captured video data. The video effects application stores information describing modifications to the captured video data in association with the captured video data. When the captured video data is presented, the captured video data, associated metadata, and information describing the modifications is communicated to a renderer, which uses the metadata to perform the identified modifications to the captured video data when presenting the captured video data.

公开(公告)号：US10977847B2

公开(公告)日：2021-04-13

申请号：US16383005

申请日：2019-04-12

Applicant: Facebook, Inc.

Inventor： Hermes Germi Pique Corchs ,  Kirill A. Pugin ,  Razvan Gabriel Racasanu ,  Colin Todd Miller ,  Ragavan Srinivasan ,  Tomer Bar ,  Bryce David Redd

IPC: G06T11/60 ,  H04L29/06 ,  H04N21/472 ,  H04N21/414 ,  H04N21/4223 ,  H04N21/44 ,  H04N21/658 ,  H04N21/81 ,  G06K9/00

Abstract: A video effects application executes on a client device having an image capture device and receives video data captured by the image capture device. The video effects application extracts information from the captured video data and stores the extracted information as metadata associated with the captured video data. For example, the video effects application identifies objects in the captured video data or identifies optical flow of the captured video data and stores the identified objects or identified optical flow as metadata associated with the captured video data. The video effects application stores information describing modifications to the captured video data in association with the captured video data. When the captured video data is presented, the captured video data, associated metadata, and information describing the modifications is communicated to a renderer, which uses the metadata to perform the identified modifications to the captured video data when presenting the captured video data.

公开(公告)号：US20180097866A1

公开(公告)日：2018-04-05

申请号：US15283292

申请日：2016-10-01

Applicant: Facebook, Inc.

Inventor： Hermes Germi Pique Corchs ,  Kirill A. Pugin ,  Razvan Gabriel Racasanu ,  Colin Todd Miller ,  Ragavan Srinivasan ,  Tomer Bar ,  Bryce David Redd

IPC: H04L29/06 ,  G06T11/60 ,  G06K9/00

CPC classification number: H04L65/604 ,  G06K9/00221 ,  G06K9/00288 ,  G06T11/60 ,  G06T2207/30201 ,  H04L65/607

Abstract: A video effects application executes on a client device having an image capture device and receives video data captured by the image capture device. The video effects application extracts information from the captured video data and stores the extracted information as metadata associated with the captured video data. For example, the video effects application identifies objects in the captured video data or identifies optical flow of the captured video data and stores the identified objects or identified optical flow as metadata associated with the captured video data. The video effects application stores information describing modifications to the captured video data in association with the captured video data. When the captured video data is presented, the captured video data, associated metadata, and information describing the modifications is communicated to a renderer, which uses the metadata to perform the identified modifications to the captured video data when presenting the captured video data.

公开(公告)号：US20190238610A1

公开(公告)日：2019-08-01

申请号：US16383005

申请日：2019-04-12

Applicant: Facebook, Inc.

Inventor： Hermes Germi Pique Corchs ,  Kirill A. Pugin ,  Razvan Gabriel Racasanu ,  Colin Todd Miller ,  Ragavan Srinivasan ,  Tomer Bar ,  Bryce David Redd

IPC: H04L29/06 ,  H04N21/81 ,  H04N21/658 ,  H04N21/44 ,  H04N21/4223 ,  H04N21/414 ,  H04N21/472 ,  G06K9/00 ,  G06T11/60

CPC classification number: H04L65/604 ,  G06K9/00221 ,  G06K9/00288 ,  G06T11/60 ,  G06T2207/30201 ,  H04L65/602 ,  H04L65/605 ,  H04L65/607 ,  H04N21/41407 ,  H04N21/4223 ,  H04N21/44008 ,  H04N21/47205 ,  H04N21/6582 ,  H04N21/8133

Abstract: A video effects application executes on a client device having an image capture device and receives video data captured by the image capture device. The video effects application extracts information from the captured video data and stores the extracted information as metadata associated with the captured video data. For example, the video effects application identifies objects in the captured video data or identifies optical flow of the captured video data and stores the identified objects or identified optical flow as metadata associated with the captured video data. The video effects application stores information describing modifications to the captured video data in association with the captured video data. When the captured video data is presented, the captured video data, associated metadata, and information describing the modifications is communicated to a renderer, which uses the metadata to perform the identified modifications to the captured video data when presenting the captured video data.

公开(公告)号：US10028022B1

公开(公告)日：2018-07-17

申请号：US15626072

申请日：2017-06-16

Applicant: Facebook, Inc.

Inventor： Hermes Germi Pique Corchs ,  Kirill A. Pugin ,  Razvan Gabriel Racasanu ,  Colin Todd Miller

IPC: H04N21/4402 ,  G11B27/031 ,  G06T7/246 ,  H04N21/439 ,  H04N21/44 ,  H04N21/442 ,  H04N21/45 ,  H04N21/81

Abstract: A media effects engine on a computer device applies one or more effects to an input media stream. A performance monitor monitors a performance metric associated with playing the input media stream and reduces a quality parameter associated with the effect upon detecting a drop in the performance metric below a target metric. The quality parameter manages a tradeoff between a quality of effect and an amount of hardware resources consumed to produce the effect. Thus, the effect can be adjusted to meet the capabilities of the computer device.