公开(公告)号：US20220351424A1

公开(公告)日：2022-11-03

申请号：US17245514

申请日：2021-04-30

Applicant: Facebook, Inc.

Inventor： David Robert Kasper ,  Catherine Yoo ,  Matthew Alexander Nichols

IPC: G06T11/00 ,  G10L25/57 ,  G10L25/90 ,  G10L21/013

Abstract: Methods, systems, and storage media for augmenting a video are disclosed. Exemplary implementations may: receive a selection of an effect; receive user-generated content comprising video data and audio data; detect a characteristic of the audio data comprising at least a volume and/or a pitch of the audio data during a period of time; determine a series of numeric values based on the characteristic of the audio data during the period of time, individual numeric values of the series of numeric values being correlated with an amplitude of the volume and/or pitch at a discrete point within the period of time; and augment at least one of the video data and/or the audio data to include the effect based on the series of numeric values at discrete points in time within the period of time.

公开(公告)号：US11069094B1

公开(公告)日：2021-07-20

申请号：US16410785

申请日：2019-05-13

Applicant: Facebook, Inc.

Inventor： Bruno Pereira Evangelista ,  Houman Meshkin ,  Ben Max Rubinstein ,  Helen Haekwang Kim ,  Anaelisa Aburto ,  David Michael Garrison Hill ,  Chayan Goswami ,  Sung Kyu Robin Kim ,  Ian Heisters ,  Catherine Yoo ,  Ernest Rowe

IPC: G06T11/00 ,  A45D44/00 ,  H04N5/265 ,  G06T11/40 ,  H04N5/272

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering makeup products on a user's face within an augmented reality environment in real-time. For example, the disclosed system can use blend a base makeup color of a selected makeup product with extracted luminance frequencies of a video stream. The disclosed system can then convert the blended makeup color to LAB color space and apply one or more shader models to the lightness of the color based on a material of the selected makeup product. The disclosed system can also apply additional operations for smoothing the skin of the user and matching the makeup product to a skin tone of the user. The disclosed system can then display the makeup product and any additional changes in an augmented reality environment in the video stream.