公开(公告)号：US10825224B2

公开(公告)日：2020-11-03

申请号：US16196680

申请日：2018-11-20

Applicant: Adobe Inc.

Inventor： Geoffrey Heller ,  Jakub Fiser ,  David P. Simons

IPC: G06K9/00 ,  G06T13/40

Abstract: Certain embodiments involve automatically detecting video frames that depict visemes and that are usable for generating an animatable puppet. For example, a computing device accesses video frames depicting a person performing gestures usable for generating a layered puppet, including a viseme gesture corresponding to a target sound or phoneme. The computing device determines that audio data including the target sound or phoneme aligns with a particular video frame from the video frames that depicts the person performing the viseme gesture. The computing device creates, from the video frames, a puppet animation of the gestures, including an animation of the viseme corresponding to the target sound or phoneme that is generated from the particular video frame. The computing device outputs the puppet animation to a presentation device.

公开(公告)号：US20200160581A1

公开(公告)日：2020-05-21

申请号：US16196680

申请日：2018-11-20

Applicant: Adobe Inc.

Inventor： Geoffrey Heller ,  Jakub Fiser ,  David P. Simons

IPC: G06T13/40 ,  G06K9/00 ,  G10L25/57

Abstract: Certain embodiments involve automatically detecting video frames that depict visemes and that are usable for generating an animatable puppet. For example, a computing device accesses video frames depicting a person performing gestures usable for generating a layered puppet, including a viseme gesture corresponding to a target sound or phoneme. The computing device determines that audio data including the target sound or phoneme aligns with a particular video frame from the video frames that depicts the person performing the viseme gesture. The computing device creates, from the video frames, a puppet animation of the gestures, including an animation of the viseme corresponding to the target sound or phoneme that is generated from the particular video frame. The computing device outputs the puppet animation to a presentation device.