公开(公告)号：US12192593B2

公开(公告)日：2025-01-07

申请号：US18164348

申请日：2023-02-03

Applicant: Adobe Inc.

Inventor： Xiaojuan Wang ,  Richard Zhang ,  Taesung Park ,  Yang Zhou ,  Elya Shechtman

IPC: H04N21/234 ,  G06V10/771 ,  G06V10/82 ,  H04N21/81

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that utilize machine learning to generate a sequence of transition frames for a gap in a clipped digital video. For example, the disclosed system receives a clipped digital video that includes a pre-cut frame prior to a gap in the clipped digital video and a post-cut frame following the gap in the clipped digital video. Moreover, the disclosed system utilizes a natural motion sequence model to generates a sequence of transition keypoint maps between the pre-cut frame and the post-cut frame. Furthermore, using a generative neural network, the disclosed system generates a sequence of transition frames for the gap in the clipped digital video from the sequence of transition keypoint maps.

公开(公告)号：US20240267597A1

公开(公告)日：2024-08-08

申请号：US18164348

申请日：2023-02-03

Applicant: Adobe Inc.

Inventor： Xiaojuan Wang ,  Richard Zhang ,  Taesung Park ,  Yang Zhou ,  Elya Shechtman

IPC: H04N21/81 ,  G06V10/771 ,  G06V10/82 ,  H04N21/234

CPC classification number: H04N21/8153 ,  G06V10/771 ,  G06V10/82 ,  H04N21/23424

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that utilize machine learning to generate a sequence of transition frames for a gap in a clipped digital video. For example, the disclosed system receives a clipped digital video that includes a pre-cut frame prior to a gap in the clipped digital video and a post-cut frame following the gap in the clipped digital video. Moreover, the disclosed system utilizes a natural motion sequence model to generates a sequence of transition keypoint maps between the pre-cut frame and the post-cut frame. Furthermore, using a generative neural network, the disclosed system generates a sequence of transition frames for the gap in the clipped digital video from the sequence of transition keypoint maps.