公开(公告)号：US11756337B2

公开(公告)日：2023-09-12

申请号：US17338193

申请日：2021-06-03

Applicant: Adobe Inc.

Inventor： Saikat Chakrabarty ,  Shivani Karol

IPC: G06V40/20 ,  H04N5/278 ,  G06T7/73 ,  G09B21/00 ,  G06N3/08 ,  G06T7/246 ,  G06V20/40 ,  G06V40/10 ,  G06V40/16 ,  G06N3/044

CPC classification number: G06V40/28 ,  G06N3/044 ,  G06N3/08 ,  G06T7/248 ,  G06T7/73 ,  G06V20/46 ,  G06V40/107 ,  G06V40/168 ,  G09B21/009 ,  H04N5/278 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30196

Abstract: Embodiments are disclosed for a subtitle generator for sign language content in digital videos. In some embodiments, a method of subtitle generation includes receiving an input video comprising a representation of one or more sign language gestures, extracting landmark coordinates associated with a signer represented in the input video, determining derivative information from the landmark coordinates, and analyzing the landmark coordinates and the derivative information by at least one gesture detection model to identify a first sign language gesture.