公开(公告)号：US20230367810A1

公开(公告)日：2023-11-16

申请号：US18091837

申请日：2022-12-30

Applicant: Google LLC

Inventor： Jonathan Matthew Malmaud ,  Nicolas Paul-Stringall Higuera ,  Jeff Hsu ,  Sarah Fay Smith ,  Gabriel Rubow Culbertson ,  Runmin Zhao

IPC: G06F16/783 ,  H04N21/4722

CPC classification number: G06F16/7844 ,  G06F16/7837 ,  H04N21/4722

Abstract: A server system obtains a transcription of content from a video and applies a machine learning resource to identify entities which are most likely to be searched for by a user viewing the video, based on the transcription of the content. The server system generates entity cards for each of the entities, each of the entity cards including descriptive content relating to a respective entity among the entities. The server system provides a user interface, to be displayed on a respective display of one or more user computing devices, for playing the video on a first portion of the user interface. When the video is played and a first entity among the entities is mentioned in the video, the user interface displays a first entity card on a second portion of the user interface, the first entity card including descriptive content relating to the first entity.

公开(公告)号：US20240370494A1

公开(公告)日：2024-11-07

申请号：US18775977

申请日：2024-07-17

Applicant: Google LLC

Inventor： Jonathan Matthew Malmaud ,  Nicolas Paul-Stringall Higuera ,  Jeff Hsu ,  Sarah Fay Smith ,  Gabriel Rubow Culbertson ,  Runmin Zhao

IPC: G06F16/783 ,  H04N21/4722

Abstract: A computer-implemented method includes: receiving a video and implementing one or more machine-learned models to: identify a plurality of entities from the video, rank the plurality of entities, and generate, based on the rank of the plurality of entities, a first entity card which includes descriptive content relating to a first entity from among the plurality of entities. The first entity corresponds to one or more entities which are ranked highest among the plurality of entities. The method further includes: providing, for presentation on a display device, the video; and providing, for presentation on the display device while the video is being played, the first entity card, in response to the first entity being mentioned in the video.

公开(公告)号：US12072934B2

公开(公告)日：2024-08-27

申请号：US18091837

申请日：2022-12-30

Applicant: Google LLC

Inventor： Jonathan Matthew Malmaud ,  Nicolas Paul-Stringall Higuera ,  Jeff Hsu ,  Sarah Fay Smith ,  Gabriel Rubow Culbertson ,  Runmin Zhao

IPC: G06F16/78 ,  G06F16/783 ,  H04N21/4722

CPC classification number: G06F16/7844 ,  G06F16/7837 ,  H04N21/4722

Abstract: A server system obtains a transcription of content from a video and applies a machine learning resource to identify entities which are most likely to be searched for by a user viewing the video, based on the transcription of the content. The server system generates entity cards for each of the entities, each of the entity cards including descriptive content relating to a respective entity among the entities. The server system provides a user interface, to be displayed on a respective display of one or more user computing devices, for playing the video on a first portion of the user interface. When the video is played and a first entity among the entities is mentioned in the video, the user interface displays a first entity card on a second portion of the user interface, the first entity card including descriptive content relating to the first entity.