公开(公告)号：US20240371164A1

公开(公告)日：2024-11-07

申请号：US18652703

申请日：2024-05-01

Applicant: Google LLC

Inventor： Shen Yan ,  Xuehan Xiong ,  Arsha Nagrani ,  Anurag Arnab ,  David Alexander Ross ,  Cordelia Schmid

IPC: G06V20/40 ,  G06V10/774 ,  G06V10/80

Abstract: Methods and systems for video localization using artificial intelligence are provided herein. A set of video embeddings representing features of one or more video frames of a media it em and a set of textual embeddings corresponding to an event associated with the media item are obtained. Fused video-textual data is generated based on the set of video embeddings and the set of textual embeddings. The fused video-textual data indicates features of the video frames of the media item and textual data pertaining to the media item. The fused video-textual data is provided as an input to an artificial intelligence (AI) model trained to perform multiple video localization tasks with respect to media items of a platform. One or move outputs of the AI model are obtained. A segment of the media item that depicts the event is determined based on the one or move outputs of the AI model.

公开(公告)号：US20220383652A1

公开(公告)日：2022-12-01

申请号：US17775529

申请日：2020-11-04

Applicant: Google LLC

Inventor： Bryan Andrew Seybold ,  Shan Yang ,  Bo Hu ,  Kevin Patrick Murphy ,  David Alexander Ross

IPC: G06V40/10 ,  G06V40/20 ,  G06V10/82 ,  G06V10/62 ,  A01K29/00

Abstract: A computing system comprising one or more computing devices can obtain one or more images of an animal. The computing system can determine, using at least one of one or more machine-learned models, a plurality of joint positions associated with the animal based on the one or more images. The computing system can determine a body model for the animal. The computing system can estimate a body pose for the animal based on the one or more images, the plurality of joint positions, and the determined body model.

公开(公告)号：US20250054306A1

公开(公告)日：2025-02-13

申请号：US18797297

申请日：2024-08-07

Applicant: Google LLC

Inventor： Daniel S. Cohen ,  Christopher R. Conover ,  Emily Rose Smith ,  Anoop Menon ,  Benjamin Lehn ,  Sudheendra Vijayanarasimhan ,  Bo Hu ,  Shen Yan ,  Xuehan Xiong ,  David Alexander Ross

IPC: G06V20/40 ,  G06V10/70 ,  H04N21/8549

Abstract: Aspects of the disclosure are directed to methods and systems for short form previews of long form media items. A server can provide, to an artificial intelligence (AI) model, a long form media item to be shared with users. The server can receive, from the AI model, one or more frames that are predicted to contain content that is of interest to the users. The server can extract a segment of the long form media item that corresponds to the one or more frames, where the extracted segment corresponds to a short form media item preview. The short form media item preview can be provided for presentation to the users.