公开(公告)号：US10769208B2

公开(公告)日：2020-09-08

申请号：US16151588

申请日：2018-10-04

Applicant: OATH INC.

Inventor： Yale Song ,  Jordi Vallmitjana ,  Amanda Stent ,  Alejandro Jaimes

IPC: G06F7/02 ,  G06F16/00 ,  G06F16/738 ,  G06F16/38 ,  G06F16/34 ,  G06F16/78

Abstract: Disclosed herein is an automated approach for summarizing media content using descriptive information associated with the media content. For example and without limitation, the descriptive information may comprise a title associated with the media content. One or more segments of the media content may be identified to form a media content summary based on each segment's respective similarity to the descriptive information, which respective similarity may be determined using a media content and auxiliary data feature spaces. A shared dictionary of canonical patterns generated using the media content and auxiliary data feature spaces may be used in determining a media content segment's similarity to the descriptive information.

公开(公告)号：US10565771B2

公开(公告)日：2020-02-18

申请号：US15911106

申请日：2018-03-03

Applicant: OATH INC.

Inventor： Yale Song ,  Michael Gygli ,  Liangliang Cao

IPC: G06T13/80 ,  G06K9/48 ,  G06K9/00 ,  G06K9/62 ,  G06N3/08 ,  G06T9/00 ,  G06F16/00 ,  G06N3/04

Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically extracting and creating an animated Graphics Interchange Format (GIF) file from a media file. The disclosed systems and methods identify a number of GIF candidates from a video file, and based on analysis of each candidate's attributes, features and/or qualities, at least one GIF candidate is automatically selected for rendering.

公开(公告)号：US10560742B2

公开(公告)日：2020-02-11

申请号：US15008711

申请日：2016-01-28

Applicant: Oath Inc.

Inventor： Paloma de Juan ,  Yale Song ,  Gloria Zen

IPC: H04N21/442 ,  H04N21/437 ,  H04N21/4728 ,  G06F3/0354 ,  G06F3/0338 ,  G06F3/038

Abstract: A method is provided, that initiates with providing a video over a network to a plurality of client devices, wherein each client device is configured to render the video and track movements of a pointer during the rendering of the video. Movement data that is indicative of the tracked movements of the pointer is received over the network from each client device. The movement data from the plurality of client devices is processed to determine aggregate pointer movement versus elapsed time of the video. The aggregate pointer movement is analyzed to identify a region of interest of the video. A preview of the video is generated based on the identified region of interest.

公开(公告)号：US10095786B2

公开(公告)日：2018-10-09

申请号：US14682654

申请日：2015-04-09

Applicant: OATH INC.

Inventor： Yale Song ,  Jordi Vallmitjana ,  Amanda Stent ,  Alejandro Jaimes

IPC: G06F7/02 ,  G06F17/30

Abstract: Disclosed herein is an automated approach for summarizing media content using descriptive information associated with the media content. For example and without limitation, the descriptive information may comprise a title associated with the media content. One or more segments of the media content may be identified to form a media content summary based on each segment's respective similarity to the descriptive information, which respective similarity may be determined using a media content and auxiliary data feature spaces. A shared dictionary of canonical patterns generated using the media content and auxiliary data feature spaces may be used in determining a media content segment's similarity to the descriptive information.

公开(公告)号：US10818033B2

公开(公告)日：2020-10-27

申请号：US15907586

申请日：2018-02-28

Applicant: OATH INC.

Inventor： Guy Dassa ,  Yale Song ,  Jeffrey Scholz ,  Joao Vitor Baldini Soares ,  Minho Lee

IPC: G06K9/00 ,  G06T7/73 ,  G06N3/08 ,  H04N21/2187 ,  H04N21/431 ,  H04L29/08 ,  H04L29/06 ,  H04N21/44 ,  H04N21/234 ,  G06F3/0485 ,  H04N21/4722

Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide an image processing framework that sub-divides computer vision techniques into three computationally efficient steps: detection, classification and matching. These steps provide an improved image processing framework that can analyze live stream data of a media file, in real-time, in order to identify and track specific digital objects depicted therein. This enables not only image processing detection results, but also the capabilities of augmenting the video stream with additional data related to the detected object.

公开(公告)号：US20200275133A1

公开(公告)日：2020-08-27

申请号：US15930726

申请日：2020-05-13

Applicant: Oath Inc.

Inventor： Bin NI ,  Kirk Lieb ,  Rick Hawes ,  Yale Song ,  Benoit Schillings ,  Vahe Oughourlian ,  Jordi Vallmitjana ,  Jennelle Nystrom ,  Hardik Ruparel ,  Michael Chen ,  Adam Mathes ,  Arunkumar Balasubramanian ,  Jian Zhou ,  Matt Edelman

IPC: H04N21/2187 ,  G11B27/031 ,  H04N21/488 ,  H04N21/2387 ,  H04N21/8549 ,  H04N21/234 ,  G11B27/28

Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.

公开(公告)号：US10740394B2

公开(公告)日：2020-08-11

申请号：US15941437

申请日：2018-03-30

Applicant: OATH INC.

Inventor： Yale Song ,  Guy Dassa ,  Minho Lee ,  Jeffrey Scholz ,  Joao Vitor Baldini Soares

IPC: G06F16/00 ,  G06F16/783 ,  G06K9/62 ,  G06K9/00 ,  G06N20/00 ,  G06F16/738

Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide a novel machine-in-the-loop, image-to-video bootstrapping framework that harnesses a training set built upon an image dataset and a video dataset in order to efficiently produce an accurate training set to be applied to frames of videos. The disclosed systems and methods reduce the amount of time required to build the training dataset, and also provide mechanisms to apply the training dataset to any type of content and for any type of recognition task.

公开(公告)号：US10681391B2

公开(公告)日：2020-06-09

申请号：US15209051

申请日：2016-07-13

Applicant: OATH INC.

Inventor： Bin Ni ,  Kirk Lieb ,  Rick Hawes ,  Yale Song ,  Benoit Schillings ,  Vahe Oughourlian ,  Jordi Vallmitjana ,  Jennelle Nystrom ,  Hardik Ruparel ,  Michael Chen ,  Adam Mathes ,  Arunkumar Balasubramanian ,  Jian Zhou ,  Matt Edelman

IPC: H04N5/445 ,  H04N21/2187 ,  G11B27/031 ,  H04N21/488 ,  H04N21/2387 ,  H04N21/8549 ,  H04N21/234 ,  G11B27/28

Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.

公开(公告)号：US10832738B2

公开(公告)日：2020-11-10

申请号：US15972851

申请日：2018-05-07

Applicant: OATH INC.

Inventor： Yale Song ,  Jordi Vallmitjana ,  Miriam Redi ,  Alejandro Jaimes

IPC: H04N7/10 ,  H04N7/025 ,  G11B27/34 ,  G06K9/00 ,  H04N21/81 ,  G06K9/03 ,  G11B27/28 ,  H04N21/2743 ,  H04N21/482 ,  H04N21/234 ,  H04N21/2343 ,  H04N21/2668 ,  H04N21/431 ,  H04N21/44

Abstract: Disclosed are systems and methods for improving interactions with and between computers in content searching, generating, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically generate a thumbnail image from a frame of a video file, where the thumbnail image displays content of a selected frame determined to be high-quality and highly-relevant to the content of the video file. Frames of a video file are analyzed, and the frame that is the most contextually relevant to the video and of the highest visual quality is selected, where a thumbnail image is generated and displayed on a site or application over a network.

公开(公告)号：US10390082B2

公开(公告)日：2019-08-20

申请号：US15088792

申请日：2016-04-01

Applicant: OATH INC.

Inventor： Yale Song ,  Jordi Vallmitjana

IPC: H04N21/44 ,  H04N21/8549 ,  H04N21/25 ,  H04N21/234 ,  H04N21/466 ,  H04N21/845 ,  H04N21/2187 ,  H04N21/81

Abstract: Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically detecting and rendering highlights from streaming videos in real-time. As a streaming video is being broadcast over the Internet, the disclosed systems and methods determine each type of scene from the streaming video, and automatically score highlight scenes. The scored highlight scenes are then communicated to users as compiled video segments, which can be over any type of channel or platform accessible to a user's device and network that enables content rendering and user interaction.