公开(公告)号：US10986399B2

公开(公告)日：2021-04-20

申请号：US16441956

申请日：2019-06-14

Applicant: Gracenote, Inc.

Inventor： Mihailo M. Stojancic ,  Sunil Suresh Kulkarni ,  Shashank Merchant ,  Jose Pio Pereira ,  Oleksiy Bolgarov

IPC: H04N21/439 ,  H04N21/8352 ,  G10H1/00 ,  H04N21/414 ,  H04N21/422 ,  H04N21/4223 ,  H04N21/433 ,  H04N21/84 ,  H04N21/845 ,  H04N1/32

Abstract: A mobile device responds in real time to media content presented on a media device, such as a television. The mobile device captures temporal fragments of audio-video content on its microphone, camera, or both and generates corresponding audio-video query fingerprints. The query fingerprints are transmitted to a search server located remotely or used with a search function on the mobile device for content search and identification. Audio features are extracted and audio signal global onset detection is used for input audio frame alignment. Additional audio feature signatures are generated from local audio frame onsets, audio frame frequency domain entropy, and maximum change in the spectral coefficients. Video frames are analyzed to find a television screen in the frames, and a detected active television quadrilateral is used to generate video fingerprints to be combined with audio fingerprints for more reliable content identification.

公开(公告)号：US20190387273A1

公开(公告)日：2019-12-19

申请号：US16441956

申请日：2019-06-14

Applicant: Gracenote, Inc.

Inventor： Mihailo M. Stojancic ,  Sunil Suresh Kulkarni ,  Shashank Merchant ,  Jose Pio Pereira ,  Oleksiy Bolgarov

IPC: H04N21/439 ,  H04N1/32 ,  H04N21/8352 ,  G10H1/00 ,  H04N21/414 ,  H04N21/422 ,  H04N21/4223 ,  H04N21/433 ,  H04N21/84 ,  H04N21/845

Abstract: A mobile device responds in real time to media content presented on a media device, such as a television. The mobile device captures temporal fragments of audio-video content on its microphone, camera, or both and generates corresponding audio-video query fingerprints. The query fingerprints are transmitted to a search server located remotely or used with a search function on the mobile device for content search and identification. Audio features are extracted and audio signal global onset detection is used for input audio frame alignment. Additional audio feature signatures are generated from local audio frame onsets, audio frame frequency domain entropy, and maximum change in the spectral coefficients. Video frames are analyzed to find a television screen in the frames, and a detected active television quadrilateral is used to generate video fingerprints to be combined with audio fingerprints for more reliable content identification.

公开(公告)号：US10714145B2

公开(公告)日：2020-07-14

申请号：US16386015

申请日：2019-04-16

Applicant: Gracenote, Inc.

Inventor： Sunil Suresh Kulkarni ,  Oleksiy Bolgarov

IPC: G11B27/10 ,  H04N9/80 ,  G11B27/031 ,  H04N21/262 ,  H04N21/458 ,  H04N21/234 ,  H04N21/44 ,  H04N21/4788

Abstract: Example methods and apparatus to add a tagged snippet of multimedia content to a playlist are disclosed. An example apparatus comprises an automatic content recognition search service to search a fingerprint database to find a match between query fingerprints for a snippet of multimedia content captured from a multimedia program at a timestamp and reference fingerprints of matching reference multimedia content stored in the fingerprint database, a tag service to generate a tag representing the snippet of multimedia content, wherein the tag, the timestamp, meta information associated with the matching reference multimedia content, and a monitored variable for a number of viewers of the snippet of multimedia content are stored in a database storage as a tagged snippet of multimedia content, and to add the tagged snippet of multimedia content to a playlist for an identified multimedia program if the number of viewers of the tagged snippet exceeds a threshold.

公开(公告)号：US20170201793A1

公开(公告)日：2017-07-13

申请号：US15297658

申请日：2016-10-19

Applicant: Gracenote, Inc.

Inventor： Jose Pio Pereira ,  Sunil Suresh Kulkarni ,  Oleksiy Bolgarov ,  Prashant Ramanathan ,  Shashank Merchant ,  Mihailo M. Stojancic

IPC: H04N21/44 ,  H04N21/442 ,  H04H60/59 ,  H04N21/845 ,  H04N21/8352 ,  H04H60/37

CPC classification number: H04N21/44008 ,  G06F21/10 ,  G06F2221/0704 ,  G06K9/00758 ,  H04H20/106 ,  H04H60/37 ,  H04H60/56 ,  H04H60/59 ,  H04H2201/90 ,  H04N21/44204 ,  H04N21/8352 ,  H04N21/8456

Abstract: A content segmentation, categorization and identification method on consumer devices (clients) is described. Methods for content tracking are illustrated that are suitable for large scale deployment and applications such as broadcast monitoring, novel content publishing and interaction. Time-aligned (synchronous) applications such as multi-language selection, customized advertisements, second screen services and content monitoring applications can be economically deployed at large scales. The client performs fingerprinting, scene change detection, audio turn detection, and logo detection on incoming video and gathers database search results, logos and text to identify and segment video streams into content, promos, and commercials. A learning engine is configured to learn rules for optimal identification and segmentation at each client for each channel and program. Content sensed at the client site is tracked with reduced computation and applications are executed with timing precision. A method and user interface for time-aligned publishing of content and subsequent usage and interaction on one or more displays is described.

公开(公告)号：US20160364389A1

公开(公告)日：2016-12-15

申请号：US15155428

申请日：2016-05-16

Applicant: Gracenote, Inc.

Inventor： Mihailo M. Stojancic ,  Sunil Suresh Kulkarni ,  Shashank Merchant ,  Jose Pio Pereira ,  Oleksiy Bolgarov

IPC: G06F17/30

CPC classification number: G06F16/43 ,  G06F16/433 ,  G06F16/434

Abstract: Techniques for efficient database formation and search in applications embedded in a media device are provided. The search may be performed synchronously with presentation of media programming content on a nearby media presentation device. A mobile media device captures some temporal fragments of the presented audio/video content on its microphone and camera, and then generates query fingerprints for the captured fragment. A local reference database resides on the mobile media device and a master reference database resides on a remote server with a most recent chunk of reference fingerprints transferred dynamically to the local mobile media device. A chunk of the query fingerprints generated locally on the mobile media device are searched on the local reference database for continuous content search and identification. The method presented automatically switches between the local search on the mobile media device and a remote search on an external search server.

公开(公告)号：US20210012810A1

公开(公告)日：2021-01-14

申请号：US16911139

申请日：2020-06-24

Applicant: Gracenote, Inc.

Inventor： Sunil Suresh Kulkarni ,  Oleksiy Bolgarov

IPC: G11B27/10 ,  G11B27/031 ,  H04N21/262 ,  H04N21/458 ,  H04N21/234 ,  H04N21/44 ,  H04N21/4788

Abstract: Example methods and apparatus to add a tagged snippet of multimedia content to a playlist are disclosed. An example apparatus comprises an automatic content recognition search service to search a fingerprint database to find a match between query fingerprints for a snippet of multimedia content captured from a multimedia program at a timestamp and reference fingerprints of matching reference multimedia content stored in the fingerprint database, a tag service to generate a tag representing the snippet of multimedia content, wherein the tag, the timestamp, meta information associated with the matching reference multimedia content, and a monitored variable for a number of viewers of the snippet of multimedia content are stored in a database storage as a tagged snippet of multimedia content, and to add the tagged snippet of multimedia content to a playlist for an identified multimedia program if the number of viewers of the tagged snippet exceeds a threshold.

公开(公告)号：US10297286B2

公开(公告)日：2019-05-21

申请号：US15973118

申请日：2018-05-07

Applicant: Gracenote, Inc.

Inventor： Sunil Suresh Kulkarni ,  Oleksiy Bolgarov

IPC: H04N9/80 ,  G11B27/10 ,  G11B27/031 ,  H04N21/262 ,  H04N21/458 ,  H04N21/234 ,  H04N21/44 ,  H04N21/4788

Abstract: Example methods and apparatus to add a tagged snippet of multimedia content to a playlist are disclosed. An example apparatus comprises an automatic content recognition search service to search a fingerprint database to find a match between query fingerprints for a snippet of multimedia content captured from a multimedia program at a timestamp and reference fingerprints of matching reference multimedia content stored in the fingerprint database, a tag service to generate a tag representing the snippet of multimedia content, wherein the tag, the timestamp, meta information associated with the matching reference multimedia content, and a monitored variable for a number of viewers of the snippet of multimedia content are stored in a database storage as a tagged snippet of multimedia content, and to add the tagged snippet of multimedia content to a playlist for an identified multimedia program if the number of viewers of the tagged snippet exceeds a threshold.

公开(公告)号：US20180254068A1

公开(公告)日：2018-09-06

申请号：US15973118

申请日：2018-05-07

Applicant: Gracenote, Inc.

Inventor： Sunil Suresh Kulkarni ,  Oleksiy Bolgarov

IPC: G11B27/10 ,  H04N21/458 ,  G11B27/031 ,  H04N21/262

CPC classification number: G11B27/10 ,  G11B27/031 ,  H04N21/23418 ,  H04N21/26258 ,  H04N21/44008 ,  H04N21/458 ,  H04N21/4788

Abstract: Example methods and apparatus to add a tagged snippet of multimedia content to a playlist are disclosed. An example apparatus comprises an automatic content recognition search service to search a fingerprint database to find a match between query fingerprints for a snippet of multimedia content captured from a multimedia program at a timestamp and reference fingerprints of matching reference multimedia content stored in the fingerprint database, a tag service to generate a tag representing the snippet of multimedia content, wherein the tag, the timestamp, meta information associated with the matching reference multimedia content, and a monitored variable for a number of viewers of the snippet of multimedia content are stored in a database storage as a tagged snippet of multimedia content, and to add the tagged snippet of multimedia content to a playlist for an identified multimedia program if the number of viewers of the tagged snippet exceeds a threshold.

公开(公告)号：US09966112B1

公开(公告)日：2018-05-08

申请号：US14255742

申请日：2014-04-17

Applicant: Gracenote, Inc.

Inventor： Sunil Suresh Kulkarni ,  Oleksiy Bolgarov

IPC: H04N9/80 ,  G11B27/10 ,  G11B27/031 ,  H04N21/262 ,  H04N21/458

CPC classification number: G11B27/10 ,  G11B27/031 ,  H04N21/23418 ,  H04N21/26258 ,  H04N21/44008 ,  H04N21/458 ,  H04N21/4788

Abstract: In order to organize and reference multimedia content that is presented on a television or other media devices, a tagging system and method are utilized. An approach is described to tag multimedia content at specific times, record text, audio and/or video, and comment at specific times in the multimedia content. For tagging, commenting, and sharing particular moments of multimedia content, automatic content recognition (ACR) is used. ACR supports tagging and recording of snippets of the multimedia content at specific times. Snippets are displayed by using a thumbnail of pictures or small multimedia clips. The snippets can be commented on and shared with selected users or groups of users. An automatic highlight playlist of a multimedia content can be generated, and various filtering operations of the tags, comments and snippets can also be performed.