公开(公告)号：WO2018053257A1

公开(公告)日：2018-03-22

申请号：PCT/US2017/051768

申请日：2017-09-15

Applicant: SECOND SPECTRUM, INC.

Inventor： CHANG, Yu-Han ,  MAHESWARAN, Rajiv ,  SU, Jeffrey, Wayne ,  HOLLINGSWORTH, Noel

IPC: H04N21/466 ,  H04N21/44 ,  H04N21/434 ,  H04N21/234 ,  H04N21/25 ,  H04N21/4223 ,  H04N21/45 ,  G06N99/00

CPC classification number: H04N21/466 ,  G06F16/783 ,  G06K2009/00738 ,  G06N7/005 ,  G06N20/10 ,  G06N20/20 ,  H04N21/21805 ,  H04N21/2187 ,  H04N21/23418 ,  H04N21/251 ,  H04N21/4725 ,  H04N21/8126 ,  H04N21/84

Abstract: Providing enhanced video content includes processing at least one video feed through at least one spatiotemporal pattern recognition algorithm that uses machine learning to develop an understanding of a plurality of events and to determine at least one event type for each of the plurality of events. The event type includes an entry in a relationship library detailing a relationship between two visible features. Extracting and indexing a plurality of video cuts from the video feed is performed based on the at least one event type determined by the understanding that corresponds to an event in the plurality of events detectable in the video cuts. Lastly, automatically and under computer control, an enhanced video content data structure is generated using the extracted plurality of video cuts based on the indexing of the extracted plurality of video cuts.

Abstract translation: 提供增强的视频内容包括通过至少一个时空模式识别算法来处理至少一个视频馈送，该时间模式识别算法使用机器学习来开发对多个事件的理解并确定每个事件的至少一个事件类型 在多个事件中。 事件类型在关系库中包含一个条目，详细说明两个可见特征之间的关系。 从视频馈送中提取和索引多个视频剪辑是基于由对应于视频剪辑中可检测的多个事件中的事件的理解所确定的至少一个事件类型来执行的。 最后，自动且在计算机控制下，基于提取的多个视频剪辑的索引，使用所提取的多个视频剪辑来生成增强视频内容数据结构。

公开(公告)号：WO2019183235A8

公开(公告)日：2019-09-26

申请号：PCT/US2019/023192

申请日：2019-03-20

Applicant: SECOND SPECTRUM, INC.

Inventor： CHAN, Edward, Shek ,  CHANG, Yu-Han ,  MAHESWARAN, Rajiv, Tharmeswaran ,  SU, Jeffrey, Wayne ,  ROLLING, Benjamin, M. ,  HOLLINGSWORTH, Noel

IPC: G06T7/292 ,  G06T7/80 ,  H04N21/218 ,  H04N21/2187 ,  H04N21/236 ,  H04N21/235 ,  H04N5/232

Abstract: A media system generally includes a memory device that stores an event datastore that stores a plurality of event records, each event record corresponding to a respective event and event metadata describing at least one feature of the event. The media system (a) receives a request to generate an aggregated clip comprised of one or more media segments, where each media segment depicts a respective event; (b) for each event record from at least a subset of the plurality of event records, determines an interest level of the event corresponding to the event record; (c) determines one or more events to depict in the aggregated clip based on the respective interest levels of the one or more events; (d) generates the aggregated clip based on the respective media segments that depict the one or more events; and (e) transmits the aggregated clip to a user device.

公开(公告)号：WO2019183235A1

公开(公告)日：2019-09-26

申请号：PCT/US2019/023192

申请日：2019-03-20

Applicant: SECOND SPECTRUM, INC.

Inventor： CHAN, Edward, Shek ,  CHANG, Yu-Han ,  MAHESWARAN, Rajiv, Tharmeswaran ,  SU, Jeffrey, Wayne ,  ROLLING, Benjamin, M. ,  HOLLINGSWORTH, Noel

IPC: G06T7/292 ,  G06T7/80 ,  H04N21/218 ,  H04N21/2187 ,  H04N21/236 ,  H04N21/235 ,  H04N5/232

Abstract: A media system generally includes a memory device that stores an event datastore that stores a plurality of event records, each event record corresponding to a respective event and event metadata describing at least one feature of the event. The media system (a) receives a request to generate an aggregated clip comprised of one or more media segments, where each media segment depicts a respective event; (b) for each event record from at least a subset of the plurality of event records, determines an interest level of the event corresponding to the event record; (c) determines one or more events to depict in the aggregated clip based on the respective interest levels of the one or more events; (d) generates the aggregated clip based on the respective media segments that depict the one or more events; and (e) transmits the aggregated clip to a user device.