METHOD AND APPARATUS FOR ALIGNING PARAGRAPH AND VIDEO

    公开(公告)号:US20200322570A1

    公开(公告)日:2020-10-08

    申请号:US16703075

    申请日:2019-12-04

    IPC分类号: H04N7/025 G06F16/45

    摘要: Embodiments of the present disclosure provide a method and apparatus for aligning a paragraph and a video. The method may include: acquiring a commentary and a candidate material resource set corresponding to the commentary, a candidate material resource being a video or an image; acquiring a matching degree between each paragraph in the commentary and each candidate material resource in the candidate material resource set; and determining a candidate material resource sequence corresponding to the each paragraph in the commentary based on the matching degrees between the paragraphs in the commentary and the candidate material resources, playing durations of the candidate material resources and text lengths of the paragraphs in the commentary, an image playing duration being a preset image playing duration.

    METHOD AND APPARATUS FOR GENERATING VIDEO
    2.
    发明申请

    公开(公告)号:US20200320307A1

    公开(公告)日:2020-10-08

    申请号:US16703716

    申请日:2019-12-04

    IPC分类号: G06K9/00 G10L13/04 G10L13/08

    摘要: Embodiments of the present disclosure provide a method and apparatus for generating a video. The method may include: determining a commentary of a target news cluster, each piece of news in the target news cluster being specific to a given news event; generating a voice corresponding to each paragraph in the commentary using a speech synthesis technology; determining a candidate material resource set corresponding to the commentary based on a video and an image included in the target news cluster, the candidate material resource being a video or image; determining a candidate material resource sequence corresponding to the each paragraph in the commentary; and generating a video corresponding to the commentary based on the voice corresponding to the each paragraph in the commentary and the candidate material resource sequence.

    AUTOMATICALLY AND PRECISELY GENERATING HIGHLIGHT VIDEOS WITH ARTIFICIAL INTELLIGENCE

    公开(公告)号:US20220188550A1

    公开(公告)日:2022-06-16

    申请号:US17393373

    申请日:2021-08-03

    申请人: Baidu USA, LLC

    摘要: Presented herein are systems, methods, and datasets for automatically and precisely generating highlight or summary videos of content. For example, in one or more embodiments, videos of sporting events may be digested or condensed into highlights, which will dramatically benefit sports media, broadcasters, video creators or commentators, or other short video creators, in terms of cost reduction, fast, and mass production, and saving tedious engineering hours. Embodiment of the framework may also be used or adapted for use to better promote sports teams, players, and/or games, and produce stories to glorify the spirit of sports or its players. While presented in the context of sports, it shall be noted that the methodology may be used for videos comprising other content and events.

    METHOD AND APPARATUS FOR GENERATING COMMENTARY

    公开(公告)号:US20200320253A1

    公开(公告)日:2020-10-08

    申请号:US16703718

    申请日:2019-12-04

    IPC分类号: G06F40/30 G06K9/00 G10L13/04

    摘要: Embodiments of the present disclosure provide a method and apparatus for generating a commentary. The method may include: acquiring at least one news cluster composed of pieces of news generated within a first preset time length, the pieces of news in the news cluster direct to a given news event; determining a target news cluster based on the at least one news cluster; determining, for each piece of news in the target news cluster, a score of being suitable for generating a commentary for the piece of news; and generating, based on a piece of target news, a commentary for the target news cluster, where the piece of target news is a piece of news having a highest score of being suitable for generating a commentary in the target news cluster.

    TRANSFORMER-BASED TEMPORAL DETECTION IN VIDEO

    公开(公告)号:US20230055636A1

    公开(公告)日:2023-02-23

    申请号:US17572624

    申请日:2022-01-10

    申请人: Baidu USA, LLC

    IPC分类号: G06V20/40 G06N3/08 G06V10/42

    摘要: With rapidly evolving technologies and emerging tools, sports-related videos generated online are rapidly increasing. To automate the sports video editing/highlight generation process, a key task is to precisely recognize and locate events-of-interest in videos. Embodiments herein comprise a two-stage paradigm to detect categories of events and when these events happen in videos. In one or more embodiments, multiple action recognition models extract high-level semantic features, and a transformer-based temporal detection module locates target events. These novel approaches achieved state-of-the-art performance in both action spotting and replay grounding. While presented in the context of sports, it shall be noted that the systems and methods herein may be used for videos comprising other content and events.

    METHOD AND APPARATUS FOR GENERATING INFORMATION

    公开(公告)号:US20200320306A1

    公开(公告)日:2020-10-08

    申请号:US16702886

    申请日:2019-12-04

    IPC分类号: G06K9/00 G10L13/04

    摘要: Embodiments of the present disclosure provide a method and apparatus for generating information. The method may include: determining at least one video segment obtained by semantically segmenting videos included in a target news cluster as a target video set, where respective pieces of news in the target news cluster directs to a given news event; determining a commentary for the target news cluster; determining, based on the target video set and a target image set, a candidate material resource set corresponding to the commentary, where the target image set is composed of respective images included in the target news cluster; and for each paragraph in the commentary, determining degrees of matching between the paragraph and candidate material resources in the candidate material resource set.

    METHOD FOR ALIGNING TEXT WITH MEDIA MATERIAL, APPARATUS AND STORAGE MEDIUM

    公开(公告)号:US20220083741A1

    公开(公告)日:2022-03-17

    申请号:US17538932

    申请日:2021-11-30

    摘要: A method for aligning a text with a media material, an apparatus, and a storage medium are provided. The method includes: determining a set of anchor points in the text; performing following operations i) to v) repeatedly until all anchor points are removed from the set of anchor points or all media materials are removed from a set of media materials: i) ranking the anchor points in the set of anchor points, ii) selecting a target anchor point from the set of anchor points based on the ranked anchor points in the set, iii) determining, from the set of media materials, a media material matching a text segment starting from the target anchor point, iv) removing the target anchor point, and v) removing the media material matching the text segment starting from the target anchor point; and aligning the text segments with respective media matching materials.