Interacting with hierarchical clusters of video segments using a video timeline

    公开(公告)号:US11630562B2

    公开(公告)日:2023-04-18

    申请号:US17017366

    申请日:2020-09-10

    申请人: ADOBE INC.

    摘要: Embodiments are directed to techniques for interacting with a hierarchical video segmentation using a video timeline. In some embodiments, the finest level of a hierarchical segmentation identifies the smallest interaction unit of a video—semantically defined video segments of unequal duration called clip atoms, and higher levels cluster the clip atoms into coarser sets of video segments. A presented video timeline is segmented based on one of the levels, and one or more segments are selected through interactions with the video timeline. For example, a click or tap on a video segment or a drag operation dragging along the timeline snaps selection boundaries to corresponding segment boundaries defined by the level. Navigating to a different level of the hierarchy transforms the selection into coarser or finer video segments defined by the level. Any operation can be performed on selected video segments, including playing back, trimming, or editing.

    Interacting with hierarchical clusters of video segments using a metadata panel

    公开(公告)号:US11995894B2

    公开(公告)日:2024-05-28

    申请号:US17017353

    申请日:2020-09-10

    申请人: ADOBE INC.

    IPC分类号: G06V20/40 G06T7/10

    摘要: Embodiments are directed to techniques for interacting with a hierarchical video segmentation using a metadata panel with a composite list of video metadata. The composite list is segmented into selectable metadata segments at locations corresponding to boundaries of video segments defined by a hierarchical segmentation. In some embodiments, the finest level of a hierarchical segmentation identifies the smallest interaction unit of a video—semantically defined video segments of unequal duration called clip atoms, and higher levels cluster the clip atoms into coarser sets of video segments. One or more metadata segments can be selected in various ways, such as by clicking or tapping on a metadata segment or by performing a metadata search. When a metadata segment is selected, a corresponding video segment is emphasized on the video timeline, a playback cursor is moved to the first video frame of the video segment, and the first video frame is presented.

    Digital Video Generation depicting Edit Operations to Digital Content

    公开(公告)号:US20230215466A1

    公开(公告)日:2023-07-06

    申请号:US17568396

    申请日:2022-01-04

    申请人: Adobe Inc.

    IPC分类号: G11B27/031 G11B27/34

    CPC分类号: G11B27/031 G11B27/34

    摘要: Digital video generation techniques are described that depict implementation of edit operations to digital content. In one example, a content processing system is configured to generate log data as part of monitoring edit operations that are executed to edit digital content. The log data includes operation data describing the edit operation, time data, and location data indicating a location within the digital content at which the edit operation is executed. Subsequently, a user input is received that selects a location within the digital content. A search module of the content processing system generates a search query based on the location and searches the log data to locate logs of edit operations that correspond to that location. The content processing system, for instance, generates a digital video that depicts a time lapse of execution of the edit operations as following a sequence indicated by the time data.

    Segmentation and hierarchical clustering of video

    公开(公告)号:US11450112B2

    公开(公告)日:2022-09-20

    申请号:US17017344

    申请日:2020-09-10

    申请人: ADOBE INC.

    摘要: Embodiments are directed to segmentation and hierarchical clustering of video. In an example implementation, a video is ingested to generate a multi-level hierarchical segmentation of the video. In some embodiments, the finest level identifies a smallest interaction unit of the video—semantically defined video segments of unequal duration called clip atoms. Clip atom boundaries are detected in various ways. For example, speech boundaries are detected from audio of the video, and scene boundaries are detected from video frames of the video. The detected boundaries are used to define the clip atoms, which are hierarchically clustered to form a multi-level hierarchical representation of the video. In some cases, the hierarchical segmentation identifies a static, pre-computed, hierarchical set of video segments, where each level of the hierarchical segmentation identifies a complete set (i.e., covering the entire range of the video) of disjoint (i.e., non-overlapping) video segments with a corresponding level of granularity.

    INTERACTING WITH HIERARCHICAL CLUSTERS OF VIDEO SEGMENTS USING A METADATA PANEL

    公开(公告)号:US20220076024A1

    公开(公告)日:2022-03-10

    申请号:US17017353

    申请日:2020-09-10

    申请人: ADOBE INC.

    IPC分类号: G06K9/00 G06T7/10

    摘要: Embodiments are directed to techniques for interacting with a hierarchical video segmentation using a metadata panel with a composite list of video metadata. The composite list is segmented into selectable metadata segments at locations corresponding to boundaries of video segments defined by a hierarchical segmentation. In some embodiments, the finest level of a hierarchical segmentation identifies the smallest interaction unit of a video—semantically defined video segments of unequal duration called clip atoms, and higher levels cluster the clip atoms into coarser sets of video segments. One or more metadata segments can be selected in various ways, such as by clicking or tapping on a metadata segment or by performing a metadata search. When a metadata segment is selected, a corresponding video segment is emphasized on the video timeline, a playback cursor is moved to the first video frame of the video segment, and the first video frame is presented.