公开(公告)号：US20240134909A1

公开(公告)日：2024-04-25

申请号：US17967703

申请日：2022-10-17

Applicant: Adobe Inc.

Inventor： Lubomira Assenova DONTCHEVA ,  Dingzeyu LI ,  Kim Pascal PIMMEL ,  Hijung SHIN ,  Hanieh DEILAMSALEHY ,  Aseem Omprakash AGARWALA ,  Joy Oakyung KIM ,  Joel Richard BRANDT ,  Cristin Ailidh Fraser

IPC: G06F16/732

CPC classification number: G06F16/732

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for a visual and text search interface used to navigate a video transcript. In an example embodiment, a freeform text query triggers a visual search for frames of a loaded video that match the freeform text query (e.g., frame embeddings that match a corresponding embedding of the freeform query), and triggers a text search for matching words from a corresponding transcript or from tags of detected features from the loaded video. Visual search results are displayed (e.g., in a row of tiles that can be scrolled to the left and right), and textual search results are displayed (e.g., in a row of tiles that can be scrolled up and down). Selecting (e.g., clicking or tapping on) a search result tile navigates a transcript interface to a corresponding portion of the transcript.

公开(公告)号：US20240134597A1

公开(公告)日：2024-04-25

申请号：US17967714

申请日：2022-10-17

Applicant: Adobe Inc.

Inventor： Lubomira Assenova DONTCHEVA ,  Anh Lan TRUONG ,  Hanieh DEILAMSALEHY ,  Kim Pascal PIMMEL ,  Aseem Omprakash AGARWALA ,  Dingzeyu Li ,  Joel Richard BRANDT ,  Joy Oakyung KIM

IPC: G06F3/16 ,  G06F3/0482 ,  G06F3/0484 ,  G06F16/735 ,  G06F16/738

CPC classification number: G06F3/167 ,  G06F3/0482 ,  G06F3/0484 ,  G06F16/735 ,  G06F16/738

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for a question search for meaningful questions that appear in a video. In an example embodiment, an audio track from a video is transcribed, and the transcript is parsed to identify sentences that end with a question mark. Depending on the embodiment, one or more types of questions are filtered out, such as short questions less than a designated length or duration, logistical questions, and/or rhetorical questions. As such, in response to a command to perform a question search, the questions are identified, and search result tiles representing video segments of the questions are presented. Selecting (e.g., clicking or tapping on) a search result tile navigates a transcript interface to a corresponding portion of the transcript.

公开(公告)号：US20240127858A1

公开(公告)日：2024-04-18

申请号：US17967608

申请日：2022-10-17

Applicant: Adobe Inc.

Inventor： Lubomira Assenova DONTCHEVA ,  Hijung SHIN ,  Joel Richard BRANDT ,  Joy Oakyung KIM

IPC: G11B27/031 ,  G10L15/24 ,  G10L15/26

CPC classification number: G11B27/031 ,  G10L15/24 ,  G10L15/26

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for annotating transcript text with video metadata, and including thumbnail bars in the transcript to help users select a desired portion of a video through transcript interactions. In an example embodiment, a video editing interface includes a transcript interface that presents a transcript with transcript text that is annotated to indicate corresponding portions of the video where various features were detected (e.g., annotating via text stylization of transcript text and/or labeling the transcript text with a textual representation of a corresponding detected feature class). In some embodiments, the transcript interface displays a visual representation of detected non-speech audio or pauses (e.g., a sound bar) and/or video thumbnails corresponding to each line of transcript text (e.g., a thumbnail bar). Transcript text, soundbars, and/or thumbnail bars are selectable to identify and perform video editing operations on a corresponding video segment.

公开(公告)号：US20210142827A1

公开(公告)日：2021-05-13

申请号：US16679013

申请日：2019-11-08

Applicant: ADOBE INC.

Inventor： William Hayes ALLEN ,  Lubomira DONTCHEVA ,  Haiqing LU ,  Zachary Platt MCCULLOUGH ,  David R. STEIN ,  Christopher NUUJA ,  Benoit AMBRY ,  Joel Richard Brandt ,  Cristin Ailidh FRASER ,  Joy Oakyung KIM ,  Hijung SHIN

IPC: G11B27/034 ,  G11B27/036 ,  G06F3/0484

Abstract: Systems and methods provide for capturing and presenting content creation tools of an application used in a video. Application data from the application for the duration of the video is received. The application data includes data identifiers and time markers corresponding to user interaction with an application in a video. The application data is processed to detect tool identifiers identifying tools used in the video based on the data identifiers. For each a tool identifier, a tool label and a corresponding time in the timeline is determined. A tool record storing the tool labels and the corresponding times in association with the video is generated. When a viewer requests to watch the video, the tool record is presented to the viewer in conjunction with the video.