Synchronizing audio and video components of an automatically generated audio/video presentation

    公开(公告)号:US10062415B2

    公开(公告)日:2018-08-28

    申请号:US15283054

    申请日:2016-09-30

    Applicant: Apple Inc.

    Abstract: Some embodiments provide an application that can automatically generate a movie from a collection of media clips stored on a device or accessible by the device. The movie creation process of some embodiments uses novel video and audio compositors that dynamically composite video and audio components of the movie. The video compositors process explores different combination of media clips and media-clip arrangements to produce an interesting video presentation. The audio compositor receives the duration of the video presentation, and dynamically generates a song for the video presentation based on this duration. Another novel interaction is that in some embodiments the audio compositor provides the starting location of its last segment to the video compositor so that the video compositor can align the start of the last video segment with this ending segment. In some embodiments, the video and audio compositors also synchronize fade-out effects that they apply to their respective presentations with each other. Also, in some embodiments, the video compositor can ask the audio compositor for one or more audio onsets that are near a particular time in the presentation. In some of these embodiments, the audio compositor returns (1) a list of onsets that are near a time that is specified by the video compositor, and (2) a priority for each of these onsets. The video compositor then uses this list of onsets to align an edit point in the composite video's definition to the location of one of the onsets based the specified priority value(s) and the desirability of the video edit at the onset location.

    User Interface for Adjusting an Automatically Generated Audio/Video Presentation

    公开(公告)号:US20170091973A1

    公开(公告)日:2017-03-30

    申请号:US15283161

    申请日:2016-09-30

    Applicant: Apple Inc.

    Abstract: Some embodiments provide a method for creating a composite presentation. In some embodiments, this method is performed by an application that executes on a computing device that stores media content pieces (e.g., videos, still images, etc.), and/or that has access through a network to media content pieces (MCPs) stored on other computing devices. The method of some embodiments (1) performs a first automated process that analyzes the MCPs (e.g., analyzes the content and/or metadata of the MCPs) to define one or more MCP groups, (2) based on one or more compositing parameters, performs a second automated process to generate composite presentation definitions from the defined MCP groups, and (3) produces a user interface (UI) layout that identifies the defined composite presentations and provides tools for adjusting the compositing parameters to adjust the defined composite presentations.

    Grouping Media Content for Automatically Generating a Media Presentation

    公开(公告)号:US20170091154A1

    公开(公告)日:2017-03-30

    申请号:US15283098

    申请日:2016-09-30

    Applicant: Apple Inc.

    Abstract: Some embodiments provide a media compositing method that performs automated processes (1) to analyze the media content pieces (MCPs) to define one or more MCP groups, and (2) produces a user interface (UI) layout that identifies the defined MCP groups as groups for which the method can display composite presentations (e.g., video presentations). To define the MCP groups, the method of some embodiments uses one or more media grouping templates (MGTs). In some embodiments, the method can define multiple MGT instances for an MGT. For instance, in some embodiments, the MGTs include (1) location-bounded MGTs (e.g., videos and/or photos captured within a region with a particular radius), (2) time-bounded MGTs (e.g., videos and/or photos captured within a particular time range and/or date range), (3) time-bounded and location-bounded MGTs (e.g., mornings at a beach), (4) content-defined MGTs (e.g., videos and/or photos containing smiles), and (5) user-metadata based MGTs (e.g., MCPs from albums created by the user, MCPs shared by a user with others, MCPs having particular user-defined metadata tags, etc.).

    Audio Authoring and Compositing
    15.
    发明申请

    公开(公告)号:US20190180785A1

    公开(公告)日:2019-06-13

    申请号:US16280120

    申请日:2019-02-20

    Applicant: Apple Inc.

    Abstract: Some embodiments provide an audio authoring method that provide a set authoring tools for specifying rules for combining sections of a first song to generate a second song. The set of authoring tools allow an array of cells to be arranged in first and second directions, and allow each body section to be associated with one set of cells that are arranged in the first direction and another set of cells that are arranged in the second direction. At each cell that belongs to one set of cells arranged in the first direction for a first body section and another set of cells arranged in the second direction for a second body section, the set of tools also allow the user to specify whether the second body section is allowed to follow the first body section. Some embodiments provide a method for compositing audio, The method receives (1) several song sections, and (2) for each particular song section, a priority value and a set of succession rules that identify a set of song sections that cannot follow the particular song section. Based on the priority values, the method adds the song sections to the first song until a desired first-song duration is reached without exceeding the duration or until all song sections have been examined for adding to the first song. The method then analyzes a sequence of song sections in the first song to remove any song section that violates a succession rule.

    Automatic Video Compositing
    16.
    发明申请

    公开(公告)号:US20170092324A1

    公开(公告)日:2017-03-30

    申请号:US15283147

    申请日:2016-09-30

    Applicant: Apple Inc.

    CPC classification number: G11B27/031 G11B27/34

    Abstract: Some embodiments provide a method for creating a composite presentation. The method performs a first automated process to select a subset of media content pieces from a set of available media content pieces (MCPs), based on analysis of metadata associated with the MCPs. The method performs a second automated process to generate a definition of the composite presentation from the selected subset of MCPs. The second automated process defines edits that select desired portions of the selected subset of MCPs for inclusion in the composite presentation. The method then renders the composite presentation based on the generated definition.

    OPTIMIZED VOLUME ADJUSTMENT
    17.
    发明申请
    OPTIMIZED VOLUME ADJUSTMENT 审中-公开
    优化体积调整

    公开(公告)号:US20160352296A1

    公开(公告)日:2016-12-01

    申请号:US15231603

    申请日:2016-08-08

    Applicant: Apple Inc.

    CPC classification number: H03G3/02 G06F3/01 G06F3/04847 H04R29/008 H04R2430/01

    Abstract: A method for adjusting the sound volume of media clips using volume adjuster lines is provided. The volume adjuster lines are individually set for each clip based on the intrinsic, or absolute, volume values of the clip. In some embodiments, the volume adjuster lines are set for each clip based on the peak value or a calculated loudness equivalent of the clip. A user can move the volume adjuster line to set the absolute sound level of a clip. The volume adjuster lines can be hidden in some embodiments. In these embodiments, dragging on any portion of a clip is treated as dragging on the volume adjuster line. Some embodiments provide a deformable volume adjuster line, or curve. In these embodiments, a single audio clip can have several different volume adjuster lines for different sections of the clip where the volume adjuster line for each section is individually adjustable.

    Abstract translation: 提供了一种使用音量调节器线调节媒体剪辑的音量的方法。 基于剪辑的固有或绝对体积值,为每个剪辑单独设置音量调节器线。 在一些实施例中,基于剪辑的峰值或所计算的响度等效值,为每个剪辑设置音量调节器线。 用户可以移动音量调节线以设置剪辑的绝对声级。 在一些实施例中,音量调节器线可以被隐藏。 在这些实施例中,在夹子的任何部分上的拖动被视为在音量调节器线上拖动。 一些实施例提供可变形体积调节器线或曲线。 在这些实施例中,单个音频剪辑可以具有用于剪辑的不同部分的几个不同的音量调节器线,其中每个部分的音量调节器线可单独调节。

Patent Agency Ranking