COORDINATING AND MIXING AUDIOVISUAL CONTENT CAPTURED FROM GEOGRAPHICALLY DISTRIBUTED PERFORMERS

    公开(公告)号:US20210037166A1

    公开(公告)日:2021-02-04

    申请号:US16814132

    申请日:2020-03-10

    Applicant: SMULE, INC.

    Abstract: Audiovisual performances, including vocal music, are captured and coordinated with those of other users in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for visually prominent presentation performance synchronized video of one or more of the contributors. Prominence of particular performance synchronized video may be based, at least in part, on computationally-defined audio features extracted from (or computed over) captured vocal audio. Over the course of a coordinated audiovisual performance timeline, these computationally-defined audio features are selective for performance synchronized video of one or more of the contributing vocalists.

    Coordinated Audiovisual Montage from Selected Crowd-Sourced Content with Alignment to Audio Baseline
    2.
    发明申请
    Coordinated Audiovisual Montage from Selected Crowd-Sourced Content with Alignment to Audio Baseline 审中-公开
    协调视听蒙太奇从选定的人群内容与对准音频基线

    公开(公告)号:US20150279427A1

    公开(公告)日:2015-10-01

    申请号:US14739910

    申请日:2015-06-15

    Applicant: Smule, Inc.

    Abstract: A generally diverse set of audiovisual clips is sourced from one or more repositories for use in preparing a coordinated audiovisual work. In some cases, audiovisual clips are retrieved using tags such as user-assigned hashtags or metadata. Pre-existing associations of such tags can be used as hints that certain audiovisual clips are likely to share correspondence with an audio signal encoding of a particular song or other audio baseline. Clips are evaluated for computationally determined correspondence with an audio baseline track. In general, comparisons of audio power spectra, of rhythmic features, tempo, pitch sequences and other extracted audio features may be used to establish correspondence. For clips exhibiting a desired level of correspondence, computationally determined temporal alignments of individual clips with the baseline audio track are used to prepare a coordinated audiovisual work that mixes the selected audiovisual clips with the audio track.

    Abstract translation: 一组多样化的视听片段来自一个或多个存储库,用于准备协调的视听作品。 在某些情况下,使用诸如用户分配的标签或元数据的标签来检索视听剪辑。 这些标签的预先存在的关联可以用作某些视听剪辑可能与特定歌曲或其他音频基线的音频信号编码共享对应关系的提示。 评估剪辑与计算确定的与音频基准轨迹的对应关系。 通常,可以使用音频功率谱,节奏特征,速度,音调序列和其他提取的音频特征的比较来建立对应关系。 对于呈现期望的对应级别的剪辑,使用单独剪辑与基线音轨的计算确定的时间对准来准备将所选择的视听剪辑与音轨混合的协调的视听作品。

    COORDINATING AND MIXING AUDIOVISUAL CONTENT CAPTURED FROM GEOGRAPHICALLY DISTRIBUTED PERFORMERS

    公开(公告)号:US20230112247A1

    公开(公告)日:2023-04-13

    申请号:US17813235

    申请日:2022-07-18

    Applicant: SMULE, INC.

    Abstract: Audiovisual performances, including vocal music, are captured and coordinated with those of other users in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for visually prominent presentation performance synchronized video of one or more of the contributors. Prominence of particular performance synchronized video may be based, at least in part, on computationally-defined audio features extracted from (or computed over) captured vocal audio. Over the course of a coordinated audiovisual performance timeline, these computationally-defined audio features are selective for performance synchronized video of one or more of the contributing vocalists.

    COORDINATING AND MIXING AUDIOVISUAL CONTENT CAPTURED FROM GEOGRAPHICALLY DISTRIBUTED PERFORMERS
    4.
    发明申请
    COORDINATING AND MIXING AUDIOVISUAL CONTENT CAPTURED FROM GEOGRAPHICALLY DISTRIBUTED PERFORMERS 有权
    协调和混合从地理分布执行者获取的音像内容

    公开(公告)号:US20160057316A1

    公开(公告)日:2016-02-25

    申请号:US14928727

    申请日:2015-10-30

    Applicant: Smule, Inc.

    Abstract: Audiovisual performances, including vocal music, are captured and coordinated with those of other users in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for visually prominent presentation performance synchronized video of one or more of the contributors. Prominence of particular performance synchronized video may be based, at least in part, on computationally-defined audio features extracted from (or computed over) captured vocal audio. Over the course of a coordinated audiovisual performance timeline, these computationally-defined audio features are selective for performance synchronized video of one or more of the contributing vocalists.

    Abstract translation: 包括声乐在内的视听表演,以其他用户的方式被捕获和协调,以创造令人信服的用户体验。 在某些情况下,在与声音效果对应的歌词卡拉OK式演示的背景下,在移动设备,电视机型显示器和/或机顶盒设备上捕获个人用户的声乐表演(以及性能同步视频) 的背景轨道。 多个歌手的贡献以协调和混合的方式,为视觉上突出的演示效果选择一个或多个贡献者的同步视频。 特定性能同步视频的突出可以至少部分地基于从(或计算的)捕获的声音提取的计算定义的音频特征。 在协调的视听表演时间表的过程中,这些计算定义的音频特征对于一个或多个贡献歌手的性能同步视频是有选择性的。

    Coordinated audiovisual montage from selected crowd-sourced content with alignment to audio baseline

    公开(公告)号:US10971191B2

    公开(公告)日:2021-04-06

    申请号:US14739910

    申请日:2015-06-15

    Applicant: Smule, Inc.

    Abstract: A generally diverse set of audiovisual clips is sourced from one or more repositories for use in preparing a coordinated audiovisual work. In some cases, audiovisual clips are retrieved using tags such as user-assigned hashtags or metadata. Pre-existing associations of such tags can be used as hints that certain audiovisual clips are likely to share correspondence with an audio signal encoding of a particular song or other audio baseline. Clips are evaluated for computationally determined correspondence with an audio baseline track. In general, comparisons of audio power spectra, of rhythmic features, tempo, pitch sequences and other extracted audio features may be used to establish correspondence. For clips exhibiting a desired level of correspondence, computationally determined temporal alignments of individual clips with the baseline audio track are used to prepare a coordinated audiovisual work that mixes the selected audiovisual clips with the audio track.

    Coordinating and mixing audiovisual content captured from geographically distributed performers

    公开(公告)号:US09866731B2

    公开(公告)日:2018-01-09

    申请号:US14928727

    申请日:2015-10-30

    Applicant: Smule, Inc.

    Abstract: Audiovisual performances, including vocal music, are captured and coordinated with those of other users in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for visually prominent presentation performance synchronized video of one or more of the contributors. Prominence of particular performance synchronized video may be based, at least in part, on computationally-defined audio features extracted from (or computed over) captured vocal audio. Over the course of a coordinated audiovisual performance timeline, these computationally-defined audio features are selective for performance synchronized video of one or more of the contributing vocalists.

    AUDIOVISUAL CAPTURE AND SHARING FRAMEWORK WITH COORDINATED USER-SELECTABLE AUDIO AND VIDEO EFFECTS FILTERS
    9.
    发明申请
    AUDIOVISUAL CAPTURE AND SHARING FRAMEWORK WITH COORDINATED USER-SELECTABLE AUDIO AND VIDEO EFFECTS FILTERS 有权
    协调用户可选择音频和视频效果滤波器的音频捕获和共享框架

    公开(公告)号:US20140229831A1

    公开(公告)日:2014-08-14

    申请号:US14104618

    申请日:2013-12-12

    Applicant: Smule, Inc.

    Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a compute pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.

    Abstract translation: 应用协调的音频和视频过滤器对来增强视听表演的艺术和情感内容。 当应用于托管在便携式计算设备(例如移动电话或媒体播放器,计算板或平板电脑,游戏控制器或个人数字助理或书籍阅读器)上的视听应用的音频和视频处理流水线中时,这种滤波器对, 可以允许用户选择增强与其协调的音频和视频的效果。 通过使用可在处理器上执行的数字信号处理软件和使用设备的存储,扬声器和显示设备或与设备互操作的数字信号处理软件,使用摄像机和麦克风接口在便携式计算设备处捕获,过滤和呈现协调的音频和视频。 通过在亲密手持设备上提供视听拍摄和个性化,现代社交网络平台流行的类型的社交互动和发布现在可以扩展到视听内容。

Patent Agency Ranking