Coordinating and mixing audiovisual content captured from geographically distributed performers

    公开(公告)号:US10587780B2

    公开(公告)日:2020-03-10

    申请号:US15864819

    申请日:2018-01-08

    Applicant: Smule, Inc.

    Abstract: Audiovisual performances, including vocal music, are captured and coordinated with those of other users in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for visually prominent presentation performance synchronized video of one or more of the contributors. Prominence of particular performance synchronized video may be based, at least in part, on computationally-defined audio features extracted from (or computed over) captured vocal audio. Over the course of a coordinated audiovisual performance timeline, these computationally-defined audio features are selective for performance synchronized video of one or more of the contributing vocalists.

    COORDINATING AND MIXING AUDIOVISUAL CONTENT CAPTURED FROM GEOGRAPHICALLY DISTRIBUTED PERFORMERS

    公开(公告)号:US20180262654A1

    公开(公告)日:2018-09-13

    申请号:US15864819

    申请日:2018-01-08

    Applicant: Smule, Inc.

    Abstract: Audiovisual performances, including vocal music, are captured and coordinated with those of other users in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for visually prominent presentation performance synchronized video of one or more of the contributors. Prominence of particular performance synchronized video may be based, at least in part, on computationally-defined audio features extracted from (or computed over) captured vocal audio. Over the course of a coordinated audiovisual performance timeline, these computationally-defined audio features are selective for performance synchronized video of one or more of the contributing vocalists.

    Audiovisual capture and sharing framework with coordinated user-selectable audio and video effects filters
    15.
    发明授权
    Audiovisual capture and sharing framework with coordinated user-selectable audio and video effects filters 有权
    视听采集和共享框架,具有协调的用户可选音频和视频效果滤镜

    公开(公告)号:US09459768B2

    公开(公告)日:2016-10-04

    申请号:US14104618

    申请日:2013-12-12

    Applicant: Smule, Inc.

    Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a computing pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.

    Abstract translation: 应用协调的音频和视频过滤器对来增强视听表演的艺术和情感内容。 当应用在便携式计算设备(例如移动电话或媒体播放器,计算板或平板电脑,游戏控制器或个人数字助理或书籍阅读器)上的视听应用的音频和视频处理流水线中时,这种滤波器对, 可以允许用户选择增强与其协调的音频和视频的效果。 通过使用可在处理器上执行的数字信号处理软件和使用设备的存储,扬声器和显示设备或与设备互操作的数字信号处理软件,使用摄像机和麦克风接口在便携式计算设备处捕获,过滤和呈现协调的音频和视频。 通过在亲密手持设备上提供视听拍摄和个性化,现代社交网络平台流行的类型的社交互动和发布现在可以扩展到视听内容。

Patent Agency Ranking