System and method for capture and rendering of performance on synthetic string instrument

    公开(公告)号:US10163428B2

    公开(公告)日:2018-12-25

    申请号:US15583632

    申请日:2017-05-01

    Applicant: SMULE, INC.

    Abstract: Synthetic multi-string musical instruments have been developed for capturing and rendering musical performances on handheld or other portable devices in which a multi-touch sensitive display provides one of the input vectors for an expressive performance by a user or musician. Visual cues may be provided on the multi-touch sensitive display to guide the user in a performance based on a musical score. Alternatively, or in addition, uncued freestyle modes of operation may be provided. In either case, it is not the musical score that drives digital synthesis and audible rendering of the synthetic multi-string musical instrument. Rather, it is the stream of user gestures captured at least in part using the multi-touch sensitive display that drives the digital synthesis and audible rendering.

    AUDIOVISUAL COLLABORATION METHOD WITH LATENCY MANAGEMENT FOR WIDE-AREA BROADCAST

    公开(公告)号:US20180288467A1

    公开(公告)日:2018-10-04

    申请号:US15944537

    申请日:2018-04-03

    Applicant: SMULE, INC.

    Abstract: Techniques have been developed to facilitate the livestreaming of group audiovisual performances. Audiovisual performances including vocal music are captured and coordinated with performances of other users in ways that can create compelling user and listener experiences. For example, in some cases or embodiments, duets with a host performer may be supported in a sing-with-the-artist style audiovisual livestream in which aspiring vocalists request or queue particular songs for a live radio show entertainment format. The developed techniques provide a communications latency-tolerant mechanism for synchronizing vocal performances captured at geographically-separated devices (e.g., at globally-distributed, but network-connected mobile phones or tablets or at audiovisual capture devices geographically separated from a live studio).

    AUTOMATED GENERATION OF COORDINATED AUDIOVISUAL WORK BASED ON CONTENT CAPTURED GEOGRAPHICALLY DISTRIBUTED PERFORMERS
    27.
    发明申请
    AUTOMATED GENERATION OF COORDINATED AUDIOVISUAL WORK BASED ON CONTENT CAPTURED GEOGRAPHICALLY DISTRIBUTED PERFORMERS 有权
    基于内容捕获的地理分布执行器自动生成协调的视听作品

    公开(公告)号:US20160358595A1

    公开(公告)日:2016-12-08

    申请号:US15173041

    申请日:2016-06-03

    Applicant: SMULE, INC.

    Abstract: Vocal audio of a user together with performance synchronized video is captured and coordinated with audiovisual contributions of other users to form composite duet-style or glee club-style or window-paned music video-style audiovisual performances. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for presentation, at any given time along a given performance timeline, performance synchronized video of one or more of the contributors. Selections are in accord with a visual progression that codes a sequence of visual layouts in correspondence with other coded aspects of a performance score such as pitch tracks, backing audio, lyrics, sections and/or vocal parts.

    Abstract translation: 用户的声音与表演同步视频一起被捕获并与其他用户的视听贡献协调,以形成复合二重风格或欢乐的俱乐部风格或窗口播放的音乐视频风格的视听表演。 在某些情况下,在与声音效果对应的歌词卡拉OK式演示的背景下,在移动设备,电视机型显示器和/或机顶盒设备上捕获个人用户的声乐表演(以及性能同步视频) 的背景轨道。 协调和混合多个歌手的贡献,以选择演示,在给定的演奏时间表的任何给定时间,一个或多个贡献者的演出同步视频。 选择符合视觉进程,其编码与表演评分的其他编码方面对应的视觉布局序列,例如音高轨迹,背景音频,歌词,部分和/或声部。

    SOCIAL MUSIC SYSTEM AND METHOD WITH CONTINUOUS, REAL-TIME PITCH CORRECTION OF VOCAL PERFORMANCE AND DRY VOCAL CAPTURE FOR SUBSEQUENT RE-RENDERING BASED ON SELECTIVELY APPLICABLE VOCAL EFFECT(S) SCHEDULE(S)
    28.
    发明申请
    SOCIAL MUSIC SYSTEM AND METHOD WITH CONTINUOUS, REAL-TIME PITCH CORRECTION OF VOCAL PERFORMANCE AND DRY VOCAL CAPTURE FOR SUBSEQUENT RE-RENDERING BASED ON SELECTIVELY APPLICABLE VOCAL EFFECT(S) SCHEDULE(S) 有权
    社会音乐系统和方法,连续地实时调整基于适用视频效果(S)的视频再现渲染的视频性能和干晰视频采集(S)

    公开(公告)号:US20140039883A1

    公开(公告)日:2014-02-06

    申请号:US13960564

    申请日:2013-08-06

    Applicant: Smule, Inc.

    Abstract: Vocal musical performances may be captured and, in some cases or embodiments, pitch-corrected and/or processed in accord with a user selectable vocal effects schedule for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. Vocal effects schedules may also be selectively applied to such performances. In these ways, even amateur user/performers with imperfect pitch are encouraged to take a shot at “stardom” and/or take part in a game play, social network or vocal achievement application architecture that facilitates musical collaboration on a global scale and/or, in some cases or embodiments, to initiate revenue generating in-application transactions.

    Abstract translation: 可以捕获声乐表演,并且在一些情况或实施例中,根据用户可选择的声音效果调度进行音调校正和/或处理,以便以创建令人信服的用户体验的方式与后退轨道进行混合和呈现。 在某些情况下,个人用户的声乐表演在卡拉OK式表现的歌词的背景下被捕获在移动设备上,与对应于背景音轨的可听效果相对应。 可以根据音调校正设置在移动设备上实时地对这些演奏进行音调校正。 声音效果计划也可以选择性地应用于这种表演。 通过这些方式,甚至鼓励具有不完美音调的业余用户/表演者在“stardom”和/或参与游戏,社交网络或声乐成就应用程序架构中,促进全球范围内的音乐协作和/或 在某些情况或实施例中,用于启动生成应用程序内交易的收入。

Patent Agency Ranking