公开(公告)号：WO2016196987A1

公开(公告)日：2016-12-08

申请号：PCT/US2016/035810

申请日：2016-06-03

Applicant: SMULE, INC.

Inventor： SUNG, Kevin ,  KIM, Bona ,  MOLDOVER, Jon ,  SHIMMIN, John ,  YANG, Jeannie ,  COOK, Perry

IPC: H04N21/23 ,  H04N21/20 ,  H04N21/233 ,  H04N21/234 ,  H04N21/2343

CPC classification number: G10H1/368 ,  G10H1/366 ,  G10H2210/331 ,  G10H2220/005 ,  G10H2220/011 ,  G10H2220/355 ,  G10H2230/015 ,  G10H2240/175 ,  G10H2240/251 ,  G11B27/02

Abstract: Vocal audio of a user together with performance synchronized video is captured and coordinated with audiovisual contributions of other users to form composite duet-style or glee club-style or window-paned music video-style audiovisual performances. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for presentation, at any given time along a given performance timeline, performance synchronized video of one or more of the contributors. Selections are in accord with a visual progression that codes a sequence of visual layouts in correspondence with other coded aspects of a performance score such as pitch tracks, backing audio, lyrics, sections and/or vocal parts.

Abstract translation: 用户的声音与表演同步视频一起被捕获并与其他用户的视听贡献协调，以形成复合二重风格或欢乐的俱乐部风格或窗口播放的音乐视频风格的视听表演。 在某些情况下，在与声音效果对应的歌词卡拉OK式演示的背景下，在移动设备，电视机型显示器和/或机顶盒设备上捕获个人用户的声乐表演（以及性能同步视频） 的背景轨道。 多个歌手的贡献是协调和混合的，以选择演示，在给定的演奏时间表的任何给定的时间，一个或多个贡献者的演出同步视频。 选择符合视觉进程，其编码与表演评分的其他编码方面对应的视觉布局序列，例如音高轨迹，背景音频，歌词，部分和/或声部。

公开(公告)号：WO2021041393A1

公开(公告)日：2021-03-04

申请号：PCT/US2020/047768

申请日：2020-08-25

Applicant: SMULE, INC.

Inventor： MOLDOVER, Jon ,  STEINWEDEL, David ,  SMITH, Jeffrey C. ,  COOK, Perry R.

IPC: G10H1/36 ,  H04N21/4402 ,  H04N21/439 ,  H04N7/14

Abstract: User interface techniques provide user vocalists with mechanisms for solo audiovisual capture and for seeding subsequent performances by other users (e.g., joiners). Audiovisual capture may be against a full-length work or seed spanning much or all of a pre-existing audio (or audiovisual) work and in some cases may mix, to seed further contributions of one or more joiners, a users captured media content for at least some portions of the audio (or audiovisual) work. A short seed or short segment may span less than all (and in some cases, much less than all) of the audio (or audiovisual) work. For example, a verse, chorus, refrain, hook or other limited chunk of an audio (or audiovisual) work may constitute a short seed or short segment. Computational techniques are described that allow a system to automatically identify suitable short seeds or short segments. After audiovisual capture against the short seed or short segment, a resulting, solo or group, full-length or short-form performance may be posted, livestreamed, or otherwise disseminated in a social network

公开(公告)号：WO2019040492A1

公开(公告)日：2019-02-28

申请号：PCT/US2018/047325

申请日：2018-08-21

Applicant: SMULE, INC.

Inventor： STEINWEDEL, David ,  COOK, Perry R. ,  CHI, Paul T. ,  ZHOU, Wei ,  MOLDOVER, Jon ,  HOLMBERG, Anton ,  LI, Jingxi

IPC: H04N21/439 ,  H04N21/43 ,  H04N21/4402 ,  H04N5/272 ,  G06N99/00

Abstract: Visual effects schedules are applied to audiovisual performances with differing visual effects applied in correspondence with differing elements of musical structure. Segmentation techniques applied to one or more audio tracks (e.g., vocal or backing tracks) are used to compute some of the components of the musical structure. In some cases, applied visual effects schedules are mood-denominated and may be selected by a performer as a component of his or her visual expression or determined from an audiovisual performance using machine learning techniques.