公开(公告)号：US20200294550A1

公开(公告)日：2020-09-17

申请号：US16834775

申请日：2020-03-30

Applicant: SMULE, INC.

Inventor： Parag P. Chordia ,  Perry R. Cook ,  Mark T. Godfrey ,  Prerna Gupta ,  Nicholas M. Kruge ,  Randal J. Leistikow ,  Alexander M.D. Rae ,  Ian S. Simon

IPC: G11B27/031 ,  G06F3/0482 ,  G06F3/0484 ,  G10L21/055 ,  G10L21/003 ,  G10H1/00 ,  G10H1/38

Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a computing pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.

公开(公告)号：US20170301329A1

公开(公告)日：2017-10-19

申请号：US15463878

申请日：2017-03-20

Applicant: SMULE, INC.

Inventor： Jeannie Yang ,  Nicholas M. Kruge ,  Gregory C. Thompson ,  Perry R. Cook

IPC: G10H1/36

CPC classification number: G10H1/366 ,  G10H2210/066 ,  G10H2210/331 ,  G10H2220/096 ,  G10H2240/251 ,  G10L21/013

Abstract: Vocal musical performances may be captured and, in some cases or embodiments, pitch-corrected and/or processed in accord with a user selectable vocal effects schedule for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. Vocal effects schedules may also be selectively applied to such performances. In these ways, even amateur user/performers with imperfect pitch are encouraged to take a shot at “stardom” and/or take part in a game play, social network or vocal achievement application architecture that facilitates musical collaboration on a global scale and/or, in some cases or embodiments, to initiate revenue generating in-application transactions.

公开(公告)号：US20210248985A1

公开(公告)日：2021-08-12

申请号：US17249113

申请日：2021-02-19

Applicant: SMULE, INC.

Inventor： Jeannie Yang ,  Nicholas M. Kruge ,  Gregory C. Thompson ,  Perry R. Cook

IPC: G10H1/36 ,  G10L21/013

Abstract: Vocal musical performances may be captured and, in some cases or embodiments, pitch-corrected and/or processed in accord with a user selectable vocal effects schedule for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. Vocal effects schedules may also be selectively applied to such performances. In these ways, even amateur user/performers with imperfect pitch are encouraged to take a shot at “stardom” and/or take part in a game play, social network or vocal achievement application architecture that facilitates musical collaboration on a global scale and/or, in some cases or embodiments, to initiate revenue generating in-application transactions.

公开(公告)号：US20140229831A1

公开(公告)日：2014-08-14

申请号：US14104618

申请日：2013-12-12

Applicant: Smule, Inc.

Inventor： Parag P. Chordia ,  Perry R. Cook ,  Mark T. Godfrey ,  Prerna Gupta ,  Nicholas M. Kruge ,  Randal J. Leistikow ,  Alexander M.D. Rae ,  Ian S. Simon

IPC: G06F3/0482 ,  G06F3/0484

CPC classification number: G11B27/031 ,  G06F3/0482 ,  G06F3/04842 ,  G10H1/0025 ,  G10H1/383 ,  G10H2210/576 ,  G10L21/003 ,  G10L21/013 ,  G10L21/055 ,  H04N21/41407 ,  H04N21/854

Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a compute pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.

Abstract translation: 应用协调的音频和视频过滤器对来增强视听表演的艺术和情感内容。 当应用于托管在便携式计算设备（例如移动电话或媒体播放器，计算板或平板电脑，游戏控制器或个人数字助理或书籍阅读器）上的视听应用的音频和视频处理流水线中时，这种滤波器对， 可以允许用户选择增强与其协调的音频和视频的效果。 通过使用可在处理器上执行的数字信号处理软件和使用设备的存储，扬声器和显示设备或与设备互操作的数字信号处理软件，使用摄像机和麦克风接口在便携式计算设备处捕获，过滤和呈现协调的音频和视频。 通过在亲密手持设备上提供视听拍摄和个性化，现代社交网络平台流行的类型的社交互动和发布现在可以扩展到视听内容。

公开(公告)号：US10930256B2

公开(公告)日：2021-02-23

申请号：US16296391

申请日：2019-03-08

Applicant: SMULE, INC.

Inventor： Jeannie Yang ,  Nicholas M. Kruge ,  Gregory C. Thompson ,  Perry R. Cook

IPC: G10H1/36 ,  G10H1/10 ,  G10L21/013

Abstract: Vocal musical performances may be captured and, in some cases or embodiments, pitch-corrected and/or processed in accord with a user selectable vocal effects schedule for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. Vocal effects schedules may also be selectively applied to such performances. In these ways, even amateur user/performers with imperfect pitch are encouraged to take a shot at “stardom” and/or take part in a game play, social network or vocal achievement application architecture that facilitates musical collaboration on a global scale and/or, in some cases or embodiments, to initiate revenue generating in-application transactions.

公开(公告)号：US20190266987A1

公开(公告)日：2019-08-29

申请号：US16296391

申请日：2019-03-08

Applicant: Smule, Inc.

Inventor： Jeannie Yang ,  Nicholas M. Kruge ,  Gregory C. Thompson ,  Perry R. Cook

IPC: G10H1/36 ,  G10L21/013

Abstract: Vocal musical performances may be captured and, in some cases or embodiments, pitch-corrected and/or processed in accord with a user selectable vocal effects schedule for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. Vocal effects schedules may also be selectively applied to such performances. In these ways, even amateur user/performers with imperfect pitch are encouraged to take a shot at “stardom” and/or take part in a game play, social network or vocal achievement application architecture that facilitates musical collaboration on a global scale and/or, in some cases or embodiments, to initiate revenue generating in-application transactions.

公开(公告)号：US20150279427A1

公开(公告)日：2015-10-01

申请号：US14739910

申请日：2015-06-15

Applicant: Smule, Inc.

Inventor： Mark T. Godfrey ,  Turner Evan Kirk ,  Ian S. Simon ,  Nicholas M. Kruge

IPC: G11B27/10 ,  G06F17/30 ,  G11B27/031

CPC classification number: G11B27/10 ,  G06F3/0481 ,  G06F16/686 ,  G10L25/48 ,  G10L25/54 ,  G10L25/57 ,  G11B27/031 ,  H04N21/41407 ,  H04N21/854

Abstract: A generally diverse set of audiovisual clips is sourced from one or more repositories for use in preparing a coordinated audiovisual work. In some cases, audiovisual clips are retrieved using tags such as user-assigned hashtags or metadata. Pre-existing associations of such tags can be used as hints that certain audiovisual clips are likely to share correspondence with an audio signal encoding of a particular song or other audio baseline. Clips are evaluated for computationally determined correspondence with an audio baseline track. In general, comparisons of audio power spectra, of rhythmic features, tempo, pitch sequences and other extracted audio features may be used to establish correspondence. For clips exhibiting a desired level of correspondence, computationally determined temporal alignments of individual clips with the baseline audio track are used to prepare a coordinated audiovisual work that mixes the selected audiovisual clips with the audio track.

Abstract translation: 一组多样化的视听片段来自一个或多个存储库，用于准备协调的视听作品。 在某些情况下，使用诸如用户分配的标签或元数据的标签来检索视听剪辑。 这些标签的预先存在的关联可以用作某些视听剪辑可能与特定歌曲或其他音频基线的音频信号编码共享对应关系的提示。 评估剪辑与计算确定的与音频基准轨迹的对应关系。 通常，可以使用音频功率谱，节奏特征，速度，音调序列和其他提取的音频特征的比较来建立对应关系。 对于呈现期望的对应级别的剪辑，使用单独剪辑与基线音轨的计算确定的时间对准来准备将所选择的视听剪辑与音轨混合的协调的视听作品。

公开(公告)号：US11670270B2

公开(公告)日：2023-06-06

申请号：US17249113

申请日：2021-02-19

Applicant: SMULE, INC.

Inventor： Jeannie Yang ,  Nicholas M. Kruge ,  Gregory C. Thompson ,  Perry R. Cook

IPC: G10H1/36 ,  G10H1/10 ,  G10L21/013

CPC classification number: G10H1/366 ,  G10L21/013 ,  G10H2210/066 ,  G10H2210/331 ,  G10H2220/096 ,  G10H2240/251

Abstract: Embodiments described provide a method for mixing vocal performances from different vocalists. A vocal score temporally synchronized with a corresponding backing track and lyrics is retrieved via a communications interface of a portable computing device. A first vocal performance of a user is captured, via a microphone interface of the portable computing device, and in correspondence with the backing track. An open call indication for soliciting, from a second vocalist, a second vocal performance to be mixed for audible rendering with the first vocal performance is transmitted. A mix to one of the user and the second vocalist is provided by selecting, based on to whom the mix is provided, the mix from alternative mixes each having a different prominent vocal performance.

公开(公告)号：US10229662B2

公开(公告)日：2019-03-12

申请号：US15463878

申请日：2017-03-20

Applicant: SMULE, INC.

Inventor： Jeannie Yang ,  Nicholas M. Kruge ,  Gregory C. Thompson ,  Perry R. Cook

IPC: G10L21/00 ,  G10H1/36 ,  G10L21/013

Abstract: Vocal musical performances may be captured and, in some cases or embodiments, pitch-corrected and/or processed in accord with a user selectable vocal effects schedule for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. Vocal effects schedules may also be selectively applied to such performances. In these ways, even amateur user/performers with imperfect pitch are encouraged to take a shot at “stardom” and/or take part in a game play, social network or vocal achievement application architecture that facilitates musical collaboration on a global scale and/or, in some cases or embodiments, to initiate revenue generating in-application transactions.

公开(公告)号：US20140039883A1

公开(公告)日：2014-02-06

申请号：US13960564

申请日：2013-08-06

Applicant: Smule, Inc.

Inventor： Jeannie Yang ,  Nicholas M. Kruge ,  Gregory C. Thompson ,  Perry R. Cook

IPC: G10L21/013

CPC classification number: G10H1/366 ,  G10H2210/066 ,  G10H2210/331 ,  G10H2220/096 ,  G10H2240/251 ,  G10L21/013

Abstract: Vocal musical performances may be captured and, in some cases or embodiments, pitch-corrected and/or processed in accord with a user selectable vocal effects schedule for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. Vocal effects schedules may also be selectively applied to such performances. In these ways, even amateur user/performers with imperfect pitch are encouraged to take a shot at “stardom” and/or take part in a game play, social network or vocal achievement application architecture that facilitates musical collaboration on a global scale and/or, in some cases or embodiments, to initiate revenue generating in-application transactions.

Abstract translation: 可以捕获声乐表演，并且在一些情况或实施例中，根据用户可选择的声音效果调度进行音调校正和/或处理，以便以创建令人信服的用户体验的方式与后退轨道进行混合和呈现。 在某些情况下，个人用户的声乐表演在卡拉OK式表现的歌词的背景下被捕获在移动设备上，与对应于背景音轨的可听效果相对应。 可以根据音调校正设置在移动设备上实时地对这些演奏进行音调校正。 声音效果计划也可以选择性地应用于这种表演。 通过这些方式，甚至鼓励具有不完美音调的业余用户/表演者在“stardom”和/或参与游戏，社交网络或声乐成就应用程序架构中，促进全球范围内的音乐协作和/或 在某些情况或实施例中，用于启动生成应用程序内交易的收入。