-
公开(公告)号:US20230353812A1
公开(公告)日:2023-11-02
申请号:US18152045
申请日:2023-01-09
Applicant: SMULE, INC.
Inventor: Anton Holmberg , Benjamin Hersch , Jeannie Yang , Perry R. Cook , Jeffrey C. Smith
IPC: H04N21/43 , H04N21/4788 , H04L67/104 , H04N21/242 , H04N21/2187 , G10H1/36 , H04N21/462 , H04N5/265 , H04L65/611 , H04L65/612 , H04L65/75
CPC classification number: H04N21/4302 , H04N21/4788 , H04L67/104 , H04N21/242 , H04N21/2187 , G10H1/366 , H04N21/4622 , H04N5/265 , H04N21/43079 , H04L65/611 , H04L65/612 , H04L65/765 , H04N21/462 , G10H2210/091 , G10H2210/066 , G10H2220/011 , G10H2240/175 , G10H2230/015
Abstract: Techniques have been developed to facilitate the livestreaming of group audiovisual performances. Audiovisual performances including vocal music are captured and coordinated with performances of other users in ways that can create compelling user and listener experiences. For example, in some cases or embodiments, duets with a host performer may be supported in a sing-with-the-artist style audiovisual livestream in which aspiring vocalists request or queue particular songs for a live radio show entertainment format. The developed techniques provide a communications latency-tolerant mechanism for synchronizing vocal performances captured at geographically-separated devices (e.g., at globally-distributed, but network-connected mobile phones or tablets or at audiovisual capture devices geographically separated from a live studio).
-
公开(公告)号:US11693616B2
公开(公告)日:2023-07-04
申请号:US16947943
申请日:2020-08-25
Applicant: SMULE, INC.
Inventor: Jon Moldover , David Steinwedel , Jeffrey C. Smith , Perry R. Cook
IPC: G06F3/0484 , G06F3/16 , G06F3/0482 , G10L25/51 , G06F3/0488 , G10L25/90
CPC classification number: G06F3/16 , G06F3/0482 , G06F3/0484 , G06F3/0488 , G10L25/51 , G10L25/90 , G06F2203/04808
Abstract: User interface techniques provide user vocalists with mechanisms for solo audiovisual capture and for seeding subsequent performances by other users (e.g., joiners). Audiovisual capture may be against a full-length work or seed spanning much or all of a pre-existing audio (or audiovisual) work and in some cases may mix, to seed further contributions of one or more joiners, a user's captured media content for at least some portions of the audio (or audiovisual) work. A short seed or short segment may span less than all (and in some cases, much less than all) of the audio (or audiovisual) work. For example, a verse, chorus, refrain, hook or other limited “chunk” of an audio (or audiovisual) work may constitute a short seed or short segment. Computational techniques are described that allow a system to automatically identify suitable short seeds or short segments. After audiovisual capture against the short seed or short segment, a resulting, solo or group, full-length or short-form performance may be posted, livestreamed, or otherwise disseminated in a social network.
-
公开(公告)号:US11683536B2
公开(公告)日:2023-06-20
申请号:US17659644
申请日:2022-04-18
Applicant: SMULE, INC.
Inventor: Anton Holmberg , Benjamin Hersh , Jeannie Yang , Yuning Woo , Wang Liang , Perry R. Cook , Jeffrey C. Smith
IPC: H04N21/2187 , H04N21/233 , H04N21/43 , H04L65/75
CPC classification number: H04N21/2187 , H04L65/762 , H04N21/233 , H04N21/43076
Abstract: Techniques have been developed to facilitate the livestreaming of group audiovisual performances. Audiovisual performances including vocal music are captured and coordinated with performances of other users in ways that can create compelling user and listener experiences. For example, in some cases or embodiments, duets with a host performer may be supported in a sing-with-the-artist style audiovisual livestream in which aspiring vocalists request or queue particular songs for a live radio show entertainment format. The developed techniques provide a communications latency-tolerant mechanism for synchronizing vocal performances captured at geographically-separated devices (e.g., at globally-distributed, but network-connected mobile phones or tablets or at audiovisual capture devices geographically separated from a live studio).
-
4.
公开(公告)号:US11488569B2
公开(公告)日:2022-11-01
申请号:US16107351
申请日:2018-08-21
Applicant: SMULE, INC.
Inventor: David Steinwedel , Perry R. Cook , Paul T. Chi , Wei Zhou , Jon Moldover , Anton Holmberg , Jingxi Li
Abstract: Visual effects schedules are applied to audiovisual performances with differing visual effects applied in correspondence with differing elements of musical structure. Segmentation techniques applied to one or more audio tracks (e.g., vocal or backing tracks) are used to compute some of the components of the musical structure. In some cases, applied visual effects schedules are mood-denominated and may be selected by a performer as a component of his or her visual expression or determined from an audiovisual performance using machine learning techniques.
-
公开(公告)号:US20220180879A1
公开(公告)日:2022-06-09
申请号:US17479912
申请日:2021-09-20
Applicant: SMULE, INC.
Inventor: Parag Chordia , Mark Godfrey , Alexander Rae , Prerna Gupta , Perry R. Cook
IPC: G10L19/02 , G10L21/055 , G10H1/36 , G10L19/00
Abstract: Captured vocals may be automatically transformed using advanced digital signal processing techniques that provide captivating applications, and even purpose-built devices, in which mere novice user-musicians may generate, audibly render and share musical performances. In some cases, the automated transformations allow spoken vocals to be segmented, arranged, temporally aligned with a target rhythm, meter or accompanying backing tracks and pitch corrected in accord with a score or note sequence. Speech-to-song music applications are one such example. In some cases, spoken vocals may be transformed in accord with musical genres such as rap using automated segmentation and temporal alignment techniques, often without pitch correction. Such applications, which may employ different signal processing and different automated transformations, may nonetheless be understood as speech-to-rap variations on the theme.
-
公开(公告)号:US20220030056A1
公开(公告)日:2022-01-27
申请号:US17303769
申请日:2021-06-07
Applicant: SMULE, INC.
Inventor: Anton Holmberg , Benjamin Hersh , Jeannie Yang , Perry R. Cook , Jeffrey C. Smith
Abstract: Techniques have been developed to facilitate the livestreaming of group audiovisual performances. Audiovisual performances including vocal music are captured and coordinated with performances of other users in ways that can create compelling user and listener experiences. For example, in some cases or embodiments, duets with a host performer may be supported in a sing-with-the-artist style audiovisual livestream in which aspiring vocalists request or queue particular songs for a live radio show entertainment format. The developed techniques provide a communications latency-tolerant mechanism for synchronizing vocal performances captured at geographically-separated devices (e.g., at globally-distributed, but network-connected mobile phones or tablets or at audiovisual capture devices geographically separated from a live studio).
-
公开(公告)号:US11146901B2
公开(公告)日:2021-10-12
申请号:US16403939
申请日:2019-05-06
Applicant: SMULE, INC.
Inventor: Amanda Chaudhary , David Steinwedel , John Shimmin , Lance Jabr , Randal Leistikow
Abstract: Latency on different devices (e.g., devices of differing brand, model, vintage, etc.) can vary significantly and tens of milliseconds can affect human perception of lagging and leading components of a performance. As a result, use of a uniform latency estimate across a wide variety of devices is unlikely to provide good results, and hand-estimating round-trip latency across a wide variety of devices is costly and would constantly need to be updated for new devices. Instead, a system has been developed for crowdsourcing latency estimates.
-
公开(公告)号:US10930256B2
公开(公告)日:2021-02-23
申请号:US16296391
申请日:2019-03-08
Applicant: SMULE, INC.
Inventor: Jeannie Yang , Nicholas M. Kruge , Gregory C. Thompson , Perry R. Cook
IPC: G10H1/36 , G10H1/10 , G10L21/013
Abstract: Vocal musical performances may be captured and, in some cases or embodiments, pitch-corrected and/or processed in accord with a user selectable vocal effects schedule for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. Vocal effects schedules may also be selectively applied to such performances. In these ways, even amateur user/performers with imperfect pitch are encouraged to take a shot at “stardom” and/or take part in a game play, social network or vocal achievement application architecture that facilitates musical collaboration on a global scale and/or, in some cases or embodiments, to initiate revenue generating in-application transactions.
-
9.
公开(公告)号:US20210037166A1
公开(公告)日:2021-02-04
申请号:US16814132
申请日:2020-03-10
Applicant: SMULE, INC.
Inventor: Mark T. Godfrey , Perry R. Cook
IPC: H04N5/04 , G10L21/013 , G10L13/033 , G10H1/36
Abstract: Audiovisual performances, including vocal music, are captured and coordinated with those of other users in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for visually prominent presentation performance synchronized video of one or more of the contributors. Prominence of particular performance synchronized video may be based, at least in part, on computationally-defined audio features extracted from (or computed over) captured vocal audio. Over the course of a coordinated audiovisual performance timeline, these computationally-defined audio features are selective for performance synchronized video of one or more of the contributing vocalists.
-
公开(公告)号:US20200312290A1
公开(公告)日:2020-10-01
申请号:US16665611
申请日:2019-10-28
Applicant: SMULE, INC.
Inventor: Stefan Sullivan , John Shimmin , Dean Schaffer , Perry R. Cook
IPC: G10H1/36
Abstract: Digital signal processing and machine learning techniques can be employed in a vocal capture and performance social network to computationally generate vocal pitch tracks from a collection of vocal performances captured against a common temporal baseline such as a backing track or an original performance by a popularizing artist. In this way, crowd-sourced pitch tracks may be generated and distributed for use in subsequent karaoke-style vocal audio captures or other applications. Large numbers of performances of a song can be used to generate a pitch track. Computationally determined pitch trackings from individual audio signal encodings of the crowd-sourced vocal performance set are aggregated and processed as an observation sequence of a trained Hidden Markov Model (HMM) or other statistical model to produce an output pitch track.
-
-
-
-
-
-
-
-
-