公开(公告)号：US20200286457A1

公开(公告)日：2020-09-10

申请号：US16574971

申请日：2019-09-18

Applicant: SMULE, INC.

Inventor： Kevin Sung ,  Bona Kim ,  Jon Moldover ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

IPC: G10H1/36 ,  G11B27/02 ,  G11B27/031 ,  G11B27/10 ,  G11B27/28 ,  G11B27/34

Abstract: Vocal audio of a user together with performance synchronized video is captured and coordinated with audiovisual contributions of other users to form composite duet-style or glee club-style or window-paned music video-style audiovisual performances. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for presentation, at any given time along a given performance timeline, performance synchronized video of one or more of the contributors. Selections are in accord with a visual progression that codes a sequence of visual layouts in correspondence with other coded aspects of a performance score such as pitch tracks, backing audio, lyrics, sections and/or vocal parts.

公开(公告)号：US10672375B2

公开(公告)日：2020-06-02

申请号：US15694461

申请日：2017-09-01

Applicant: SMULE, INC.

Inventor： Spencer Salazar ,  Rebecca A. Fiebrink ,  Ge Wang ,  Mattias Ljungstrom ,  Jeffrey C. Smith ,  Perry R. Cook

IPC: G10H1/36 ,  G10L21/013 ,  G06F3/16 ,  G10L21/0356

Abstract: Vocal musical performances may be captured and continuously pitch-corrected at a mobile device for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. In some cases, such pitch correction settings code a particular key or scale for the vocal performance or for portions thereof. In some cases, pitch correction settings include a score-coded melody sequence of note targets supplied with, or for association with, the lyrics and/or backing track. In some cases, pitch correction settings are dynamically variable based on gestures captured at a user interface.

公开(公告)号：US10460711B2

公开(公告)日：2019-10-29

申请号：US15649040

申请日：2017-07-13

Applicant: SMULE, INC.

Inventor： Stefan Sullivan ,  John Shimmin ,  Dean Schaffer ,  Perry R. Cook

IPC: G10H1/36

Abstract: Digital signal processing and machine learning techniques can be employed in a vocal capture and performance social network to computationally generate vocal pitch tracks from a collection of vocal performances captured against a common temporal baseline such as a backing track or an original performance by a popularizing artist. In this way, crowd-sourced pitch tracks may be generated and distributed for use in subsequent karaoke-style vocal audio captures or other applications. Large numbers of performances of a song can be used to generate a pitch track. Computationally determined pitch trackings from individual audio signal encodings of the crowd-sourced vocal performance set are aggregated and processed as an observation sequence of a trained Hidden Markov Model (HMM) or other statistical model to produce an output pitch track.

公开(公告)号：US10424283B2

公开(公告)日：2019-09-24

申请号：US15910646

申请日：2018-03-02

Applicant: SMULE, INC.

Inventor： Kevin Sung ,  Bona Kim ,  Jon Moldover ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

IPC: G10H1/36 ,  G11B27/02

Abstract: Vocal audio of a user together with performance synchronized video is captured and coordinated with audiovisual contributions of other users to form composite duet-style or glee club-style or window-paned music video-style audiovisual performances. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for presentation, at any given time along a given performance timeline, performance synchronized video of one or more of the contributors. Selections are in accord with a visual progression that codes a sequence of visual layouts in correspondence with other coded aspects of a performance score such as pitch tracks, backing audio, lyrics, sections and/or vocal parts.

公开(公告)号：US20180182366A1

公开(公告)日：2018-06-28

申请号：US15693946

申请日：2017-09-01

Applicant: SMULE, INC.

Inventor： Spencer Salazar ,  Rebecca A. Fiebrink ,  Ge Wang ,  Mattias Ljungstrom ,  Jeffrey C. Smith ,  Perry R. Cook

IPC: G10H1/36 ,  G06F3/16 ,  G10L21/0356 ,  G10L21/013

Abstract: Techniques have been developed to facilitate (1) the capture and pitch correction of vocal performances on handheld or other portable computing devices and (2) the mixing of such pitch-corrected vocal performances with backing tracks for audible rendering on targets that include such portable computing devices and as well as desktops, workstations, gaming stations, even telephony targets. Implementations of the described techniques employ signal processing techniques and allocations of system functionality that are suitable given the generally limited capabilities of such handheld or portable computing devices and that facilitate efficient encoding and communication of the pitch-corrected vocal performances (or precursors or derivatives thereof) via wireless and/or wired bandwidth-limited networks for rendering on portable computing devices or other targets.

公开(公告)号：US20180151164A1

公开(公告)日：2018-05-31

申请号：US15694461

申请日：2017-09-01

Applicant: SMULE, INC.

Inventor： Spencer Salazar ,  Rebecca A. Fiebrink ,  Ge Wang ,  Mattias Ljungstrom ,  Jeffrey C. Smith ,  Perry R. Cook

IPC: G10H1/36 ,  G06F3/16 ,  G10L21/0356 ,  G10L21/013

Abstract: Vocal musical performances may be captured and continuously pitch-corrected at a mobile device for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. In some cases, such pitch correction settings code a particular key or scale for the vocal performance or for portions thereof. In some cases, pitch correction settings include a score-coded melody sequence of note targets supplied with, or for association with, the lyrics and/or backing track. In some cases, pitch correction settings are dynamically variable based on gestures captured at a user interface.

公开(公告)号：USD807381S1

公开(公告)日：2018-01-09

申请号：US29566255

申请日：2016-05-27

Applicant: Smule, Inc.

Designer： Benjamin Hersh ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

公开(公告)号：US09866731B2

公开(公告)日：2018-01-09

申请号：US14928727

申请日：2015-10-30

Applicant: Smule, Inc.

Inventor： Mark T. Godfrey ,  Perry R. Cook

IPC: G10L21/013 ,  H04N5/04 ,  G10L13/033 ,  G10H1/36

CPC classification number: H04N5/04 ,  G10H1/366 ,  G10H2210/066 ,  G10H2210/331 ,  G10H2240/251 ,  G10L13/0335 ,  G10L21/013 ,  Y10S84/04

Abstract: Audiovisual performances, including vocal music, are captured and coordinated with those of other users in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for visually prominent presentation performance synchronized video of one or more of the contributors. Prominence of particular performance synchronized video may be based, at least in part, on computationally-defined audio features extracted from (or computed over) captured vocal audio. Over the course of a coordinated audiovisual performance timeline, these computationally-defined audio features are selective for performance synchronized video of one or more of the contributing vocalists.

公开(公告)号：US09852742B2

公开(公告)日：2017-12-26

申请号：US14517647

申请日：2014-10-17

Applicant: Smule, Inc.

Inventor： Perry R. Cook ,  Ari Lazier ,  Tom Lieber ,  Turner Evan Kirk

IPC: G10H1/06 ,  G10L21/013 ,  G10H1/36 ,  G10L13/033

CPC classification number: G10L21/013 ,  G10H1/366 ,  G10H2210/066 ,  G10H2210/331 ,  G10H2240/251 ,  G10L13/0335 ,  Y10S84/04

Abstract: Despite many practical limitations imposed by mobile device platforms and application execution environments, vocal musical performances may be captured and continuously pitch-corrected for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at a portable computing device (such as a mobile phone, personal digital assistant, laptop computer, notebook computer, pad-type computer or netbook) in accord with pitch correction settings. In some cases, pitch correction settings include a score-coded melody and/or harmonies supplied with, or for association with, the lyrics and backing tracks. Harmonies notes or chords may be coded as explicit targets or relative to the score coded melody or even actual pitches sounded by a vocalist, if desired.

公开(公告)号：USD803245S1

公开(公告)日：2017-11-21

申请号：US29566074

申请日：2016-05-26

Applicant: Smule, Inc.

Designer： Benjamin Hersh ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook