-
91.
公开(公告)号:US20230335094A1
公开(公告)日:2023-10-19
申请号:US18051391
申请日:2022-10-31
Applicant: SMULE, INC.
Inventor: David Steinwedel , Perry R. Cook , Paul T. Chi , Wei Zhou , Jon Moldover , Anton Holmberg , Jingxi Li
CPC classification number: G10H1/368 , G10H1/366 , G11B27/02 , G06T11/00 , G10H2240/251 , G10H2240/175 , G10H2230/015 , G10H2220/355 , G10H2220/005 , G10H2220/011 , G10H2210/331
Abstract: Visual effects schedules are applied to audiovisual performances with differing visual effects applied in correspondence with differing elements of musical structure. Segmentation techniques applied to one or more audio tracks (e.g., vocal or backing tracks) are used to compute some of the components of the musical structure. In some cases, applied visual effects schedules are mood-denominated and may be selected by a performer as a component of his or her visual expression or determined from an audiovisual performance using machine learning techniques.
-
公开(公告)号:US11756518B2
公开(公告)日:2023-09-12
申请号:US17452174
申请日:2021-10-25
Applicant: SMULE, INC.
Inventor: Kevin Sung , Bona Kim , Jon Moldover , John Shimmin , Jeannie Yang , Perry R. Cook
CPC classification number: G10H1/368 , G10H1/366 , G11B27/02 , G11B27/031 , G11B27/10 , G11B27/28 , G11B27/34 , G10H2210/331 , G10H2220/005 , G10H2220/011 , G10H2220/355 , G10H2230/015 , G10H2240/175 , G10H2240/251
Abstract: Vocal audio of a user together with performance synchronized video is captured and coordinated with audiovisual contributions of other users to form composite duet-style or glee club-style or window-paned music video-style audiovisual performances. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for presentation, at any given time along a given performance timeline, performance synchronized video of one or more of the contributors. Selections are in accord with a visual progression that codes a sequence of visual layouts in correspondence with other coded aspects of a performance score such as pitch tracks, backing audio, lyrics, sections and/or vocal parts.
-
公开(公告)号:US20220223128A1
公开(公告)日:2022-07-14
申请号:US17452174
申请日:2021-10-25
Applicant: SMULE, INC.
Inventor: Kevin Sung , Bona Kim , Jon Moldover , John Shimmin , Jeannie Yang , Perry R. Cook
Abstract: Vocal audio of a user together with performance synchronized video is captured and coordinated with audiovisual contributions of other users to form composite duet-style or glee club-style or window-paned music video-style audiovisual performances. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for presentation, at any given time along a given performance timeline, performance synchronized video of one or more of the contributors. Selections are in accord with a visual progression that codes a sequence of visual layouts in correspondence with other coded aspects of a performance score such as pitch tracks, backing audio, lyrics, sections and/or vocal parts.
-
94.
公开(公告)号:US11264058B2
公开(公告)日:2022-03-01
申请号:US16834775
申请日:2020-03-30
Applicant: SMULE, INC.
Inventor: Parag P. Chordia , Perry R. Cook , Mark T. Godfrey , Prerna Gupta , Nicholas M. Kruge , Randal J. Leistikow , Alexander M. D. Rae , Ian S. Simon
IPC: G10L21/055 , G11B27/031 , G06F3/0482 , G06F3/04842 , G10L21/003 , G10H1/00 , G10H1/38 , H04N21/414 , H04N21/854 , G10L21/013
Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a computing pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.
-
公开(公告)号:US11250826B2
公开(公告)日:2022-02-15
申请号:US16665611
申请日:2019-10-28
Applicant: SMULE, INC.
Inventor: Stefan Sullivan , John Shimmin , Dean Schaffer , Perry R. Cook
IPC: G10H1/36
Abstract: Digital signal processing and machine learning techniques can be employed in a vocal capture and performance social network to computationally generate vocal pitch tracks from a collection of vocal performances captured against a common temporal baseline such as a backing track or an original performance by a popularizing artist. In this way, crowd-sourced pitch tracks may be generated and distributed for use in subsequent karaoke-style vocal audio captures or other applications. Large numbers of performances of a song can be used to generate a pitch track. Computationally determined pitch trackings from individual audio signal encodings of the crowd-sourced vocal performance set are aggregated and processed as an observation sequence of a trained Hidden Markov Model (HMM) or other statistical model to produce an output pitch track.
-
96.
公开(公告)号:US20210125595A1
公开(公告)日:2021-04-29
申请号:US16898891
申请日:2020-06-11
Applicant: SMULE, INC.
Inventor: Spencer Salazar , Rebecca A. Fiebrink , Ge Wang , Mattias Ljungstrom , Jeffrey C. Smith , Perry R. Cook
IPC: G10H1/36 , G10L21/013 , G06F3/16 , G10L21/0356
Abstract: Techniques have been developed to facilitate (1) the capture and pitch correction of vocal performances on handheld or other portable computing devices and (2) the mixing of such pitch-corrected vocal performances with backing tracks for audible rendering on targets that include such portable computing devices and as well as desktops, workstations, gaming stations, even telephony targets. Implementations of the described techniques employ signal processing techniques and allocations of system functionality that are suitable given the generally limited capabilities of such handheld or portable computing devices and that facilitate efficient encoding and communication of the pitch-corrected vocal performances (or precursors or derivatives thereof) via wireless and/or wired bandwidth-limited networks for rendering on portable computing devices or other targets.
-
公开(公告)号:US10930296B2
公开(公告)日:2021-02-23
申请号:US15849194
申请日:2017-12-20
Applicant: Smule, Inc.
Inventor: Perry R. Cook , Ari Lazier , Tom Lieber , Turner Evan Kirk
IPC: G10H1/36 , G10L21/013 , G10L13/033
Abstract: In some examples, a system includes a first portable computing device that audibly renders a backing track, captures and pitch corrects a vocal performance of a first user, and transmits the first user's pitch corrected vocal performance. The system may also include a second portable computing device including a data communications interface that receives the first user's pitch corrected vocal performance, an audio transducer that audibly renders a mix of the backing track and the first user's pitch corrected vocal performance, a display for concurrent presentation of lyrics temporally synchronized with a vocal score and the backing track, a microphone interface that captures a vocal performance of a second user, and pitch correction code executable on the second portable computing device to pitch correct the second user's vocal performance in accord with the vocal score to produce a composite multi-vocal performance.
-
98.
公开(公告)号:US10685634B2
公开(公告)日:2020-06-16
申请号:US15693946
申请日:2017-09-01
Applicant: SMULE, INC.
Inventor: Spencer Salazar , Rebecca A. Fiebrink , Ge Wang , Mattias Ljungstrom , Jeffrey C. Smith , Perry R. Cook
IPC: G10H1/02 , G10H1/36 , G10L21/013 , G06F3/16 , G10L21/0356
Abstract: Techniques have been developed to facilitate (1) the capture and pitch correction of vocal performances on handheld or other portable computing devices and (2) the mixing of such pitch-corrected vocal performances with backing tracks for audible rendering on targets that include such portable computing devices and as well as desktops, workstations, gaming stations, even telephony targets. Implementations of the described techniques employ signal processing techniques and allocations of system functionality that are suitable given the generally limited capabilities of such handheld or portable computing devices and that facilitate efficient encoding and communication of the pitch-corrected vocal performances (or precursors or derivatives thereof) via wireless and/or wired bandwidth-limited networks for rendering on portable computing devices or other targets.
-
公开(公告)号:US10607650B2
公开(公告)日:2020-03-31
申请号:US15284229
申请日:2016-10-03
Applicant: SMULE, INC.
Inventor: Parag P. Chordia , Perry R. Cook , Mark T. Godfrey , Prerna Gupta , Nicholas M. Kruge , Randal J. Leistikow , Alexander M. D. Rae , Ian S. Simon
IPC: G10L21/055 , G10H1/36 , G11B27/031 , G06F3/0482 , G06F3/0484 , G10L21/003 , G10H1/00 , G10H1/38 , H04N21/414 , H04N21/854 , G10L21/013
Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a computing pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.
-
100.
公开(公告)号:US10587780B2
公开(公告)日:2020-03-10
申请号:US15864819
申请日:2018-01-08
Applicant: Smule, Inc.
Inventor: Mark T. Godfrey , Perry R. Cook
IPC: G10H1/36 , H04N5/04 , G10L21/013 , G10L13/033
Abstract: Audiovisual performances, including vocal music, are captured and coordinated with those of other users in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for visually prominent presentation performance synchronized video of one or more of the contributors. Prominence of particular performance synchronized video may be based, at least in part, on computationally-defined audio features extracted from (or computed over) captured vocal audio. Over the course of a coordinated audiovisual performance timeline, these computationally-defined audio features are selective for performance synchronized video of one or more of the contributing vocalists.
-
-
-
-
-
-
-
-
-