公开(公告)号：USD800753S1

公开(公告)日：2017-10-24

申请号：US29566090

申请日：2016-05-26

Applicant: Smule, Inc.

Designer： Benjamin Hersh ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

公开(公告)号：USD800752S1

公开(公告)日：2017-10-24

申请号：US29566085

申请日：2016-05-26

Applicant: Smule, Inc.

Designer： Benjamin Hersh ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

公开(公告)号：US09666199B2

公开(公告)日：2017-05-30

申请号：US13910949

申请日：2013-06-05

Applicant: Smule, Inc.

Inventor： Parag Chordia ,  Mark Godfrey ,  Alexander Rae ,  Prerna Gupta ,  Perry R. Cook

IPC: G10L21/007 ,  G10L21/04 ,  G10L19/02 ,  G10L19/00 ,  G10L21/055 ,  G10H1/36

CPC classification number: G10L19/02 ,  G10H1/366 ,  G10H2210/051 ,  G10H2240/141 ,  G10H2250/235 ,  G10L19/00 ,  G10L21/055

Abstract: Captured vocals may be automatically transformed using advanced digital signal processing techniques that provide captivating applications, and even purpose-built devices, in which mere novice user-musicians may generate, audibly render and share musical performances. In some cases, the automated transformations allow spoken vocals to be segmented, arranged, temporally aligned with a target rhythm, meter or accompanying backing tracks and pitch corrected in accord with a score or note sequence. Speech-to-song music applications are one such example. In some cases, spoken vocals may be transformed in accord with musical genres such as rap using automated segmentation and temporal alignment techniques, often without pitch correction. Such applications, which may employ different signal processing and different automated transformations, may nonetheless be understood as speech-to-rap variations on the theme.

公开(公告)号：US20160005416A1

公开(公告)日：2016-01-07

申请号：US14720320

申请日：2015-05-22

Applicant: Smule, Inc.

Inventor： Spencer Salazar ,  Rebecca A. Fiebrink ,  Ge Wang ,  Mattias Ljungstrom ,  Jeffrey C. Smith ,  Perry R. Cook

IPC: G10L21/013 ,  G06F3/16

CPC classification number: G10H1/366 ,  G06F3/165 ,  G10H1/368 ,  G10H2210/251 ,  G10H2210/331 ,  G10H2220/011 ,  G10H2240/125 ,  G10H2240/175 ,  G10H2240/211 ,  G10H2240/251 ,  G10L21/013 ,  G10L21/0356

Abstract: Techniques have been developed to facilitate (1) the capture and pitch correction of vocal performances on handheld or other portable computing devices and (2) the mixing of such pitch-corrected vocal performances with backing tracks for audible rendering on targets that include such portable computing devices and as well as desktops, workstations, gaming stations, even telephony targets. Implementations of the described techniques employ signal processing techniques and allocations of system functionality that are suitable given the generally limited capabilities of such handheld or portable computing devices and that facilitate efficient encoding and communication of the pitch-corrected vocal performances (or precursors or derivatives thereof) via wireless and/or wired bandwidth-limited networks for rendering on portable computing devices or other targets.

Abstract translation: 已经开发了技术来促进（1）在手持或其他便携式计算设备上的声音表演的捕获和音调校正，以及（2）将这种音调校正的声乐表演与背景轨道的混合，以便在包括这种便携式计算机 设备，以及桌面，工作站，游戏站，甚至电话目标。 所描述的技术的实施采用信号处理技术和系统功能的分配，给定这些手持或便携式计算设备的通常有限的能力，并且促进音调校正的声乐表演（或其前体或衍生物）的有效编码和通信， 通过无线和/或有线带宽限制网络在便携式计算设备或其他目标上呈现。

公开(公告)号：US09083451B2

公开(公告)日：2015-07-14

申请号：US14295106

申请日：2014-06-03

Applicant: Smule, Inc.

Inventor： Perry R. Cook

IPC: H04B11/00 ,  G06F3/16 ,  H04M1/725 ,  G10L19/018

CPC classification number: H04B11/00 ,  G06F3/16 ,  G10L19/018 ,  H04M1/72527 ,  H04M1/7253 ,  H04W76/14

Abstract: Techniques have been developed for transmitting and receiving information conveyed through the air from one portable device to another as a generally unperceivable coding within an otherwise recognizable acoustic signal. For example, in some embodiments in accordance with the present invention(s), information is acoustically communicated from a first handheld device toward a second by encoding the information in a signal that, when converted into acoustic energy at an acoustic transducer of the first handheld device, is characterized in that the acoustic energy is discernable to a human ear yet the encoding of the information therein is generally not perceivable by the human. The acoustic energy is transmitted from the acoustic transducer of the first handheld device toward the second handheld device across an air gap that constitutes a substantially entirety of the distance between the devices. Acoustic energy received at the second handheld device may then be processed using signal processing techniques tailored to detection of the particular information encodings employed.

Abstract translation: 已经开发了用于将通过空气传送的信息从一个便携式设备发送到另一个的技术，作为在另外可识别的声学信号中的通常不可理解的编码。 例如，在根据本发明的一些实施例中，通过对信号进行编码来将信息从第一手持设备传播到第二手持设备，当信号被转换成第一手持设备的声换能器时的声能时 装置的特征在于，声能量可以被人耳识别，但是其中的信息的编码通常不被人感知。 声能从第一手持装置的声换能器朝向第二手持装置穿过构成装置之间基本上整个距离的气隙传送。 然后可以使用针对所采用的特定信息编码进行定制的信号处理技术来处理在第二手持设备处接收的声能。

公开(公告)号：US20150170636A1

公开(公告)日：2015-06-18

申请号：US14517647

申请日：2014-10-17

Applicant: Smule, Inc.

Inventor： Perry R. Cook ,  Ari Lazier ,  Tom Lieber ,  Turner Evan Kirk

IPC: G10L13/033

CPC classification number: G10L21/013 ,  G10H1/366 ,  G10H2210/066 ,  G10H2210/331 ,  G10H2240/251 ,  G10L13/0335 ,  Y10S84/04

Abstract: Despite many practical limitations imposed by mobile device platforms and application execution environments, vocal musical performances may be captured and continuously pitch-corrected for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at a portable computing device (such as a mobile phone, personal digital assistant, laptop computer, notebook computer, pad-type computer or netbook) in accord with pitch correction settings. In some cases, pitch correction settings include a score-coded melody and/or harmonies supplied with, or for association with, the lyrics and backing tracks. Harmonies notes or chords may be coded as explicit targets or relative to the score coded melody or even actual pitches sounded by a vocalist, if desired.

Abstract translation: 尽管移动设备平台和应用程序执行环境的许多实际限制，可以捕获声乐表演，并且以不断创造令人信服的用户体验的方式，以后备音轨进行混音和渲染。 在某些情况下，个人用户的声乐表演在卡拉OK式表现的歌词的背景下被捕获在移动设备上，与对应于背景音轨的可听效果相对应。 可以根据音调校正设置在便携式计算设备（诸如手机，个人数字助理，膝上型计算机，笔记本电脑，平板电脑或上网本）上实时地进行音调校正。 在某些情况下，音高校正设置包括与歌词和背景音轨一起提供或与歌词和背景音轨相关联的分数编码旋律和/或和声。 和弦音符或和弦可以被编码为明确的目标，或者相对于得分编码的旋律，或者如果需要，由声乐家发出的甚至实际的音调也被编码。

公开(公告)号：US20140347958A1

公开(公告)日：2014-11-27

申请号：US14295106

申请日：2014-06-03

Applicant: Smule, Inc.

Inventor： Perry R. Cook

IPC: H04B11/00

CPC classification number: H04B11/00 ,  G06F3/16 ,  G10L19/018 ,  H04M1/72527 ,  H04M1/7253 ,  H04W76/14

Abstract: Techniques have been developed for transmitting and receiving information conveyed through the air from one portable device to another as a generally unperceivable coding within an otherwise recognizable acoustic signal. For example, in some embodiments in accordance with the present invention(s), information is acoustically communicated from a first handheld device toward a second by encoding the information in a signal that, when converted into acoustic energy at an acoustic transducer of the first handheld device, is characterized in that the acoustic energy is discernable to a human ear yet the encoding of the information therein is generally not perceivable by the human. The acoustic energy is transmitted from the acoustic transducer of the first handheld device toward the second handheld device across an air gap that constitutes a substantially entirety of the distance between the devices. Acoustic energy received at the second handheld device may then be processed using signal processing techniques tailored to detection of the particular information encodings employed.

Abstract translation: 已经开发了用于将通过空气传送的信息从一个便携式设备发送到另一个的技术，作为在另外可识别的声学信号中的通常不可理解的编码。 例如，在根据本发明的一些实施例中，通过对信号进行编码来将信息从第一手持设备传播到第二手持设备，当信号被转换成第一手持设备的声换能器时的声能时 装置的特征在于，声能量可以被人耳识别，但是其中的信息的编码通常不被人感知。 声能从第一手持装置的声换能器朝向第二手持装置穿过构成装置之间基本上整个距离的气隙传送。 然后可以使用针对所采用的特定信息编码进行定制的信号处理技术来处理在第二手持设备处接收的声能。

公开(公告)号：US20140229831A1

公开(公告)日：2014-08-14

申请号：US14104618

申请日：2013-12-12

Applicant: Smule, Inc.

Inventor： Parag P. Chordia ,  Perry R. Cook ,  Mark T. Godfrey ,  Prerna Gupta ,  Nicholas M. Kruge ,  Randal J. Leistikow ,  Alexander M.D. Rae ,  Ian S. Simon

IPC: G06F3/0482 ,  G06F3/0484

CPC classification number: G11B27/031 ,  G06F3/0482 ,  G06F3/04842 ,  G10H1/0025 ,  G10H1/383 ,  G10H2210/576 ,  G10L21/003 ,  G10L21/013 ,  G10L21/055 ,  H04N21/41407 ,  H04N21/854

Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a compute pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.

Abstract translation: 应用协调的音频和视频过滤器对来增强视听表演的艺术和情感内容。 当应用于托管在便携式计算设备（例如移动电话或媒体播放器，计算板或平板电脑，游戏控制器或个人数字助理或书籍阅读器）上的视听应用的音频和视频处理流水线中时，这种滤波器对， 可以允许用户选择增强与其协调的音频和视频的效果。 通过使用可在处理器上执行的数字信号处理软件和使用设备的存储，扬声器和显示设备或与设备互操作的数字信号处理软件，使用摄像机和麦克风接口在便携式计算设备处捕获，过滤和呈现协调的音频和视频。 通过在亲密手持设备上提供视听拍摄和个性化，现代社交网络平台流行的类型的社交互动和发布现在可以扩展到视听内容。

公开(公告)号：US12175156B2

公开(公告)日：2024-12-24

申请号：US17403342

申请日：2021-08-16

Applicant: SMULE, INC.

Inventor： Benjamin Hersh ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

IPC: A63F13/215 ,  A63F13/22 ,  A63F13/537 ,  A63F13/655 ,  A63F13/814 ,  G06F3/16 ,  G10H1/36 ,  A63F13/45 ,  G10L21/013 ,  G10L25/57

Abstract: Embodiments described herein relate generally to systems comprising a display device, a display device-coupled computing platform, a mobile device in communication with the computing platform, and a content server in which methods and techniques of capture and/or processing of audiovisual performances are described and, in particular, description of techniques suitable for use in connection with display device connected computing platforms for rendering vocal performance captured by a handheld computing device.

公开(公告)号：US12033644B2

公开(公告)日：2024-07-09

申请号：US17479912

申请日：2021-09-20

Applicant: SMULE, INC.

Inventor： Parag Chordia ,  Mark Godfrey ,  Alexander Rae ,  Prerna Gupta ,  Perry R. Cook

IPC: G10L21/04 ,  G10H1/36 ,  G10L19/00 ,  G10L19/02 ,  G10L21/01 ,  G10L21/055

CPC classification number: G10L19/02 ,  G10H1/366 ,  G10L19/00 ,  G10L21/055 ,  G10H2210/051 ,  G10H2240/141 ,  G10H2250/235

Abstract: Captured vocals may be automatically transformed using advanced digital signal processing techniques that provide captivating applications, and even purpose-built devices, in which mere novice user-musicians may generate, audibly render and share musical performances. In some cases, the automated transformations allow spoken vocals to be segmented, arranged, temporally aligned with a target rhythm, meter or accompanying backing tracks and pitch corrected in accord with a score or note sequence. Speech-to-song music applications are one such example. In some cases, spoken vocals may be transformed in accord with musical genres such as rap using automated segmentation and temporal alignment techniques, often without pitch correction. Such applications, which may employ different signal processing and different automated transformations, may nonetheless be understood as speech-to-rap variations on the theme.