公开(公告)号：US20170125057A1

公开(公告)日：2017-05-04

申请号：US15284229

申请日：2016-10-03

Applicant: SMULE, INC.

Inventor： Parag P. Chordia ,  Perry R. Cook ,  Mark T. Godfrey ,  Prerna Gupta ,  Nicholas M. Kruge ,  Randal J. Leistikow ,  Alexander M.D. Rae ,  Ian S. Simon

IPC: G11B27/031 ,  G10H1/38 ,  G10H1/00 ,  G10L21/055

CPC classification number: G11B27/031 ,  G06F3/0482 ,  G06F3/04842 ,  G10H1/0025 ,  G10H1/383 ,  G10H2210/576 ,  G10L21/003 ,  G10L21/013 ,  G10L21/055 ,  H04N21/41407 ,  H04N21/854

Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a computing pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.

公开(公告)号：US20170123755A1

公开(公告)日：2017-05-04

申请号：US15337891

申请日：2016-10-28

Applicant: SMULE, INC.

Inventor： Benjamin Hersh ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

IPC: G06F3/16 ,  G06F3/041 ,  G10L21/007

CPC classification number: G06F3/165 ,  G06F1/1694 ,  G06F3/017 ,  G06F3/167 ,  G10H1/361 ,  G10H1/366 ,  G10H1/368 ,  G10H2210/331 ,  G10H2220/455 ,  G10H2230/015 ,  G10H2240/175 ,  G10H2240/251 ,  G10L21/013 ,  G10L25/57 ,  H04M1/7253 ,  H04M1/72558 ,  H04R3/005 ,  H04R2420/07 ,  H04R2499/11 ,  H04S2400/15

Abstract: Embodiments described herein relate generally to systems comprising a display device, a display device-coupled computing platform, a mobile device in communication with the computing platform, and a content server in which methods and techniques of capture and/or processing of audiovisual performances are described and, in particular, description of techniques suitable for use in connection with display device connected computing platforms for rendering vocal performance captured by a handheld computing device.

公开(公告)号：US09601127B2

公开(公告)日：2017-03-21

申请号：US13960564

申请日：2013-08-06

Applicant: Smule, Inc.

Inventor： Jeannie Yang ,  Nicholas M. Kruge ,  Gregory C. Thompson ,  Perry R. Cook

IPC: G10L21/00 ,  G10L21/013 ,  G10H1/36

CPC classification number: G10H1/366 ,  G10H2210/066 ,  G10H2210/331 ,  G10H2220/096 ,  G10H2240/251 ,  G10L21/013

Abstract: Vocal musical performances may be captured and, in some cases or embodiments, pitch-corrected and/or processed in accord with a user selectable vocal effects schedule for mixing and rendering with backing tracks in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track. Such performances can be pitch-corrected in real-time at the mobile device in accord with pitch correction settings. Vocal effects schedules may also be selectively applied to such performances. In these ways, even amateur user/performers with imperfect pitch are encouraged to take a shot at “stardom” and/or take part in a game play, social network or vocal achievement application architecture that facilitates musical collaboration on a global scale and/or, in some cases or embodiments, to initiate revenue generating in-application transactions.

公开(公告)号：US20170011724A1

公开(公告)日：2017-01-12

申请号：US15275807

申请日：2016-09-26

Applicant: SMULE, INC.

Inventor： Perry R. Cook ,  Jeannie Yang ,  Yar Woo ,  John Shimmin ,  Randal Leistikow ,  Michael Berger ,  Jeff Smith

IPC: G10H1/32 ,  G10H1/00

CPC classification number: G10H1/0016 ,  G10H1/368 ,  G10H1/38 ,  G10H2210/091 ,  G10H2210/201 ,  G10H2210/225 ,  G10H2220/096 ,  G10H2220/241 ,  G10H2220/355 ,  G10H2220/395

Abstract: Notwithstanding practical limitations imposed by mobile device platforms and applications, truly captivating musical instruments may be synthesized in ways that allow musically expressive performances to be captured and rendered in real-time. Synthetic musical instruments that provide a game, grading or instructional mode are described in which one or more qualities of a user's performance are assessed relative to a musical score. By providing a range of modes (from score-assisted to fully user-expressive), user interactions with synthetic musical instruments are made more engaging and tend to capture user interest over generally longer periods of time. Synthetic musical instruments are described in which force dynamics of user gestures (such as finger contact forces applied to a multi-touch sensitive display or surface and/or the temporal extent and applied pressure of sustained contact thereon) are captured and drive the digital synthesis in ways that enhance expressiveness of user performances.

Abstract translation: 尽管移动设备平台和应用程序的实际限制，真正迷人的乐器可能会以允许音乐表现性能被实时捕获和渲染的方式进行合成。 描述提供游戏，分级或教学模式的合成乐器，其中评估用户演奏的一个或多个质量相对于乐谱。 通过提供一系列模式（从分数辅助到完全用户表达），与合成乐器的用户交互更加引人入胜，并且倾向于在一般较长的时间段内捕获用户兴趣。 描述了合成乐器，其中捕获用户手势的力动力学（诸如施加到多触摸敏感显示器或表面上的手指接触力和/或其持续接触的时间范围和施加压力）并且驱动数字合成 增强用户表现力的方式。

公开(公告)号：US09459768B2

公开(公告)日：2016-10-04

申请号：US14104618

申请日：2013-12-12

Applicant: Smule, Inc.

Inventor： Parag P. Chordia ,  Perry R. Cook ,  Mark T. Godfrey ,  Prerna Gupta ,  Nicholas M. Kruge ,  Randal J. Leistikow ,  Alexander M. D. Rae ,  Ian S. Simon

IPC: G10L21/04 ,  G10L21/055 ,  H04N21/854 ,  G06F3/0482 ,  G06F3/0484 ,  G10L21/003 ,  G10L21/013 ,  H04N21/414

CPC classification number: G11B27/031 ,  G06F3/0482 ,  G06F3/04842 ,  G10H1/0025 ,  G10H1/383 ,  G10H2210/576 ,  G10L21/003 ,  G10L21/013 ,  G10L21/055 ,  H04N21/41407 ,  H04N21/854

Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a computing pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.

Abstract translation: 应用协调的音频和视频过滤器对来增强视听表演的艺术和情感内容。 当应用在便携式计算设备（例如移动电话或媒体播放器，计算板或平板电脑，游戏控制器或个人数字助理或书籍阅读器）上的视听应用的音频和视频处理流水线中时，这种滤波器对， 可以允许用户选择增强与其协调的音频和视频的效果。 通过使用可在处理器上执行的数字信号处理软件和使用设备的存储，扬声器和显示设备或与设备互操作的数字信号处理软件，使用摄像机和麦克风接口在便携式计算设备处捕获，过滤和呈现协调的音频和视频。 通过在亲密手持设备上提供视听拍摄和个性化，现代社交网络平台流行的类型的社交互动和发布现在可以扩展到视听内容。

公开(公告)号：US20150381290A1

公开(公告)日：2015-12-31

申请号：US14752283

申请日：2015-06-26

Applicant: Smule, Inc.

Inventor： Perry R. Cook

IPC: H04B11/00 ,  H04W76/02 ,  H04M1/725

CPC classification number: H04B11/00 ,  G06F3/16 ,  G10L19/018 ,  H04M1/72527 ,  H04M1/7253 ,  H04W76/14

Abstract: Techniques have been developed for transmitting and receiving information conveyed through the air from one portable device to another as a generally unperceivable coding within an otherwise recognizable acoustic signal. For example, in some embodiments in accordance with the present invention(s), information is acoustically communicated from a first handheld device toward a second by encoding the information in a signal that, when converted into acoustic energy at an acoustic transducer of the first handheld device, is characterized in that the acoustic energy is discernable to a human ear yet the encoding of the information therein is generally not perceivable by the human. The acoustic energy is transmitted from the acoustic transducer of the first handheld device toward the second handheld device across an air gap that constitutes a substantially entirety of the distance between the devices. Acoustic energy received at the second handheld device may then be processed using signal processing techniques tailored to detection of the particular information encodings employed.

Abstract translation: 已经开发了用于将通过空气传送的信息从一个便携式设备发送到另一个的技术，作为在另外可识别的声学信号中的通常不可理解的编码。 例如，在根据本发明的一些实施例中，通过对信号进行编码来将信息从第一手持设备传播到第二手持设备，当信号被转换成第一手持设备的声换能器时的声能时 装置的特征在于，声能量可以被人耳识别，但是其中的信息的编码通常不被人感知。 声能从第一手持装置的声换能器朝向第二手持装置穿过构成装置之间基本上整个距离的气隙传送。 然后可以使用针对所采用的特定信息编码进行定制的信号处理技术来处理在第二手持设备处接收的声能。

公开(公告)号：US20130339035A1

公开(公告)日：2013-12-19

申请号：US13910949

申请日：2013-06-05

Applicant: Smule, Inc.

Inventor： Parag Chordia ,  Mark Godfrey ,  Alexander Rae ,  Prerna Gupta ,  Perry R. Cook

IPC: G10L19/00

CPC classification number: G10L19/02 ,  G10H1/366 ,  G10H2210/051 ,  G10H2240/141 ,  G10H2250/235 ,  G10L19/00 ,  G10L21/055

Abstract: Captured vocals may be automatically transformed using advanced digital signal processing techniques that provide captivating applications, and even purpose-built devices, in which mere novice user-musicians may generate, audibly render and share musical performances. In some cases, the automated transformations allow spoken vocals to be segmented, arranged, temporally aligned with a target rhythm, meter or accompanying backing tracks and pitch corrected in accord with a score or note sequence. Speech-to-song music applications are one such example. In some cases, spoken vocals may be transformed in accord with musical genres such as rap using automated segmentation and temporal alignment techniques, often without pitch correction. Such applications, which may employ different signal processing and different automated transformations, may nonetheless be understood as speech-to-rap variations on the theme.

Abstract translation: 可以使用提供令人兴奋的应用程序的高级数字信号处理技术来自动转换捕获的声乐，甚至专门设计的设备，其中只有新手的用户音乐家可以产生，可听地呈现和共享音乐表演。 在某些情况下，自动转换允许口头声乐被分段，排列，暂时地与目标节奏，表或伴奏背景轨道和音调相一致地按照得分或音符序列校正。 歌曲到歌曲的音乐应用程序就是这样一个例子。 在某些情况下，口语可以根据音乐类型（例如使用自动分割和时间对准技术，通常不进行音高校正）进行转换。 可能采用不同信号处理和不同自动化转换的这种应用可能被理解为主题上的讲话到说唱变体。