公开(公告)号：US20230282188A1

公开(公告)日：2023-09-07

申请号：US17688382

申请日：2022-03-07

Applicant: Lemon Inc.

Inventor： Bochen Li ,  Rodrigo Castellon ,  Daiyu Zhang ,  Jitong Chen

IPC: G10H1/00 ,  G10L25/18 ,  G10L25/30

CPC classification number: G10H1/0008 ,  G10H1/0066 ,  G10L25/18 ,  G10L25/30 ,  G10H2250/311 ,  G10H2210/005 ,  G10H2210/086 ,  G10H2210/056

Abstract: Methods, systems, and storage media for generating a beatbox transcript are disclosed. Some examples may include: receiving an audio signal having a plurality of beatbox sounds, generating a spectrogram of the audio signal, processing the spectrogram of the audio signal with a neural network model trained on training samples including beatbox sounds, generating, by the neural network model a beatbox sound activation map including a plurality of activation times for a plurality of beatbox sounds, decoding the beatbox sound activation map into a beatbox transcript and providing the beatbox transcript as an output.

公开(公告)号：US12040000B2

公开(公告)日：2024-07-16

申请号：US18366478

申请日：2023-08-07

Applicant: Lemon Inc.

Inventor： Chenyu Sun ,  Jitong Chen ,  Nathanael Schager ,  Maryyann Crichton ,  Josiah John Serrano ,  Bochen Li ,  Xuefan Hu ,  Fraser Smith ,  Hwankyoo Shawn Kim ,  David Trevelyan ,  Suiyu Feng ,  Brandon Wu ,  Tao Xiong

IPC: G11B27/031 ,  G06F3/04847 ,  G06F3/0488 ,  G11B27/00 ,  G06F3/16

CPC classification number: G11B27/031 ,  G06F3/04847 ,  G06F3/0488 ,  G11B27/007 ,  G06F3/165

Abstract: The present application provides a special effect processing method and apparatus. The method includes: generating an audio signal in response to a touch operation of a user in a process of playing a video; segmenting the audio signal into multiple audio frames; performing, according to attributes of the audio frames, special effect processing on a picture which is currently played in the video.

公开(公告)号：US20230197040A1

公开(公告)日：2023-06-22

申请号：US17556178

申请日：2021-12-20

Applicant: Lemon Inc.

Inventor： Bochen Li ,  Daiyu Zhang ,  Shawn Chan Zhen Yi ,  Jitong Chen

IPC: G10H1/00 ,  G06V40/16 ,  G06V40/20

CPC classification number: G10H1/0008 ,  G06V40/174 ,  G06V40/20 ,  G10H2250/311 ,  G10H2210/325 ,  G10H2210/571 ,  G10H2220/106 ,  G10H2220/201 ,  G10H2220/455 ,  G10H2210/105

Abstract: A method for generating an audio output is described. Image inputs of interactive movements by a user captured by an image sensor are received. The interactive movements are mapped to a sequence of audio element identifiers. The sequence of audio element identifiers are processed to generate a musical sequence by performing music theory rule enforcement on the sequence of audio element identifiers. An audio output that represents the musical sequence is generated.

公开(公告)号：US11763849B1

公开(公告)日：2023-09-19

申请号：US17815402

申请日：2022-07-27

Applicant: Lemon Inc.

Inventor： Zhihao Ouyang ,  Daiyu Zhang ,  Bochen Li ,  Baoman Liu ,  Liuqing Yang

IPC: G11B27/031 ,  G06V20/40

CPC classification number: G11B27/031 ,  G06V20/46

Abstract: The present disclosure describes techniques for automatically and fast generating music for videos. The techniques comprise receiving a video from a user. The video may comprise a plurality of segments of frames. Information may be extracted from the video, wherein the extracted information comprises information indicating motion speed in the video, information indicating motion saliency in the video, information indicating scene transition in the video, and timing information associated with the video. A plurality of sets of music notes matching the plurality of segments of frames may be generated based at least in part on the extracted information. A plurality of vectors corresponding to the plurality of sets of music notes may be generated. The plurality of pieces of music audio corresponding to the plurality of segments of frames may be generated based at least in part on the plurality of vectors.