NEURAL NETWORKS FOR CHANGING CHARACTERISTICS OF VOCALS

    公开(公告)号:US20220319534A1

    公开(公告)日:2022-10-06

    申请号:US17218684

    申请日:2021-03-31

    IPC分类号: G10L25/51 G10L15/16 G10L15/26

    摘要: A messaging system for audio character type swapping. Methods of audio character type swapping include receiving input audio data having a first characteristic and transforming the input audio data to an input image where the input image represents the frequencies and intensities of the audio. The methods further include processing the input image using a convolutional neural network (CNN) to generate an output image and transforming the output image to output audio data, the output audio data having a second characteristic. The input audio and output audio may include vocals. The first characteristics may indicate a male voice and the second characteristics may indicate a female voice. The CNN is trained together with another CNN that changes input audio having the second characteristic to audio having the first characteristic. The CNNs are trained using discriminator CNNs that determine whether audio has a first characteristic or a second characteristic.

    MUSIC REACTIVE ANIMATION OF HUMAN CHARACTERS

    公开(公告)号:US20220101586A1

    公开(公告)日:2022-03-31

    申请号:US17487558

    申请日:2021-09-28

    摘要: Example methods for generating an animated character in dance poses to music may include generating, by at least one processor, a music input signal based on an acoustic signal associated with the music, and receiving, by the at least one processor, a model output signal from an encoding neural network. A current generated pose data is generated using a decoding neural network, the current generated pose data being based on previous generated pose data of a previous generated pose, the music input signal, and the model output signal. An animated character is generated based on a current generated pose data; and the animated character caused to be displayed by a display device.

    NEURAL NETWORKS FOR ACCOMPANIMENT EXTRACTION FROM SONGS

    公开(公告)号:US20220318566A1

    公开(公告)日:2022-10-06

    申请号:US17217139

    申请日:2021-03-30

    摘要: A messaging system that extracts accompaniment portions from songs. Methods of accompaniment extraction from songs includes receiving an input song that includes a vocal portion and an accompaniment portion, transforming the input song to an input image, where the input image represents the frequencies and intensities of the input song, processing the input image using a convolutional neural network (CNN) to generate an output image, and transforming the output image to an output accompaniment, where the output accompaniment includes the accompaniment of the input song.