公开(公告)号：US11935556B2

公开(公告)日：2024-03-19

申请号：US17218684

申请日：2021-03-31

Applicant: Snap Inc.

Inventor： Gurunandan Krishnan Gorumkonda

IPC: G10L25/51 ,  G10L15/16 ,  G10L15/26

CPC classification number: G10L25/51 ,  G10L15/16 ,  G10L15/26

Abstract: A messaging system for audio character type swapping. Methods of audio character type swapping include receiving input audio data having a first characteristic and transforming the input audio data to an input image where the input image represents the frequencies and intensities of the audio. The methods further include processing the input image using a convolutional neural network (CNN) to generate an output image and transforming the output image to output audio data, the output audio data having a second characteristic. The input audio and output audio may include vocals. The first characteristics may indicate a male voice and the second characteristics may indicate a female voice. The CNN is trained together with another CNN that changes input audio having the second characteristic to audio having the first characteristic. The CNNs are trained using discriminator CNNs that determine whether audio has a first characteristic or a second characteristic.

公开(公告)号：US11816773B2

公开(公告)日：2023-11-14

申请号：US17487558

申请日：2021-09-28

Applicant: Snap Inc.

Inventor： Gurunandan Krishnan Gorumkonda ,  Hsin-Ying Lee ,  Jie Xu

IPC: G06T13/20 ,  G06N3/08 ,  G06T13/40 ,  G06T13/80 ,  G06N3/044 ,  G06N3/045

CPC classification number: G06T13/205 ,  G06N3/044 ,  G06N3/045 ,  G06N3/08 ,  G06T13/40 ,  G06T13/80 ,  G10H2210/031

Abstract: Example methods for generating an animated character in dance poses to music may include generating, by at least one processor, a music input signal based on an acoustic signal associated with the music, and receiving, by the at least one processor, a model output signal from an encoding neural network. A current generated pose data is generated using a decoding neural network, the current generated pose data being based on previous generated pose data of a previous generated pose, the music input signal, and the model output signal. An animated character is generated based on a current generated pose data; and the animated character caused to be displayed by a display device.

公开(公告)号：US11810236B2

公开(公告)日：2023-11-07

申请号：US17350975

申请日：2021-06-17

Applicant: Snap Inc.

Inventor： Gurunandan Krishnan Gorumkonda ,  Shree K. Nayar

IPC: G06T13/80 ,  G10L21/055

CPC classification number: G06T13/80 ,  G10L21/055

Abstract: Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.

公开(公告)号：US11670027B2

公开(公告)日：2023-06-06

申请号：US17526540

申请日：2021-11-15

Applicant: Snap Inc.

Inventor： Gurunandan Krishnan Gorumkonda ,  Shree K. Nayar

IPC: G06T13/20 ,  G06T7/246 ,  G06T13/80 ,  G06T13/40

CPC classification number: G06T13/205 ,  G06T7/246 ,  G06T13/40 ,  G06T13/80

Abstract: Methods, devices, media, and other embodiments are described for generating, modifying, and outputting pseudorandom animations that can be synchronized to audio data. In one embodiment, a computer animation model made up of comprising one or more control points is accessed by one or more processors, which associate motion patterns with a first control point of the one or more control points, and associate one or more speed harmonics with the first control point. A set of motion states is identify with a motion state for the combinations of possibilities, and a probability value is assigned to each motion state of the set of motion states. The probability value can be used to probabilistically determine a particular motion state to be part of displayed animation for the computer animation model.

公开(公告)号：US11348297B2

公开(公告)日：2022-05-31

申请号：US16588412

申请日：2019-09-30

Applicant: Snap Inc.

Inventor： Gurunandan Krishnan Gorumkonda ,  Shree K. Nayar

IPC: G06T13/20 ,  G06T7/246 ,  G06T13/40 ,  G06T13/80

Abstract: Methods, devices, media, and other embodiments are described for a state-space system for pseudorandom animation. In one embodiment animation elements within a computer model are identified, and for each animation element motion patterns and speed harmonics are identified. A set of motion data values comprising a state-space description of the motion patterns and the speed harmonics are generated, and a probability assigned to each value of the set of motion data values for the state-space description. The probability can then be used to select and update a particular motion used in an animation generated from the computer model.

公开(公告)号：US20220148246A1

公开(公告)日：2022-05-12

申请号：US17526540

申请日：2021-11-15

Applicant: Snap Inc.

Inventor： Gurunandan Krishnan Gorumkonda ,  Shree K. Nayar

IPC: G06T13/20 ,  G06T7/246 ,  G06T13/80 ,  G06T13/40

Abstract: Methods, devices, media, and other embodiments are described for generating, modifying, and outputting pseudorandom animations that can be synchronized to audio data. In one embodiment, a computer animation model made up of comprising one or more control points is accessed by one or more processors, which associate motion patterns with a first control point of the one or more control points, and associate one or more speed harmonics with the first control point. A set of motion states is identify with a motion state for the combinations of possibilities, and a probability value is assigned to each motion state of the set of motion states. The probability value can be used to probabilistically determine a particular motion state to be part of displayed animation for the computer animation model.

公开(公告)号：US11222455B2

公开(公告)日：2022-01-11

申请号：US16588373

申请日：2019-09-30

Applicant: Snap Inc.

Inventor： Gurunandan Krishnan Gorumkonda ,  Shree K. Nayar

IPC: G06T13/80 ,  G10L21/055

Abstract: Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.

公开(公告)号：US20210097746A1

公开(公告)日：2021-04-01

申请号：US16588373

申请日：2019-09-30

Applicant: Snap Inc.

Inventor： Gurunandan Krishnan Gorumkonda ,  Shree K. Nayar

IPC: G06T13/80 ,  G10L21/055

Abstract: Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.

公开(公告)号：US20210097743A1

公开(公告)日：2021-04-01

申请号：US16588412

申请日：2019-09-30

Applicant: Snap Inc.

Inventor： Gurunandan Krishnan Gorumkonda ,  Shree K. Nayar

IPC: G06T13/20 ,  G06T13/80 ,  G06T13/40 ,  G06T7/246

Abstract: Methods, devices, media, and other embodiments are described for a state-space system for pseudorandom animation. In one embodiment animation elements within a computer model are identified, and for each animation element motion patterns and speed harmonics are identified. A set of motion data values comprising a state-space description of the motion patterns and the speed harmonics are generated, and a probability assigned to each value of the set of motion data values for the state-space description. The probability can then be used to select and update a particular motion used in an animation generated from the computer model.