-
公开(公告)号:US20240144569A1
公开(公告)日:2024-05-02
申请号:US18491563
申请日:2023-10-20
Applicant: Snap Inc.
Inventor: Gurunandan Krishnan Gorumkonda
CPC classification number: G06T13/205 , G06T7/0002 , G06T7/70 , G06T13/40 , G06T13/80 , G06T2207/10016 , G06T2207/20084 , G06T2207/30196
Abstract: Method of generating a real-time avatar animation using danceability scores starts with a processor receiving a real-time acoustic signal comprising acoustic segments. The processor generates using a danceability neural network a danceability score for each of the acoustic segments. The processor generates a real-time animation of a first avatar and a second avatar based on the danceability score and avatar characteristics associated with the first avatar and the second avatar. The processor causes to be displayed on a first client device the real-time animation of the first avatar and the second avatar. Other embodiments are described herein.
-
公开(公告)号:US20240054709A1
公开(公告)日:2024-02-15
申请号:US18482634
申请日:2023-10-06
Applicant: Snap Inc.
Inventor: Gurunandan Krishnan Gorumkonda , Hsin-Ying Lee , Jie Xu
CPC classification number: G06T13/205 , G06N3/08 , G06T13/40 , G06T13/80 , G06N3/044 , G06N3/045 , G10H2210/031
Abstract: Example methods for generating an animated character in dance poses to music may include generating, by at least one processor, a music input signal based on an acoustic signal associated with the music, and receiving, by the at least one processor, a model output signal from an encoding neural network. A current generated pose data is generated using a decoding neural network, the current generated pose data being based on previous generated pose data of a previous generated pose, the music input signal, and the model output signal. An animated character is generated based on a current generated pose data; and the animated character caused to be displayed by a display device.
-
公开(公告)号:US20240013467A1
公开(公告)日:2024-01-11
申请号:US18371356
申请日:2023-09-21
Applicant: Snap Inc.
Inventor: Gurunandan Krishnan Gorumkonda , Shree K. Nayar
IPC: G06T13/80 , G10L21/055
CPC classification number: G06T13/80 , G10L21/055
Abstract: Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.
-
公开(公告)号:US11176723B2
公开(公告)日:2021-11-16
申请号:US16588446
申请日:2019-09-30
Applicant: Snap Inc.
Inventor: Gurunandan Krishnan Gorumkonda , Shree K. Nayar
Abstract: Methods, devices, media, and other embodiments are described for generating, modifying, and outputting pseudorandom animations that can be synchronized to audio data. In one embodiment, a computer animation model made up of comprising one or more control points is accessed by one or more processors, which associate motion patterns with a first control point of the one or more control points, and associate one or more speed harmonics with the first control point. A set of motion states is identify with a motion state for the combinations of possibilities, and a probability value is assigned to each motion state of the set of motion states. The probability value can be used to probabilistically determine a particular motion state to be part of displayed animation for the computer animation model.
-
公开(公告)号:US20210312682A1
公开(公告)日:2021-10-07
申请号:US17350954
申请日:2021-06-17
Applicant: Snap Inc.
Inventor: Gurunandan Krishnan Gorumkonda , Shree K. Nayar
Abstract: Methods, devices, media, and other embodiments are described for generating pseudorandom animations matched to audio data on a device. In one embodiment a video is generated and output on a display of the device using a computer animation model. Audio is detected from a microphone of the device, and the audio data is processed to determine a set of audio characteristics for the audio data received at the microphone of the device. A first motion state is randomly selected from the plurality of motion states, one or more motion values of the first motion state are generated using the set of audio characteristics, and the video is updated using the one or more motion values with the computer animation model to create an animated action within the video.
-
公开(公告)号:US11074739B2
公开(公告)日:2021-07-27
申请号:US16588373
申请日:2019-09-30
Applicant: Snap Inc.
Inventor: Gurunandan Krishnan Gorumkonda , Shree K. Nayar
IPC: G06T13/80 , G10L21/055
Abstract: Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.
-
公开(公告)号:US11069111B2
公开(公告)日:2021-07-20
申请号:US16588329
申请日:2019-09-30
Applicant: Snap Inc.
Inventor: Gurunandan Krishnan Gorumkonda , Shree K. Nayar
Abstract: Methods, devices, media, and other embodiments are described for generating pseudorandom animations matched to audio data on a device. In one embodiment a video is generated and output on a display of the device using a computer animation model. Audio is detected from a microphone of the device, and the audio data is processed to determine a set of audio characteristics for the audio data received at the microphone of the device. A first motion state is randomly selected from the plurality of motion states, one or more motion values of the first motion state are generated using the set of audio characteristics, and the video is updated using the one or more motion values with the computer animation model to create an animated action within the video.
-
公开(公告)号:US12299793B2
公开(公告)日:2025-05-13
申请号:US18306732
申请日:2023-04-25
Applicant: Snap Inc.
Inventor: Gurunandan Krishnan Gorumkonda , Shree K. Nayar
Abstract: Methods, devices, media, and other embodiments are described for generating, modifying, and outputting pseudorandom animations that can be synchronized to audio data. In one embodiment, a computer animation model made up of comprising one or more control points is accessed by one or more processors, which associate motion patterns with a first control point of the one or more control points, and associate one or more speed harmonics with the first control point. A set of motion states is identify with a motion state for the combinations of possibilities, and a probability value is assigned to each motion state of the set of motion states. The probability value can be used to probabilistically determine a particular motion state to be part of displayed animation for the computer animation model.
-
公开(公告)号:US12175999B2
公开(公告)日:2024-12-24
申请号:US17559854
申请日:2021-12-22
Applicant: Snap Inc.
Inventor: Gurunandan Krishnan Gorumkonda , Shree K. Nayar
Abstract: An audio response system can generate multimodal messages that can be dynamically updated on viewer's client device based on a type of audio response detected. The audio responses can include keywords or continuum-based signal (e.g., levels of wind noise). A machine learning scheme can be trained to output classification data from the audio response data for content selection and dynamic display updates.
-
公开(公告)号:US20240126084A1
公开(公告)日:2024-04-18
申请号:US18299923
申请日:2023-04-13
Applicant: Snap Inc.
Inventor: Jian Wang , Sizhuo Ma , Brevin Tilmon , Yicheng Wu , Gurunandan Krishnan Gorumkonda , Ramzi Zahreddine , Georgios Evangelidis
CPC classification number: G02B27/0172 , G06F3/013 , G06T19/006 , G02B2027/0138
Abstract: An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.
-
-
-
-
-
-
-
-
-