-
公开(公告)号:US20240355239A1
公开(公告)日:2024-10-24
申请号:US18638553
申请日:2024-04-17
申请人: Shree K. Nayar , Gurunandan Krishnan Gorumkonda , Jian Wang , Bing Zhou , Sizhuo Ma , Karl Bayer , Yicheng Wu
发明人: Shree K. Nayar , Gurunandan Krishnan Gorumkonda , Jian Wang , Bing Zhou , Sizhuo Ma , Karl Bayer , Yicheng Wu
CPC分类号: G09G3/001 , G06F3/013 , G06T3/60 , G06T5/60 , G06T2200/24 , G06T2207/20081 , G06T2207/30196 , G09G2340/0492 , G09G2354/00
摘要: An under-screen camera is provided. A camera is positioned behind a see-through display screen and positioned to capture scene image data of objects in front of the display screen. The camera captures scene image data of a real-world scene including a user. The scene image data is processed to remove artifacts in the scene image data created by capturing the scene image data through the see-through display screen such as blur, noise, backscatter, wiring effect, and the like.
-
公开(公告)号:US20240103610A1
公开(公告)日:2024-03-28
申请号:US18368427
申请日:2023-09-14
IPC分类号: G06F3/01 , G06F3/0346 , G06T17/00
CPC分类号: G06F3/012 , G06F3/0346 , G06T17/00
摘要: A pose tracking system is provided. The pose tracking system includes an EMF tracking system having a user-worn head-mounted EMF source and one or more user-worn EMF tracking sensors attached to the wrists of the user. The EMF source is associated with a VIO tracking system such as AR glasses or the like. The pose tracking system determines a pose of the user's head and a ground plane using the VIO tracking system and a pose of the user's hands using the EMF tracking system to determine a full-body pose for the user. Metal interference with the EMF tracking system is minimized using an IMU mounted with the EMF tracking sensors. Long term drift in the IMU and the VIO tracking system are minimized using the EMF tracking system.
-
公开(公告)号:US20240094824A1
公开(公告)日:2024-03-21
申请号:US18368358
申请日:2023-09-14
摘要: A finger gesture recognition system is provided. The finger gesture recognition system includes one or more audio sensors and one or more optic sensors. The finger gesture recognition system captures, using the one or more audio sensors, audio signal data of a finger gesture being made by a user, and captures, using the one or more optic sensors, optic signal data of the finger gesture. The finger gesture recognition system recognizes the finger gesture based on the audio signal data and the optic signal data and communicates finger gesture data of the recognized finger gesture to an Augmented Reality/Combined Reality/Virtual Reality (XR) application.
-
公开(公告)号:US20220319534A1
公开(公告)日:2022-10-06
申请号:US17218684
申请日:2021-03-31
摘要: A messaging system for audio character type swapping. Methods of audio character type swapping include receiving input audio data having a first characteristic and transforming the input audio data to an input image where the input image represents the frequencies and intensities of the audio. The methods further include processing the input image using a convolutional neural network (CNN) to generate an output image and transforming the output image to output audio data, the output audio data having a second characteristic. The input audio and output audio may include vocals. The first characteristics may indicate a male voice and the second characteristics may indicate a female voice. The CNN is trained together with another CNN that changes input audio having the second characteristic to audio having the first characteristic. The CNNs are trained using discriminator CNNs that determine whether audio has a first characteristic or a second characteristic.
-
公开(公告)号:US20220101586A1
公开(公告)日:2022-03-31
申请号:US17487558
申请日:2021-09-28
摘要: Example methods for generating an animated character in dance poses to music may include generating, by at least one processor, a music input signal based on an acoustic signal associated with the music, and receiving, by the at least one processor, a model output signal from an encoding neural network. A current generated pose data is generated using a decoding neural network, the current generated pose data being based on previous generated pose data of a previous generated pose, the music input signal, and the model output signal. An animated character is generated based on a current generated pose data; and the animated character caused to be displayed by a display device.
-
公开(公告)号:US20220318566A1
公开(公告)日:2022-10-06
申请号:US17217139
申请日:2021-03-30
摘要: A messaging system that extracts accompaniment portions from songs. Methods of accompaniment extraction from songs includes receiving an input song that includes a vocal portion and an accompaniment portion, transforming the input song to an input image, where the input image represents the frequencies and intensities of the input song, processing the input image using a convolutional neural network (CNN) to generate an output image, and transforming the output image to an output accompaniment, where the output accompaniment includes the accompaniment of the input song.
-
-
-
-
-