-
公开(公告)号:US11809773B2
公开(公告)日:2023-11-07
申请号:US16890724
申请日:2020-06-02
Applicant: NVIDIA Corporation
Inventor: Ambrish Dantrey , Anshul Gupta
Abstract: A virtual reality (VR) audio rendering system and method include spatializing microphone-captured real-world sounds according to a VR setting. In a game streaming system, when a player speaks through a microphone, the voice is processed by geometrical acoustic (GA) simulation configured for a virtual scene, and thereby spatialized audio effects specific to the scene are added. The GA simulation may include generating an impulse response using sound propagation simulation and dynamic HRTF-based listener directivity. When the GA-processed voice of the player is played, the local player or other fellow players can hear it as if the sound travels in the scenery and according to the geometries in the virtual scene. This mechanism can advantageously place the players' chatting in the same virtual world like built-in game audio, thereby advantageously providing enhanced immersive VR experience to users.
-
公开(公告)号:US20200293273A1
公开(公告)日:2020-09-17
申请号:US16890724
申请日:2020-06-02
Applicant: NVIDIA Corporation
Inventor: Ambrish Dantrey , Anshul Gupta
Abstract: A virtual reality (VR) audio rendering system and method include spatializing microphone-captured real-world sounds according to a VR setting. In a game streaming system, when a player speaks through a microphone, the voice is processed by geometrical acoustic (GA) simulation configured for a virtual scene, and thereby spatialized audio effects specific to the scene are added. The GA simulation may include generating an impulse response using sound propagation simulation and dynamic HRTF-based listener directivity. When the GA-processed voice of the player is played, the local player or other fellow players can hear it as if the sound travels in the scenery and according to the geometries in the virtual scene. This mechanism can advantageously place the players' chatting in the same virtual world like built-in game audio, thereby advantageously providing enhanced immersive VR experience to users.
-
公开(公告)号:US10412529B1
公开(公告)日:2019-09-10
申请号:US16034203
申请日:2018-07-12
Applicant: NVIDIA CORPORATION
Inventor: Ambrish Dantrey , Anshul Gupta
Abstract: A virtual reality (VR) audio rendering system and method using pre-computed impulse responses (IRs) to generate audio frames in a VR setting for rendering. Based on a current position of a user or a VR object, a set of possible motions are predicted and a set of IRs are pre-computed by using a Geometric Acoustic (GA) model of a virtual scene. Once a position change is actually detected, one of the pre-computed IRs is selected and convolved with a set of audio frames to generate modified audio frames for rendering. As the modified audio frames are generated by using pre-computed IR without requiring intensive ray tracing computations, the audio latency can be significantly reduced.
-
公开(公告)号:US10705790B2
公开(公告)日:2020-07-07
申请号:US16183396
申请日:2018-11-07
Applicant: Nvidia Corporation
Inventor: Ambrish Dantrey , Anshul Gupta
Abstract: A virtual reality (VR) audio rendering system and method include spatializing microphone-captured real-world sounds according to a VR setting. In a game streaming system, when a player speaks through a microphone, the voice is processed by geometrical acoustic (GA) simulation configured for a virtual scene, and thereby spatialized audio effects specific to the scene are added. The GA simulation may include generating an impulse response using sound propagation simulation and dynamic HRTF-based listener directivity. When the GA-processed voice of the player is played, the local player or other fellow players can hear it as if the sound travels in the scenery and according to the geometries in the virtual scene. This mechanism can advantageously place the players' chatting in the same virtual world like built-in game audio, thereby advantageously providing enhanced immersive VR experience to users.
-
-
-