-
公开(公告)号:US20240104842A1
公开(公告)日:2024-03-28
申请号:US18472653
申请日:2023-09-22
Applicant: NVIDIA Corporation
Inventor: Koki Nagano , Alexander Trevithick , Chao Liu , Eric Ryan Chan , Sameh Khamis , Michael Stengel , Zhiding Yu
IPC: G06T17/00 , G06T5/20 , G06T7/70 , G06T7/90 , G06V10/771
CPC classification number: G06T17/00 , G06T5/20 , G06T7/70 , G06T7/90 , G06V10/771 , G06T2207/10024
Abstract: A method for generating, by an encoder-based model, a three-dimensional (3D) representation of a two-dimensional (2D) image is provided. The encoder-based model is trained to infer the 3D representation using a synthetic training data set generated by a pre-trained model. The pre-trained model is a 3D generative model that produces a 3D representation and a corresponding 2D rendering, which can be used to train a separate encoder-based model for downstream tasks like estimating a triplane representation, neural radiance field, mesh, depth map, 3D key points, or the like, given a single input image, using the pseudo ground truth 3D synthetic training data set. In a particular embodiment, the encoder-based model is trained to predict a triplane representation of the input image, which can then be rendered by a volume renderer according to pose information to generate an output image of the 3D scene from the corresponding viewpoint.
-
公开(公告)号:US20240223991A1
公开(公告)日:2024-07-04
申请号:US18147915
申请日:2022-12-29
Applicant: NVIDIA Corporation
Inventor: Michael Stengel , Ward Lopes , Joohwan Kim , David Luebke
Abstract: The disclosure provides a method for audio calibration that uses audio simulation and reconstructed surface information from images or video recordings along with recorded sound. The surface component of the method introduces knowledge that enables audio wave propagation simulation for a particular location. Using the simulation results the sound distribution can be optimized. For example, unwanted audio reflection and occlusion can be recognized and resolved. In one example, the disclosure provides a method for improving acoustics at a location that includes: (1) generating a geometric model of a location using visual data obtained from the location, wherein the location includes an audio system, and (2) simulating, using the geometric model, movement of sound waves in the location that originate from the audio system. The disclosure also provides a computer system, a computer program product, and a mobile computing device that include features for improving acoustics at a location.
-
公开(公告)号:US20230251508A1
公开(公告)日:2023-08-10
申请号:US18131802
申请日:2023-04-06
Applicant: NVIDIA Corporation
Inventor: Jonghyun Kim , Benjamin Boudaoud , Michael Stengel , Josef Bo Spjut , Morgan Samuel McGuire
CPC classification number: G02C9/00 , G02B27/0176 , G02B2027/0178 , G02C2200/02
Abstract: In an embodiment, a modular augmented reality display is provided that incorporates prescription eyewear that can be used separately by the wearer. In an embodiment, an image is generated from a removable display attached to the eyewear and directed into the edge of a prescription lens, which acts as a waveguide. The image is internally reflected within the prescription lens, and is directed to the wearer by an image combiner embedded within the prescription lens. In an embodiment, the augmented reality display includes a wearable belt pouch that includes a battery and support electronics connected to the eyewear so that the weight on the eyewear is reduced.
-
公开(公告)号:US20220028158A1
公开(公告)日:2022-01-27
申请号:US17177011
申请日:2021-02-16
Applicant: NVIDIA Corporation
Inventor: Michael Stengel , Alexander Majercik , Ben Boudaoud , Morgan McGuire
Abstract: A remote device utilizes ray tracing to compute a light field for a scene to be rendered, where the light field includes information about light reflected off surfaces within the scene. This light field is then compressed utilizing one or more video compression techniques that implement temporal reuse, such that only differences between the light field for the scene and a light field for a previous scene are compressed. The compressed light field data is then sent to a client device that decompresses the light field data and uses such data to obtain the light field for the scene at the client device. This light field is then used by the client device to compute global illumination for the scene. The global illumination may be used to accurately render the scene at the mobile device, resulting in a realistic scene that is presented by the mobile device.
-
公开(公告)号:US20210181533A1
公开(公告)日:2021-06-17
申请号:US16711228
申请日:2019-12-11
Applicant: NVIDIA Corporation
Inventor: Jonghyun Kim , Benjamin Boudaoud , Michael Stengel , Josef Bo Spjut , Morgan Samuel McGuire
Abstract: In an embodiment, a modular augmented reality display is provided that incorporates prescription eyewear that can be used separately by the wearer. In an embodiment, an image is generated from a removable display attached to the eyewear and directed into the edge of a prescription lens, which acts as a waveguide. The image is internally reflected within the prescription lens, and is directed to the wearer by an image combiner embedded within the prescription lens. In an embodiment, the augmented reality display includes a wearable belt pouch that includes a battery and support electronics connected to the eyewear so that the weight on the eyewear is reduced.
-
公开(公告)号:US20240119664A1
公开(公告)日:2024-04-11
申请号:US18545911
申请日:2023-12-19
Applicant: NVIDIA Corporation
Inventor: Michael Stengel , Alexander Majercik , Ben Boudaoud , Morgan McGuire
IPC: G06T15/50 , G06T15/04 , G06T15/06 , H04L67/131 , H04N19/46
CPC classification number: G06T15/506 , G06T15/04 , G06T15/06 , H04L67/131 , H04N19/46
Abstract: A remote device utilizes ray tracing to compute a light field for a scene to be rendered, where the light field includes information about light reflected off surfaces within the scene. This light field is then compressed utilizing one or more video compression techniques that implement temporal reuse, such that only differences between the light field for the scene and a light field for a previous scene are compressed. The compressed light field data is then sent to a client device that decompresses the light field data and uses such data to obtain the light field for the scene at the client device. This light field is then used by the client device to compute global illumination for the scene. The global illumination may be used to accurately render the scene at the mobile device, resulting in a realistic scene that is presented by the mobile device.
-
公开(公告)号:US20220284621A1
公开(公告)日:2022-09-08
申请号:US17734441
申请日:2022-05-02
Applicant: NVIDIA Corporation
Inventor: Joohwan Kim , Michael Stengel , Zander Majercik , Shalini De Mello , Samuli Laine , Morgan McGuire , David Luebke
Abstract: One embodiment of a method includes calculating one or more activation values of one or more neural networks trained to infer eye gaze information based, at least in part, on eye position of one or more images of one or more faces indicated by an infrared light reflection from the one or more images.
-
公开(公告)号:US20220191638A1
公开(公告)日:2022-06-16
申请号:US17191313
申请日:2021-03-03
Applicant: NVIDIA Corporation
Inventor: Michael Stengel , Jan Kautz , David Patrick Luebke , Morgan Samuel McGuire
Abstract: Apparatuses, systems, and techniques to determine head poses of users and provide audio for the users. In at least one embodiment, a head pose is determined based, at least in part, on camera frame information, and an audio signal is generated, based at least in part, on the determined head pose.
-
公开(公告)号:US20250147344A1
公开(公告)日:2025-05-08
申请号:US19017064
申请日:2025-01-10
Applicant: NVIDIA Corporation
Inventor: Jonghyun Kim , Benjamin Boudaoud , Michael Stengel , Josef Bo Spjut , Morgan Samuel McGuire
Abstract: In an embodiment, a modular augmented reality display is provided that incorporates prescription eyewear that can be used separately by the wearer. In an embodiment, an image is generated from a removable display attached to the eyewear and directed into the edge of a prescription lens, which acts as a waveguide. The image is internally reflected within the prescription lens, and is directed to the wearer by an image combiner embedded within the prescription lens. In an embodiment, the augmented reality display includes a wearable belt pouch that includes a battery and support electronics connected to the eyewear so that the weight on the eyewear is reduced.
-
公开(公告)号:US12248203B2
公开(公告)日:2025-03-11
申请号:US18131802
申请日:2023-04-06
Applicant: NVIDIA Corporation
Inventor: Jonghyun Kim , Benjamin Boudaoud , Michael Stengel , Josef Bo Spjut , Morgan Samuel McGuire
Abstract: In an embodiment, a modular augmented reality display is provided that incorporates prescription eyewear that can be used separately by the wearer. In an embodiment, an image is generated from a removable display attached to the eyewear and directed into the edge of a prescription lens, which acts as a waveguide. The image is internally reflected within the prescription lens, and is directed to the wearer by an image combiner embedded within the prescription lens. In an embodiment, the augmented reality display includes a wearable belt pouch that includes a battery and support electronics connected to the eyewear so that the weight on the eyewear is reduced.
-
-
-
-
-
-
-
-
-