-
公开(公告)号:US20250095229A1
公开(公告)日:2025-03-20
申请号:US18397081
申请日:2023-12-27
Applicant: NVIDIA Corporation
Inventor: Yue Wang , Jiawei Yang , Boris Ivanovic , Xinshuo Weng , Or Litany , Danfei Xu , Seung Wook Kim , Sanja Fidler , Marco Pavone , Boyi Li , Tong Che
IPC: G06T11/00 , G06T17/00 , G06V10/44 , H04N13/279
Abstract: Apparatuses, systems, and techniques to generate an image of an environment. In at least one embodiment, one or more neural networks are used to identify one or more static and dynamic features of an environment to be used to generate a representation of the environment.
-
公开(公告)号:US12192547B2
公开(公告)日:2025-01-07
申请号:US18181729
申请日:2023-03-10
Applicant: NVIDIA Corporation
Inventor: Karsten Julian Kreis , Robin Rombach , Andreas Blattmann , Seung Wook Kim , Huan Ling , Sanja Fidler , Tim Dockhorn
Abstract: In various examples, systems and methods are disclosed relating to aligning images into frames of a first video using at least one first temporal attention layer of a neural network model. The first video has a first spatial resolution. A second video having a second spatial resolution is generated by up-sampling the first video using at least one second temporal attention layer of an up-sampler neural network model, wherein the second spatial resolution is higher than the first spatial resolution.
-
公开(公告)号:US20240096064A1
公开(公告)日:2024-03-21
申请号:US17832400
申请日:2022-06-03
Applicant: NVIDIA Corporation
Inventor: Daiqing Li , Huan Ling , Seung Wook Kim , Karsten Julian Kreis , Sanja Fidler , Antonio Torralba Barriuso
IPC: G06V10/774 , G06V10/764 , G06V10/82
CPC classification number: G06V10/774 , G06V10/764 , G06V10/82
Abstract: Apparatuses, systems, and techniques to annotate images using neural models. In at least one embodiment, neural networks generate mask information from labels of one or more objects within one or more images identified by one or more other neural networks.
-
公开(公告)号:US20240256831A1
公开(公告)日:2024-08-01
申请号:US18159815
申请日:2023-01-26
Applicant: NVIDIA Corporation
Inventor: Daiqing Li , Huan Ling , Seung Wook Kim , Karsten Julian Kreis , Antonio Torralba Barriuso , Sanja Fidler , Amlan Kar
IPC: G06N3/045 , G06T5/00 , G06V10/774 , G06V10/82
CPC classification number: G06N3/045 , G06T5/70 , G06V10/7753 , G06V10/82
Abstract: In various examples, systems and methods are disclosed relating to generating a response from image and/or video input for image/video-based artificial intelligence (AI) systems and applications. Systems and methods are disclosed for a first model (e.g., a teacher model) distilling its knowledge to a second model (a student model). The second model receives a downstream image in a downstream task and generates at least one feature. The first model generates first features corresponding to an image which can be a real image or a synthetic image. The second model generates second features using the image as an input to the second model. Loss with respect to first features is determined. The second model is updated using the loss.
-
公开(公告)号:US20220383570A1
公开(公告)日:2022-12-01
申请号:US17827394
申请日:2022-05-27
Applicant: NVIDIA Corporation
Inventor: Huan Ling , Karsten Kreis , Daiqing Li , Seung Wook Kim , Antonio Torralba Barriuso , Sanja Fidler
IPC: G06T11/60 , G06T7/10 , G06V10/776 , G06V10/774
Abstract: In various examples, high-precision semantic image editing for machine learning systems and applications are described. For example, a generative adversarial network (GAN) may be used to jointly model images and their semantic segmentations based on a same underlying latent code. Image editing may be achieved by using segmentation mask modifications (e.g., provided by a user, or otherwise) to optimize the latent code to be consistent with the updated segmentation, thus effectively changing the original, e.g., RGB image. To improve efficiency of the system, and to not require optimizations for each edit on each image, editing vectors may be learned in latent space that realize the edits, and that can be directly applied on other images with or without additional optimizations. As a result, a GAN in combination with the optimization approaches described herein may simultaneously allow for high precision editing in real-time with straightforward compositionality of multiple edits.
-
公开(公告)号:US20220269937A1
公开(公告)日:2022-08-25
申请号:US17184459
申请日:2021-02-24
Applicant: NVIDIA Corporation
Inventor: Seung Wook Kim , Jonah Philion , Sanja Fidler , Antonio Torralba Barriuso
Abstract: Apparatuses, systems, and techniques to use one or more neural networks to generate one or more images based, at least in part, on one or more spatially-independent features within the one or more images. In at least one embodiment, the one or more neural networks determine spatially-independent information and spatially-dependent information of the one or more images and process the spatially-independent information and the spatially-dependent information to generate the one or more spatially-independent features and one or more spatially-dependent features within the one or more images.
-
公开(公告)号:US20220067983A1
公开(公告)日:2022-03-03
申请号:US17006702
申请日:2020-08-28
Applicant: NVIDIA Corporation
Inventor: Sanja Fidler , David Acuna Marrero , Seung Wook Kim , Karsten Julian Kreis , Huan Ling
Abstract: Apparatuses, systems, and techniques to generate complete depictions of objects based on a partial depiction of the object. In at least one embodiment, an image of a complete object is generated by one or more neural networks, based on an image of a portion of the object, using an encoder of the one or more neural networks trained using training data generated from output of a decoder of the one or more neural networks.
-
公开(公告)号:US20250142145A1
公开(公告)日:2025-05-01
申请号:US19010882
申请日:2025-01-06
Applicant: NVIDIA Corporation
Inventor: Karsten Julian Kreis , Robin Rombach , Andreas Blattmann , Seung Wook Kim , Huan Ling , Sanja Fidler , Tim Dockhorn
Abstract: In various examples, systems and methods are disclosed relating to aligning images into frames of a first video using at least one first temporal attention layer of a neural network model. The first video has a first spatial resolution. A second video having a second spatial resolution is generated by up-sampling the first video using at least one second temporal attention layer of an up-sampler neural network model, wherein the second spatial resolution is higher than the first spatial resolution.
-
公开(公告)号:US12288277B2
公开(公告)日:2025-04-29
申请号:US17827394
申请日:2022-05-27
Applicant: NVIDIA Corporation
Inventor: Huan Ling , Karsten Kreis , Daiqing Li , Seung Wook Kim , Antonio Torralba Barriuso , Sanja Fidler
IPC: G06T7/10 , G06T11/60 , G06V10/774 , G06V10/776
Abstract: In various examples, high-precision semantic image editing for machine learning systems and applications are described. For example, a generative adversarial network (GAN) may be used to jointly model images and their semantic segmentations based on a same underlying latent code. Image editing may be achieved by using segmentation mask modifications (e.g., provided by a user, or otherwise) to optimize the latent code to be consistent with the updated segmentation, thus effectively changing the original, e.g., RGB image. To improve efficiency of the system, and to not require optimizations for each edit on each image, editing vectors may be learned in latent space that realize the edits, and that can be directly applied on other images with or without additional optimizations. As a result, a GAN in combination with the optimization approaches described herein may simultaneously allow for high precision editing in real-time with straightforward compositionality of multiple edits.
-
公开(公告)号:US20240171788A1
公开(公告)日:2024-05-23
申请号:US18181729
申请日:2023-03-10
Applicant: NVIDIA Corporation
Inventor: Karsten Julian Kreis , Robin Rombach , Andreas Blattmann , Seung Wook Kim , Huan Ling , Sanja Fidler , Tim Dockhorn
CPC classification number: H04N21/234363 , G06T9/00 , G06V10/24 , G06V10/25 , G06V10/82 , H04N7/0117
Abstract: In various examples, systems and methods are disclosed relating to aligning images into frames of a first video using at least one first temporal attention layer of a neural network model. The first video has a first spatial resolution. A second video having a second spatial resolution is generated by up-sampling the first video using at least one second temporal attention layer of an up-sampler neural network model, wherein the second spatial resolution is higher than the first spatial resolution.
-
-
-
-
-
-
-
-
-