公开(公告)号：US12175350B2

公开(公告)日：2024-12-24

申请号：US16566797

申请日：2019-09-10

Applicant: NVIDIA Corporation

Inventor： Arash Vahdat ,  Arun Mohanray Mallya ,  Ming-Yu Liu ,  Jan Kautz

IPC: G06N20/00 ,  G06F7/57 ,  G06N3/04 ,  G06N3/063 ,  G06N3/08 ,  G05B13/02

Abstract: In at least one embodiment, differentiable neural architecture search and reinforcement learning are combined under one framework to discover network architectures with desired properties such as high accuracy, low latency, or both. In at least one embodiment, an objective function for search based on generalization error prevents the selection of architectures prone to overfitting.

公开(公告)号：US20230110206A1

公开(公告)日：2023-04-13

申请号：US18079772

申请日：2022-12-12

Applicant: NVIDIA Corporation

Inventor： Tero Tapani Karras ,  Samuli Matias Laine ,  David Patrick Luebke ,  Jaakko T. Lehtinen ,  Miika Samuli Aittala ,  Timo Oskari Aila ,  Ming-Yu Liu ,  Arun Mohanray Mallya ,  Ting-Chun Wang

IPC: G06N3/08 ,  G06T9/00 ,  H04N19/20 ,  H04N7/15 ,  G06T7/73 ,  G06V40/16 ,  G06T5/00

Abstract: A latent code defined in an input space is processed by the mapping neural network to produce an intermediate latent code defined in an intermediate latent space. The intermediate latent code may be used as appearance vector that is processed by the synthesis neural network to generate an image. The appearance vector is a compressed encoding of data, such as video frames including a person's face, audio, and other data. Captured images may be converted into appearance vectors at a local device and transmitted to a remote device using much less bandwidth compared with transmitting the captured images. A synthesis neural network at the remote device reconstructs the images for display.

公开(公告)号：US20240193887A1

公开(公告)日：2024-06-13

申请号：US18361587

申请日：2023-07-28

Applicant: NVIDIA Corporation

Inventor： Zekun Hao ,  Ming-Yu Liu ,  Arun Mohanray Mallya

IPC: G06T19/20

CPC classification number: G06T19/20 ,  G06F30/10 ,  G06T2210/56 ,  G06T2219/2021

Abstract: Synthesis of high-quality 3D shapes with smooth surfaces has various creative and practical use cases, such as 3D content creation and CAD modeling. A vector field decoder neural network is trained to predict a generative vector field (GVF) representation of a 3D shape from a latent representation (latent code or feature volume) of the 3D shape. The GVF representation is agnostic to surface orientation, all dimensions of the vector field vary smoothly, the GVF can represent both watertight and non-watertight 3D shapes, and there is a one-to-one mapping between a predicted 3D shape and the ground truth 3D shape (i.e., the mapping is bijective). The vector field decoder can synthesize 3D shapes in multiple categories and can also synthesize 3D shapes for objects that were not included in the training dataset. In other words, the vector field decoder is also capable of zero-shot generation.

公开(公告)号：US20240095989A1

公开(公告)日：2024-03-21

申请号：US17945951

申请日：2022-09-15

Applicant: NVIDIA Corporation

Inventor： Arun Mohanray Mallya ,  Ting-Chun Wang ,  Ming-Yu Liu

IPC: G06T13/20 ,  G06T7/20 ,  G06V10/25 ,  G06V10/44 ,  G06V10/74 ,  G06V10/771 ,  G06V10/82

CPC classification number: G06T13/20 ,  G06T7/20 ,  G06V10/25 ,  G06V10/443 ,  G06V10/761 ,  G06V10/771 ,  G06V10/82 ,  G06T2207/20081 ,  G06T2207/30252

Abstract: Apparatuses, systems, and techniques to generate a video using two or more images comprising objects to be included in the video. In at least one embodiment, objects are identified in two or more images using one or more neural networks, to generate a video to include the objects in the video.

公开(公告)号：US11610435B2

公开(公告)日：2023-03-21

申请号：US17069478

申请日：2020-10-13

Applicant: NVIDIA Corporation

Inventor： Tero Tapani Karras ,  Samuli Matias Laine ,  David Patrick Luebke ,  Jaakko T. Lehtinen ,  Miika Samuli Aittala ,  Timo Oskari Aila ,  Ming-Yu Liu ,  Arun Mohanray Mallya ,  Ting-Chun Wang

IPC: G06N3/08 ,  G06V40/16 ,  G06T7/70 ,  G06V10/82 ,  G06N3/02

Abstract: A latent code defined in an input space is processed by the mapping neural network to produce an intermediate latent code defined in an intermediate latent space. The intermediate latent code may be used as appearance vector that is processed by the synthesis neural network to generate an image. The appearance vector is a compressed encoding of data, such as video frames including a person's face, audio, and other data. Captured images may be converted into appearance vectors at a local device and transmitted to a remote device using much less bandwidth compared with transmitting the captured images. A synthesis neural network at the remote device reconstructs the images for display.

公开(公告)号：US11775829B2

公开(公告)日：2023-10-03

申请号：US18079772

申请日：2022-12-12

Applicant: NVIDIA Corporation

Inventor： Tero Tapani Karras ,  Samuli Matias Laine ,  David Patrick Luebke ,  Jaakko T. Lehtinen ,  Miika Samuli Aittala ,  Timo Oskari Aila ,  Ming-Yu Liu ,  Arun Mohanray Mallya ,  Ting-Chun Wang

IPC: G06T9/00 ,  G06N3/08 ,  H04N19/20 ,  H04N7/15 ,  G06T7/73 ,  G06V40/16 ,  G06T5/00

CPC classification number: G06N3/08 ,  G06T5/003 ,  G06T7/73 ,  G06T9/002 ,  G06V40/168 ,  H04N7/157 ,  H04N19/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30201

Abstract: A latent code defined in an input space is processed by the mapping neural network to produce an intermediate latent code defined in an intermediate latent space. The intermediate latent code may be used as appearance vector that is processed by the synthesis neural network to generate an image. The appearance vector is a compressed encoding of data, such as video frames including a person's face, audio, and other data. Captured images may be converted into appearance vectors at a local device and transmitted to a remote device using much less bandwidth compared with transmitting the captured images. A synthesis neural network at the remote device reconstructs the images for display.

公开(公告)号：US20220180602A1

公开(公告)日：2022-06-09

申请号：US17111271

申请日：2020-12-03

Applicant: Nvidia Corporation

Inventor： Zekun Hao ,  Ming-Yu Liu ,  Arun Mohanray Mallya

IPC: G06T17/20 ,  G06T17/05 ,  G06T15/10 ,  G06T7/12 ,  G06K9/00

Abstract: Apparatuses, systems, and techniques are presented to generate images. In at least one embodiment, one or more neural networks are used to generate one or more images based, at least in part, upon one or more semantic features projected from a three-dimensional environment.

公开(公告)号：US20210150187A1

公开(公告)日：2021-05-20

申请号：US17143516

申请日：2021-01-07

Applicant: NVIDIA Corporation

Inventor： Tero Tapani Karras ,  Samuli Matias Laine ,  David Patrick Luebke ,  Jaakko T. Lehtinen ,  Miika Samuli Aittala ,  Timo Oskari Aila ,  Ming-Yu Liu ,  Arun Mohanray Mallya ,  Ting-Chun Wang

IPC: G06K9/00 ,  G06N3/08 ,  G06T7/70

Abstract: A latent code defined in an input space is processed by the mapping neural network to produce an intermediate latent code defined in an intermediate latent space. The intermediate latent code may be used as appearance vector that is processed by the synthesis neural network to generate an image. The appearance vector is a compressed encoding of data, such as video frames including a person's face, audio, and other data. Captured images may be converted into appearance vectors at a local device and transmitted to a remote device using much less bandwidth compared with transmitting the captured images. A synthesis neural network at the remote device reconstructs the images for display.

公开(公告)号：US11610122B2

公开(公告)日：2023-03-21

申请号：US17143608

申请日：2021-01-07

Applicant: NVIDIA Corporation

Inventor： Tero Tapani Karras ,  Samuli Matias Laine ,  David Patrick Luebke ,  Jaakko T. Lehtinen ,  Miika Samuli Aittala ,  Timo Oskari Aila ,  Ming-Yu Liu ,  Arun Mohanray Mallya ,  Ting-Chun Wang

IPC: G06T9/00 ,  G06N3/08 ,  H04N19/20 ,  H04N7/15 ,  G06T7/73 ,  G06V40/16 ,  G06T5/00

Abstract: A latent code defined in an input space is processed by the mapping neural network to produce an intermediate latent code defined in an intermediate latent space. The intermediate latent code may be used as appearance vector that is processed by the synthesis neural network to generate an image. The appearance vector is a compressed encoding of data, such as video frames including a person's face, audio, and other data. Captured images may be converted into appearance vectors at a local device and transmitted to a remote device using much less bandwidth compared with transmitting the captured images. A synthesis neural network at the remote device reconstructs the images for display.

公开(公告)号：US11580395B2

公开(公告)日：2023-02-14

申请号：US17069449

申请日：2020-10-13

Applicant: NVIDIA Corporation

Inventor： Tero Tapani Karras ,  Samuli Matias Laine ,  David Patrick Luebke ,  Jaakko T. Lehtinen ,  Miika Samuli Aittala ,  Timo Oskari Aila ,  Ming-Yu Liu ,  Arun Mohanray Mallya ,  Ting-Chun Wang

IPC: G06T9/00 ,  G06N3/08 ,  H04N19/20 ,  H04N7/15 ,  G06T7/73 ,  G06V40/16 ,  G06T5/00

Abstract: A latent code defined in an input space is processed by the mapping neural network to produce an intermediate latent code defined in an intermediate latent space. The intermediate latent code may be used as appearance vector that is processed by the synthesis neural network to generate an image. The appearance vector is a compressed encoding of data, such as video frames including a person's face, audio, and other data. Captured images may be converted into appearance vectors at a local device and transmitted to a remote device using much less bandwidth compared with transmitting the captured images. A synthesis neural network at the remote device reconstructs the images for display.