公开(公告)号：US20240144568A1

公开(公告)日：2024-05-02

申请号：US17903585

申请日：2022-09-06

Applicant: Nvidia Corporation

Inventor： Siddharth Gururani ,  Arun Mallya ,  Ting-Chun Wang ,  Jose Rafael Valle da Costa ,  Ming-Yu Liu

IPC: G06T13/20 ,  G06V10/82 ,  G06V40/16

CPC classification number: G06T13/205 ,  G06V10/82 ,  G06V40/171

Abstract: Apparatuses, systems, and techniques are presented to generate digital content. In at least one embodiment, one or more neural networks are used to generate video information based at least in part upon voice information and a combination of image features and facial landmarks corresponding to one or more images of a person.

公开(公告)号：US20240114162A1

公开(公告)日：2024-04-04

申请号：US17955734

申请日：2022-09-29

Applicant: Nvidia Corporation

Inventor： Aurobinda Maharana ,  Arun Mallya ,  Ming-Yu Liu ,  Abhijit Patait

IPC: H04N19/50 ,  H04N19/21

CPC classification number: H04N19/50 ,  H04N19/21

Abstract: Systems and methods herein address reference frame selection in video streaming applications using one or more processing units to decode a frame of an encoded video stream that uses an inter-frame depicting an object and an intra-frame depicting the object, the intra-frame being included in a set of intra-frames based at least in part on at least one attribute of the object as depicted in the intra-frame being different from the at least one attribute of the object as depicted in other intra-frames of the set of intra-frames.

公开(公告)号：US20230035306A1

公开(公告)日：2023-02-02

申请号：US17382027

申请日：2021-07-21

Applicant: Nvidia Corporation

Inventor： Ming-Yu Liu ,  Koki Nagano ,  Yeongho Seol ,  Jose Rafael Valle Gomes da Costa ,  Jaewoo Seo ,  Ting-Chun Wang ,  Arun Mallya ,  Sameh Khamis ,  Wei Ping ,  Rohan Badlani ,  Kevin Jonathan Shih ,  Bryan Catanzaro ,  Simon Yuen ,  Jan Kautz

IPC: G06T13/40 ,  H04N19/597 ,  G06N3/04 ,  G10L13/04 ,  G06T9/00 ,  G06T17/10 ,  G06T13/20

Abstract: Apparatuses, systems, and techniques are presented to generate media content. In at least one embodiment, a first neural network is used to generate first video information based, at least in part, upon voice information corresponding to one or more users, and a second neural network is used to generate second video information corresponding to the one or more users based, at least in part, upon the first video information and one or more images corresponding to the one or more users

公开(公告)号：US20240397077A1

公开(公告)日：2024-11-28

申请号：US18780242

申请日：2024-07-22

Applicant: Nvidia Corporation

Inventor： Aurobinda Maharana ,  Arun Mallya ,  Ming-Yu Liu ,  Abhijit Patait

IPC: H04N19/50 ,  H04N19/21

Abstract: Systems and methods herein address reference frame selection in video streaming applications using one or more processing units to decode a frame of an encoded video stream that uses an inter-frame depicting an object and an intra-frame depicting the object, the intra-frame being included in a set of intra-frames based at least in part on at least one attribute of the object as depicted in the intra-frame being different from the at least one attribute of the object as depicted in other intra-frames of the set of intra-frames.

公开(公告)号：US20220284232A1

公开(公告)日：2022-09-08

申请号：US17188397

申请日：2021-03-01

Applicant: NVIDIA Corporation

Inventor： Hongxu Yin ,  Arun Mallya ,  Arash Vahdat ,  Jose Manuel Alvarez Lopez ,  Jan Kautz ,  Pavlo Molchanov

IPC: G06K9/62 ,  G06K9/66

Abstract: Apparatuses, systems, and techniques to identify one or more images used to train one or more neural networks. In at least one embodiment, one or more images used to train one or more neural networks are identified, based on, for example, one or more labels of one or more objects within the one or more images.

公开(公告)号：US12047595B2

公开(公告)日：2024-07-23

申请号：US17955734

申请日：2022-09-29

Applicant: Nvidia Corporation

Inventor： Aurobinda Maharana ,  Arun Mallya ,  Ming-Yu Liu ,  Abhijit Patait

IPC: H04N19/50 ,  H04N19/21

CPC classification number: H04N19/50 ,  H04N19/21

Abstract: Systems and methods herein address reference frame selection in video streaming applications using one or more processing units to decode a frame of an encoded video stream that uses an inter-frame depicting an object and an intra-frame depicting the object, the intra-frame being included in a set of intra-frames based at least in part on at least one attribute of the object as depicted in the intra-frame being different from the at least one attribute of the object as depicted in other intra-frames of the set of intra-frames.

公开(公告)号：US20230045076A1

公开(公告)日：2023-02-09

申请号：US17389113

申请日：2021-07-29

Applicant: Nvidia Corporation

Inventor： Xun Huang ,  Arun Mallya ,  Ting Wang ,  Ming-Yu Liu

IPC: G06T7/143 ,  G06N3/04 ,  G06T7/11 ,  G06T7/13

Abstract: Apparatuses, systems, and techniques are presented to generate one or more images. In at least one embodiment, one or more neural networks are used to generate one or more images based, at least in part, upon one or more input types.

公开(公告)号：US20250111222A1

公开(公告)日：2025-04-03

申请号：US18375377

申请日：2023-09-29

Applicant: NVIDIA Corporation

Inventor： Zekun Hao ,  Ming-Yu Liu ,  Arun Mallya

IPC: G06N3/08 ,  G06N3/04

Abstract: Performance of a neural network is usually a function of the capacity, or complexity, of the neural network, including the depth of the neural network (i.e. the number of layers in the neural network) and/or the width of the neural network (i.e. the number of hidden channels). However, improving performance of a neural network by simply increasing its capacity has drawbacks, the most notable being the increased computational cost of a higher-capacity neural network. Since modern neural networks are configured such that the same neural network is evaluated regardless of the input, a higher capacity neural network means a higher computational cost incurred per input processed. The present disclosure provides for a multi-layer neural network that allows for dynamic path selection through the neural network when processing an input, which in turn can allow for increased neural network capacity without incurring the typical increased computation cost associated therewith.

公开(公告)号：US11934959B2

公开(公告)日：2024-03-19

申请号：US16889376

申请日：2020-06-01

Applicant: Nvidia Corporation

Inventor： Arun Mallya ,  Ting-Chun Wang ,  Ming-Yu Liu ,  Karan Sapra

IPC: G06N3/08 ,  G06N3/045 ,  G06N3/063 ,  G06N3/088

CPC classification number: G06N3/088 ,  G06N3/045 ,  G06N3/063

Abstract: Apparatuses, systems, and techniques are presented to synthesize consistent images or video. In at least one embodiment, one or more neural networks are used to generate one or more second images based, at least in part, on one or more point cloud representations of one or more first images.

公开(公告)号：US20210374552A1

公开(公告)日：2021-12-02

申请号：US16889376

申请日：2020-06-01

Applicant: Nvidia Corporation

Inventor： Arun Mallya ,  Ting-Chun Wang ,  Ming-Yu Liu ,  Karan Spara

IPC: G06N3/08 ,  G06N3/04 ,  G06N3/063

Abstract: Apparatuses, systems, and techniques are presented to synthesize consistent images or video. In at least one embodiment, one or more neural networks are used to generate one or more second images based, at least in part, on one or more point cloud representations of one or more first images.