公开(公告)号：US10922793B2

公开(公告)日：2021-02-16

申请号：US16353195

申请日：2019-03-14

Applicant: NVIDIA Corporation

Inventor： Seung-Hwan Baek ,  Kihwan Kim ,  Jinwei Gu ,  Orazio Gallo ,  Alejandro Jose Troccoli ,  Ming-Yu Liu ,  Jan Kautz

IPC: G06T5/00 ,  G06K9/72 ,  G06T5/50 ,  G06K9/62 ,  G06T3/40

Abstract: Missing image content is generated using a neural network. In an embodiment, a high resolution image and associated high resolution semantic label map are generated from a low resolution image and associated low resolution semantic label map. The input image/map pair (low resolution image and associated low resolution semantic label map) lacks detail and is therefore missing content. Rather than simply enhancing the input image/map pair, data missing in the input image/map pair is improvised or hallucinated by a neural network, creating plausible content while maintaining spatio-temporal consistency. Missing content is hallucinated to generate a detailed zoomed in portion of an image. Missing content is hallucinated to generate different variations of an image, such as different seasons or weather conditions for a driving video.

公开(公告)号：US20190355103A1

公开(公告)日：2019-11-21

申请号：US16353195

申请日：2019-03-14

Applicant: NVIDIA Corporation

Inventor： Seung-Hwan Baek ,  Kihwan Kim ,  Jinwei Gu ,  Orazio Gallo ,  Alejandro Jose Troccoli ,  Ming-Yu Liu ,  Jan Kautz

IPC: G06T5/00 ,  G06K9/72 ,  G06T5/50 ,  G06T3/40 ,  G06K9/62

Abstract: Missing image content is generated using a neural network. In an embodiment, a high resolution image and associated high resolution semantic label map are generated from a low resolution image and associated low resolution semantic label map. The input image/map pair (low resolution image and associated low resolution semantic label map) lacks detail and is therefore missing content. Rather than simply enhancing the input image/map pair, data missing in the input image/map pair is improvised or hallucinated by a neural network, creating plausible content while maintaining spatio-temporal consistency. Missing content is hallucinated to generate a detailed zoomed in portion of an image. Missing content is hallucinated to generate different variations of an image, such as different seasons or weather conditions for a driving video.