-
公开(公告)号：US20210132688A1
公开(公告)日：2021-05-06
申请号：US16669863
申请日：2019-10-31
Applicant: Nvidia Corporation
Inventor： Joohwan Kim , Josef Spjut , Iuri Frosio , Orazio Gallo , Ekta Prashnani
Abstract: Apparatuses, systems, and techniques are presented to modify media content using inferred attention. In at least one embodiment, a network is trained to predict a gaze of one or more users on one or more image features based, at least in part, on one or more prior gazes of the one or more users, wherein the prediction is to be used to modify at least one of the one or more image features.
-
公开(公告)号：US20190164268A1
公开(公告)日：2019-05-30
申请号：US16200192
申请日：2018-11-26
Applicant: NVIDIA Corporation
Inventor： Orazio Gallo , Jinwei Gu , Jan Kautz , Patrick Wieschollek
Abstract: When a computer image is generated from a real-world scene having a semi-reflective surface (e.g. window), the computer image will create, at the semi-reflective surface from the viewpoint of the camera, both a reflection of a scene in front of the semi-reflective surface and a transmission of a scene located behind the semi-reflective surface. Similar to a person viewing the real-world scene from different locations, angles, etc., the reflection and transmission may change, and also move relative to each other, as the viewpoint of the camera changes. Unfortunately, the dynamic nature of the reflection and transmission negatively impacts the performance of many computer applications, but performance can generally be improved if the reflection and transmission are separated. The present disclosure uses deep learning to separate reflection and transmission at a semi-reflective surface of a computer image generated from a real-world scene.
-
公开(公告)号：US09773473B2
公开(公告)日：2017-09-26
申请号：US14722036
申请日：2015-05-26
Applicant: NVIDIA CORPORATION
Inventor： Orazio Gallo , Kari Antero Pulli , David Edward Jacobs
CPC classification number: G09G5/10 , G09G5/02 , G09G2320/0257 , G09G2320/066 , G09G2354/00
Abstract: A system, computer-readable medium, and method are provided for generating images based on adaptations of the human visual system. An input image is received, an effect provoking change is received, and an afterimage resulting from a cumulative effect of human visual adaptation is computed based on the effect provoking change and a per-photoreceptor type physiological adaptation of the human visual system. The computed afterimage may include a bleaching afterimage effect and/or a local adaptation afterimage effect. The computed afterimage is then accumulated into an output image for display.
-
公开(公告)号：US20240265561A1
公开(公告)日：2024-08-08
申请号：US18638346
申请日：2024-04-17
Applicant: NVIDIA Corporation
Inventor： Orazio Gallo , Abhishek Badki
CPC classification number: G06T7/55 , G06F17/16 , G06F18/214 , G06N20/00 , G06T15/10 , G06T17/205
Abstract: One embodiment of a method includes predicting one or more three-dimensional (3D) mesh representations based on a plurality of digital images, wherein the one or more 3D mesh representations are refined by minimizing at least one difference between the one or more 3D mesh representations and the plurality of digital images.
-
5.发明公开公开(公告)号：US20230306678A1
公开(公告)日：2023-09-28
申请号：US17558881
申请日：2021-12-22
Applicant: NVIDIA Corporation
Inventor： Hang Su , Zitian Chen , Orazio Gallo
CPC classification number: G06T15/10 , G06K9/6217 , G06T1/20 , G06T7/20 , G06T7/60 , G06T7/70 , G06T15/06 , G06V10/82
Abstract: A target image corresponding to a novel view may be synthesized from two source images, corresponding source camera poses, and pixel attribute correspondences between the two source images. A particular object in the target image need only be visible in one of the two source images for successful synthesis. Each pixel in the target image is defined according to an identified pixel in one of the two source images. The identified source pixel provides attributes such as color, texture, and feature descriptors for the target pixel. The source and target camera poses are used to define geometric relationships for identifying the source pixels. In an embodiment, the pixel attribute correspondences are optical flow that defines movement of attributes from a first image of the two source images to a second image of the two source images.
-
Patent Agency Ranking
公开(公告)号：US20230081641A1
公开(公告)日：2023-03-16
申请号：US17551046
申请日：2021-12-14
Applicant: NVIDIA Corporation
Inventor： Koki Nagano , Eric Ryan Chan , Sameh Khamis , Shalini De Mello , Tero Tapani Karras , Orazio Gallo , Jonathan Tremblay
Abstract: A single two-dimensional (2D) image can be used as input to obtain a three-dimensional (3D) representation of the 2D image. This is done by extracting features from the 2D image by an encoder and determining a 3D representation of the 2D image utilizing a trained 2D convolutional neural network (CNN). Volumetric rendering is then run on the 3D representation to combine features within one or more viewing directions, and the combined features are provided as input to a multilayer perceptron (MLP) that predicts and outputs color (or multi-dimensional neural features) and density values for each point within the 3D representation. As a result, single-image inverse rendering may be performed using only a single 2D image as input to create a corresponding 3D representation of the scene in the single 2D image.
-
公开(公告)号：US20200294194A1
公开(公告)日：2020-09-17
申请号：US16299062
申请日：2019-03-11
Applicant: NVIDIA Corporation
Inventor： Deqing Sun , Orazio Gallo , Jan Kautz , Jinwei GU , Wei-Sheng Lai
Abstract: A video stitching system combines video from different cameras to form a panoramic video that, in various embodiments, is temporally stable and tolerant to strong parallax. In an embodiment, the system provides a smooth spatial interpolation that can be used to connect the input video images. In an embodiment, the system applies an interpolation layer to slices of the overlapping video sources, and the network learns a dense flow field to smoothly align the input videos with spatial interpolation. Various embodiments are applicable to areas such as virtual reality, immersive telepresence, autonomous driving, and video surveillance.
-
8.发明授权公开(公告)号：US09412042B2
公开(公告)日：2016-08-09
申请号：US13870901
申请日：2013-04-25
Applicant: NVIDIA Corporation
Inventor： Kari Pulli , Orazio Gallo , David Jacobs
CPC classification number: G06K9/6202 , G06F17/30247 , G06T5/007 , G06T5/50 , G06T2200/24 , G06T2207/20208 , G06T2207/20212 , G09G2340/045 , G09G2340/10 , G09G2380/16
Abstract: A number of images of a scene are captured and stored. The images are captured over a range of values for an attribute (e.g., a camera setting). One of the images is displayed. A location of interest in the displayed image is identified. Regions that correspond to the location of interest are identified in each of the images. Those regions are evaluated to identify which of the regions is rated highest with respect to the attribute relative to the other regions. The image that includes the highest-rated region is then displayed.
Abstract translation: 捕获并存储场景的许多图像。 图像被捕获在属性值范围（例如，相机设置）上。 其中一个图像被显示。 识别显示图像中感兴趣的位置。 在每个图像中识别对应于感兴趣位置的区域。 对这些区域进行评估，以确定哪个区域相对于其他区域的属性的额定值最高。 然后显示包含最高等级区域的图像。
-
9.发明申请UNIFIED OPTIMIZATION METHOD FOR END-TO-END CAMERA IMAGE PROCESSING FOR TRANSLATING A SENSOR CAPTURED IMAGE TO A DISPLAY IMAGE 有权用于将传感器捕获的图像转换为显示图像的端到端相机图像处理的统一优化方法公开(公告)号：US20150206504A1
公开(公告)日：2015-07-23
申请号：US14600507
申请日：2015-01-20
Applicant: NVIDIA Corporation
Inventor： Dawid Stanislaw Pajak , Felix Heide , Nagilla Dikpal Reddy , Mushfiqur Rouf , Jan Kautz , Kari Pulli , Orazio Gallo
CPC classification number: G09G5/02 , G06T3/4015 , G06T5/001 , G06T5/002 , G09G5/026 , G09G5/363 , G09G2320/0238 , G09G2320/0242 , G09G2320/0247 , G09G2320/066 , G09G2360/08
Abstract: A computer implemented method of determining a latent image from an observed image is disclosed. The method comprises implementing a plurality of image processing operations within a single optimization framework, wherein the single optimization framework comprises solving a linear minimization expression. The method further comprises mapping the linear minimization expression onto at least one non-linear solver. Further, the method comprises using the non-linear solver, iteratively solving the linear minimization expression in order to extract the latent image from the observed image, wherein the linear minimization expression comprises: a data term, and a regularization term, and wherein the regularization term comprises a plurality of non-linear image priors.
Abstract translation: 公开了一种从观察图像确定潜像的计算机实现方法。 该方法包括在单个优化框架内实现多个图像处理操作，其中单个优化框架包括求解线性最小化表达式。 该方法还包括将线性最小化表达映射到至少一个非线性求解器上。 此外，该方法包括使用非线性求解器，迭代地求解线性最小化表达以从观察图像中提取潜像，其中线性最小化表达式包括：数据项和正则化项，其中正则化 术语包括多个非线性图像先验。
-
公开(公告)号：US08929683B2
公开(公告)日：2015-01-06
申请号：US13874357
申请日：2013-04-30
Applicant: NVIDIA Corporation
Inventor： Orazio Gallo , Kari Pulli , Jun Hu
CPC classification number: G06T5/50 , G06T5/005 , G06T2207/20208 , G06T2207/20221
Abstract: A set of images is processed to modify and register the images to a reference image in preparation for blending the images to create a high-dynamic range image. To modify and register a source image to a reference image, a processing unit generates correspondence information for the source image based on a global correspondence algorithm, generates a warped source image based on the correspondence information, estimates one or more color transfer functions for the source image, and fills the holes in the warped source image. The holes in the warped source image are filled based on either a rigid transformation of a corresponding region of the source image or a transformation of the reference image based on the color transfer functions.
Abstract translation: 处理一组图像以将图像修改并注册到参考图像，以准备混合图像以创建高动态范围图像。 为了将源图像修改并注册到参考图像，处理单元基于全局对应算法生成源图像的对应信息，基于对应信息生成翘曲源图像，估计源的一个或多个颜色传递函数 图像，并填充翘曲的源图像中的孔。 基于源图像的相应区域的刚性变换或基于颜色传递函数的参考图像的变换来填充翘曲源图像中的孔。
-
-
-
-
-
-
-
-
-
Search Results
31
records
(took 0.024 seconds)
