公开(公告)号：US20190045168A1

公开(公告)日：2019-02-07

申请号：US16141426

申请日：2018-09-25

Applicant: Intel Corporation

Inventor： Bindita Chaudhuri ,  Fan Zhang ,  Oscar Nestares

IPC: H04N13/111 ,  G06T3/40 ,  G06T7/55 ,  H04N13/161 ,  H04N13/271 ,  H04N13/15 ,  H04N13/139 ,  G06T3/20 ,  H04N13/122

CPC classification number: H04N13/111 ,  G06T1/20 ,  G06T3/0093 ,  G06T3/20 ,  G06T3/4038 ,  G06T3/4053 ,  G06T7/55 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20212 ,  G06T2207/20228 ,  H04N5/23232 ,  H04N13/122 ,  H04N13/139 ,  H04N13/15 ,  H04N13/161 ,  H04N13/243 ,  H04N13/271 ,  H04N2013/0081

Abstract: Techniques related to interpolating an intermediate view image from multi-view images are discussed. Such techniques include downsampling first and second images that represent a view of a scene, generating a disparity map based on applying a first CNN to the downscaled first and second images, translating the downscaled first and second images using the disparity map, applying a second CNN to the translated downscaled first and second images and the disparity map to generate a downscaled intermediate image, and upscaling the downscaled intermediate image to an intermediate image at the resolution of the first and second images using an image super-resolution convolutional neural network.

公开(公告)号：US11368669B2

公开(公告)日：2022-06-21

申请号：US17133271

申请日：2020-12-23

Applicant: Intel Corporation

Inventor： Fan Zhang ,  Oscar Nestares

IPC: H04N13/344 ,  G06T3/00 ,  H04N5/232 ,  H04N13/296 ,  H04N13/398 ,  G06T3/40 ,  G06T15/00

Abstract: An example system for generating stereoscopic light field panoramas includes at least one memory; and at least one processor to execute instructions to: access images of a scene captured by a plurality of cameras, the images including light field information associated with the scene; generate, based on first portions of the images, a first stereoscopic light field panorama for a first perspective associated with a left eye viewpoint of the scene, the left eye viewpoint associated with a left eye position on a first circle; and generate, based on second portions of the images, a second stereoscopic light field panorama for a second perspective associated with a right eye viewpoint of the scene, the right eye viewpoint associated with a right eye position on a second circle, the first circle being different than and concentric to the second circle.

公开(公告)号：US20210120225A1

公开(公告)日：2021-04-22

申请号：US17133271

申请日：2020-12-23

Applicant: Intel Corporation

Inventor： Fan Zhang ,  Oscar Nestares

IPC: H04N13/344 ,  G06T3/00 ,  H04N5/232 ,  H04N13/296 ,  H04N13/398 ,  G06T3/40 ,  G06T15/00

Abstract: An example system for generating stereoscopic light field panoramas includes at least one memory; and at least one processor to execute instructions to: access images of a scene captured by a plurality of cameras, the images including light field information associated with the scene; generate, based on first portions of the images, a first stereoscopic light field panorama for a first perspective associated with a left eye viewpoint of the scene, the left eye viewpoint associated with a left eye position on a first circle; and generate, based on second portions of the images, a second stereoscopic light field panorama for a second perspective associated with a right eye viewpoint of the scene, the right eye viewpoint associated with a right eye position on a second circle, the first circle being different than and concentric to the second circle.

公开(公告)号：US20200267310A1

公开(公告)日：2020-08-20

申请号：US16869209

申请日：2020-05-07

Applicant: INTEL CORPORATION

Inventor： Fan Zhang

IPC: H04N5/232 ,  G06T7/80 ,  G06T5/00

Abstract: Techniques related to calibrating fisheye cameras using a single image are discussed. Such techniques include applying a first pretrained convolutional neural network to an input fisheye image to generate camera model parameters excluding a principle point and applying a second pretrained convolutional neural network to the fisheye image and a difference of the fisheye image and a projection of the fisheye image using the camera model parameters to generate the principle point.

公开(公告)号：US20190304164A1

公开(公告)日：2019-10-03

申请号：US16445066

申请日：2019-06-18

Applicant: INTEL CORPORATION

Inventor： Fan Zhang

IPC: G06T15/08 ,  G06T3/00 ,  G06T5/00 ,  G06T5/50

Abstract: Techniques related to generating a virtual view of a scene from a position between positions of known input images for presentation to a viewer are discussed. Such techniques include applying gradient-based hole-filling interpolation.

公开(公告)号：US20190220963A1

公开(公告)日：2019-07-18

申请号：US16365539

申请日：2019-03-26

Applicant: Intel Corporation

Inventor： Vladan Popovic ,  Fan Zhang ,  Oscar Nestares ,  Kalpana Seshadrinathan

IPC: G06T5/20 ,  G06T3/40 ,  G06T5/50 ,  G06T7/00

CPC classification number: G06T5/20 ,  G06T3/4007 ,  G06T5/50 ,  G06T7/0002

Abstract: Techniques related to generating a virtual view of a scene from a position between positions of known input images for presentation to a viewer are discussed. Such techniques include applying a convolution mask that approximates an inverse of a linear combination of at least the horizontal and vertical convolution matrices representative of gradient detection in the input images to a virtual intermediate gradient image that is a combination of at least an interpolated virtual image at the position, an interpolated horizontal gradient map at the position, and an interpolated vertical gradient map at the position to generate a final virtual image for the position.

公开(公告)号：US20170180699A1

公开(公告)日：2017-06-22

申请号：US14971837

申请日：2015-12-16

Applicant: INTEL CORPORATION

Inventor： Maha El Choubassi ,  Fan Zhang ,  Joshua J. Ratcliff

IPC: H04N13/00 ,  H04N5/232 ,  H04N13/04 ,  H04N13/02

Abstract: Techniques related to multiview video stabilization are discussed. Such techniques may include performing single view video stabilization on a reference video stream and propagating the single view video stabilization to another video stream based on a target disparity map.

公开(公告)号：US20220012860A1

公开(公告)日：2022-01-13

申请号：US17483635

申请日：2021-09-23

Applicant: Intel Corporation

Inventor： Fan Zhang ,  Oscar Nestares

IPC: G06T5/50 ,  G06T5/00

Abstract: Methods and apparatus are disclosed herein to synthesize six degree-of-freedom views from sparce RGB-depth inputs. An example apparatus includes at least one memory, instructions in the apparatus, and processor circuitry to execute the instructions to reproject a first red-green-blue (RGB) depth view and a second RGB depth view to a target camera position to obtain a first reprojected view and a second reprojected view, combine the first reprojected view and the second reprojected view into a blended view data based on a first weight map and a second weight map, the blended view including missing RGB depth information due to at least one of an occlusion or a disocclusion, and generate a six degree-of-freedom synthesized view of the blended view data, the synthesized view including the missing RGB depth information.

公开(公告)号：US10855966B2

公开(公告)日：2020-12-01

申请号：US16752346

申请日：2020-01-24

Applicant: Intel Corporation

Inventor： Bindita Chaudhuri ,  Fan Zhang ,  Oscar Nestares

IPC: H04N19/51 ,  H04N19/82 ,  H04N19/523 ,  H04N13/111 ,  G06T7/55 ,  H04N13/161 ,  H04N13/271 ,  H04N13/15 ,  H04N13/139 ,  G06T3/20 ,  H04N13/122 ,  G06T3/40 ,  G06T1/20 ,  H04N5/232 ,  H04N13/243 ,  G06T3/00 ,  H04N13/00

Abstract: Techniques related to interpolating an intermediate view image from multi-view images are discussed. Such techniques include downsampling first and second images that represent a view of a scene, generating a disparity map based on applying a first CNN to the downscaled first and second images, translating the downscaled first and second images using the disparity map, applying a second CNN to the translated downscaled first and second images and the disparity map to generate a downscaled intermediate image, and upscaling the downscaled intermediate image to an intermediate image at the resolution of the first and second images using an image super-resolution convolutional neural network.

公开(公告)号：US20200162715A1

公开(公告)日：2020-05-21

申请号：US16752346

申请日：2020-01-24

Applicant: Intel Corporation

Inventor： Bindita Chaudhuri ,  Fan Zhang ,  Oscar Nestares

IPC: H04N13/111 ,  G06T3/40 ,  H04N13/122 ,  G06T3/20 ,  H04N13/139 ,  H04N13/15 ,  H04N13/271 ,  H04N13/161 ,  G06T7/55 ,  H04N13/243 ,  H04N5/232 ,  G06T1/20

Abstract: Techniques related to interpolating an intermediate view image from multi-view images are discussed. Such techniques include downsampling first and second images that represent a view of a scene, generating a disparity map based on applying a first CNN to the downscaled first and second images, translating the downscaled first and second images using the disparity map, applying a second CNN to the translated downscaled first and second images and the disparity map to generate a downscaled intermediate image, and upscaling the downscaled intermediate image to an intermediate image at the resolution of the first and second images using an image super-resolution convolutional neural network.