公开(公告)号：US20200226736A1

公开(公告)日：2020-07-16

申请号：US16574622

申请日：2019-09-18

Applicant: Fyusion, Inc.

Inventor： Abhishek Kar ,  Rodrigo Ortiz Cayon ,  Ben Mildenhall ,  Stefan Johannes Josef Holzer ,  Radu Bogdan Rusu

IPC: G06T7/00 ,  G06T7/50 ,  H04N5/232

Abstract: A sampling density for capturing a plurality of two-dimensional images of a three-dimensional scene may be determined. The sampling density may be below the Nyquist rate. However, the sampling density may be sufficiently high such that captured images may be promoted to multiplane images and used to generate novel viewpoints in a light field reconstruction framework. Recording guidance may be provided at a display screen on a mobile computing device based on the determined sampling density. The recording guidance identifying a plurality of camera poses at which to position a camera to capture images of the three-dimensional scene. A plurality of images captured via the camera based on the recording guidance may be stored on a storage device.

公开(公告)号：US20200228774A1

公开(公告)日：2020-07-16

申请号：US16574639

申请日：2019-09-18

Applicant: Fyusion, Inc.

Inventor： Abhishek Kar ,  Rodrigo Ortiz Cayon ,  Ben Mildenhall ,  Stefan Johannes Josef Holzer ,  Radu Bogdan Rusu

IPC: H04N13/111 ,  G06T7/557 ,  H04N13/271 ,  G06T7/579 ,  G06T7/70 ,  G06T7/514 ,  G06T15/20

Abstract: An estimated camera pose may be determined for each of a plurality of single plane images of a designated three-dimensional scene. The sampling density of the single plane images may be below the Nyquist rate. However, the sampling density of the single plane images may be sufficiently high such that the single plane images is sufficiently high such that they may be promoted to multiplane images and used to generate novel viewpoints in a light field reconstruction framework. Scene depth information identifying for each of a respective plurality of pixels in the single plane image a respective depth value may be determined for each single plane image. A respective multiplane image including a respective plurality of depth planes may be determined for each single plane image. Each of the depth planes may include a respective plurality of pixels from the respective single plane image.

公开(公告)号：US10893250B2

公开(公告)日：2021-01-12

申请号：US16574652

申请日：2019-09-18

Applicant: Fyusion, Inc.

Inventor： Abhishek Kar ,  Rodrigo Ortiz Cayon ,  Ben Mildenhall ,  Stefan Johannes Josef Holzer ,  Radu Bogdan Rusu

IPC: G09G5/00 ,  H04N13/111 ,  G06T7/557 ,  H04N13/271 ,  G06T7/579 ,  G06T7/70 ,  G06T7/514 ,  G06T15/20 ,  G06T7/00 ,  G06T15/00 ,  G06T15/50 ,  G06T7/50 ,  H04N5/232 ,  G06T15/08 ,  H04N13/00

Abstract: A respective target viewpoint may be rendered for each of a plurality of multiplane images of a three-dimensional scene. Each of the multiplane images may be associated with a respective single plane image of the three-dimensional scene captured from a respective viewpoint. Each of the multiplane images may include a respective plurality of depth planes. Each of the depth planes may include a respective plurality of pixels from the respective single plane image. Each of the pixels in the depth plane may be positioned at approximately the same distance from the respective viewpoint. A weighted combination of the target viewpoint renderings may be determined, where the sampling density of the single plane images is sufficiently high that the weighted combination satisfies the inequality in Equation (7). The weighted combination of the target viewpoint renderings may be transmitted as a novel viewpoint image.

公开(公告)号：US10958887B2

公开(公告)日：2021-03-23

申请号：US16574622

申请日：2019-09-18

Applicant: Fyusion, Inc.

Inventor： Abhishek Kar ,  Rodrigo Ortiz Cayon ,  Ben Mildenhall ,  Stefan Johannes Josef Holzer ,  Radu Bogdan Rusu

IPC: G06T15/50 ,  H04N13/111 ,  G06T7/557 ,  H04N13/271 ,  G06T7/579 ,  G06T7/70 ,  G06T7/514 ,  G06T15/20 ,  G06T7/00 ,  G06T15/00 ,  G06T7/50 ,  H04N5/232 ,  G06T15/08 ,  H04N13/00

Abstract: A sampling density for capturing a plurality of two-dimensional images of a three-dimensional scene may be determined. The sampling density may be below the Nyquist rate. However, the sampling density may be sufficiently high such that captured images may be promoted to multiplane images and used to generate novel viewpoints in a light field reconstruction framework. Recording guidance may be provided at a display screen on a mobile computing device based on the determined sampling density. The recording guidance identifying a plurality of camera poses at which to position a camera to capture images of the three-dimensional scene. A plurality of images captured via the camera based on the recording guidance may be stored on a storage device.

公开(公告)号：US10911732B2

公开(公告)日：2021-02-02

申请号：US16574639

申请日：2019-09-18

Applicant: Fyusion, Inc.

Inventor： Abhishek Kar ,  Rodrigo Ortiz Cayon ,  Ben Mildenhall ,  Stefan Johannes Josef Holzer ,  Radu Bogdan Rusu

IPC: G06T15/50 ,  H04N13/111 ,  G06T7/557 ,  H04N13/271 ,  G06T7/579 ,  G06T7/70 ,  G06T7/514 ,  G06T15/20 ,  G06T7/00 ,  G06T15/00 ,  G06T7/50 ,  H04N5/232 ,  G06T15/08 ,  H04N13/00

Abstract: An estimated camera pose may be determined for each of a plurality of single plane images of a designated three-dimensional scene. The sampling density of the single plane images may be below the Nyquist rate. However, the sampling density of the single plane images may be sufficiently high such that the single plane images is sufficiently high such that they may be promoted to multiplane images and used to generate novel viewpoints in a light field reconstruction framework. Scene depth information identifying for each of a respective plurality of pixels in the single plane image a respective depth value may be determined for each single plane image. A respective multiplane image including a respective plurality of depth planes may be determined for each single plane image. Each of the depth planes may include a respective plurality of pixels from the respective single plane image.

公开(公告)号：US20200226816A1

公开(公告)日：2020-07-16

申请号：US16574652

申请日：2019-09-18

Applicant: Fyusion, Inc.

Inventor： Abhishek Kar ,  Rodrigo Ortiz Cayon ,  Ben Mildenhall ,  Stefan Johannes Josef Holzer ,  Radu Bogdan Rusu

IPC: G06T15/20 ,  G06T15/50 ,  G06T15/00 ,  G06T7/00

Abstract: A respective target viewpoint may be rendered for each of a plurality of multiplane images of a three-dimensional scene. Each of the multiplane images may be associated with a respective single plane image of the three-dimensional scene captured from a respective viewpoint. Each of the multiplane images may include a respective plurality of depth planes. Each of the depth planes may include a respective plurality of pixels from the respective single plane image. Each of the pixels in the depth plane may be positioned at approximately the same distance from the respective viewpoint. A weighted combination of the target viewpoint renderings may be determined, where the sampling density of the single plane images is sufficiently high that the weighted combination satisfies the inequality in Equation (7). The weighted combination of the target viewpoint renderings may be transmitted as a novel viewpoint image.