公开(公告)号：US11909942B2

公开(公告)日：2024-02-20

申请号：US17082321

申请日：2020-10-28

Applicant: CANON KABUSHIKI KAISHA

Inventor： Shin Tanaka

IPC: G01C3/08 ,  H04N13/232 ,  H04N23/63

CPC classification number: H04N13/232 ,  G01C3/085 ,  H04N23/63

Abstract: There is provided a parallax detecting apparatus. A first obtainment unit obtains a first viewpoint image and a second viewpoint image that have different viewpoints from each other in a first direction. A second obtainment unit obtains displacement information that specifies a displacement amount in a second direction between positions in the first viewpoint image and the second viewpoint image corresponding to a same position in a shooting range. The displacement amount varies in conformity with a parallax amount between the positions. The second direction is perpendicular to the first direction. A calculation unit performs correlation calculation processing with respect to each of a plurality of reference regions corresponding to a plurality of reference positions in the second viewpoint image. A detection unit detects a parallax amount at a base position in the first viewpoint image based on calculated correlations.

公开(公告)号：US11870967B2

公开(公告)日：2024-01-09

申请号：US17653796

申请日：2022-03-07

Applicant: Nevermind Capital LLC

Inventor： David Cole ,  Alan Mckay Moss

IPC: H04N7/14 ,  H04N13/111 ,  G06F3/01 ,  H04N19/44 ,  H04N13/139 ,  H04N13/161 ,  H04N13/189 ,  H04N13/194 ,  H04N13/204 ,  H04N13/282 ,  G09G3/00 ,  G09G5/00 ,  H04N13/344 ,  H04N13/232 ,  H04N13/279 ,  H04N13/271 ,  H04N13/239 ,  G06F3/04815 ,  G06T17/05 ,  G06T17/20 ,  G06T19/20 ,  H04N21/434 ,  G06V40/10

CPC classification number: H04N13/111 ,  G06F3/011 ,  G06F3/012 ,  G06F3/04815 ,  G06T17/05 ,  G06T17/20 ,  G06T19/20 ,  G09G3/003 ,  G09G5/001 ,  G09G5/003 ,  G09G5/006 ,  H04N13/139 ,  H04N13/161 ,  H04N13/189 ,  H04N13/194 ,  H04N13/204 ,  H04N13/232 ,  H04N13/239 ,  H04N13/271 ,  H04N13/279 ,  H04N13/282 ,  H04N13/344 ,  H04N19/44 ,  H04N21/4345 ,  G06T2207/30244 ,  G06V40/10 ,  G09G2352/00 ,  G09G2360/02 ,  G09G2360/125 ,  G09G2370/02

Abstract: Methods and apparatus for supporting the capture of images of surfaces of an environment visible from a default viewing position and capturing images of surfaces not visible from the default viewing position, e.g., occluded surfaces, are described. Occluded and non-occluded image portions are packed into one or more frames and communicated to a playback device for use as textures which can be applied to a model of the environment where the images were captured. An environmental model includes a model of surfaces which are occluded from view from a default viewing position but which maybe viewed is the user shifts the user's viewing location. Occluded image content can be incorporated directly into a frame that also includes non-occluded image data or sent in frames of a separate, e.g., auxiliary content stream that is multiplexed with the main content stream which communicates image data corresponding to non-occluded environmental portions.

公开(公告)号：US11849100B2

公开(公告)日：2023-12-19

申请号：US17825730

申请日：2022-05-26

Applicant: CANON KABUSHIKI KAISHA

Inventor： Toshitaka Aiba ,  Toru Kobayashi ,  Shuhei Iino ,  Takumi Uehara ,  Atsuto Noda

IPC: H04N13/246 ,  H04N13/156 ,  H04N13/178 ,  H04N13/232

CPC classification number: H04N13/246 ,  H04N13/156 ,  H04N13/178 ,  H04N13/232

Abstract: An information processing apparatus includes: a processor; and a memory storing a program which, when executed by the processor, causes the information processing apparatus to obtain an image and correction information on a first optical system and a second optical system, the image including a first area corresponding to a first image inputted via the first optical system and a second area corresponding to a second image inputted via the second optical system having a predetermined parallax with respect to the first optical system; execute correcting processing of correcting, based on the correction information, positions of a pixel included in the first area and a pixel included in the second area in the image, and generate a processed image by executing processing of transforming the corrected first area and the corrected second area.

公开(公告)号：US20230308627A1

公开(公告)日：2023-09-28

申请号：US17898589

申请日：2022-08-30

Applicant: CANON KABUSHIKI KAISHA

Inventor： Hiroki Ito ,  Yosuke Fukai ,  Kiyoshi Nitto ,  Taro Murakami ,  Atsuto Noda ,  Takumi Uehara

IPC: H04N13/232 ,  G02B7/10 ,  H04N23/55

CPC classification number: H04N13/232 ,  G02B7/10 ,  H04N23/55

Abstract: A lens apparatus includes a first optical system, a second optical system, a first focus adjusting unit configured to simultaneously adjust focus of the first optical system and the second optical system, and a second focus adjusting unit configured to adjust a relative shift of focus positions of the first optical system and the second optical system. The first focus adjusting unit is connected to both the first optical system and the second optical system. The second focus adjusting unit is connected to one of the first optical system and the second optical system.

公开(公告)号：US11700364B2

公开(公告)日：2023-07-11

申请号：US17741444

申请日：2022-05-11

Applicant: Paul Lapstun

Inventor： Paul Lapstun

IPC: H04N13/383 ,  H04N13/128 ,  H04N13/302 ,  H04N13/398 ,  H04N13/232 ,  H04N13/307

CPC classification number: H04N13/383 ,  H04N13/128 ,  H04N13/232 ,  H04N13/302 ,  H04N13/307 ,  H04N13/398

Abstract: A method of displaying a light field to at least one viewer of a light field display device, the light field based on a 3D model, the light field display device comprising a plurality of spatially distributed display elements, the method including the steps of: (a) determining the viewpoints of the eyes of the at least one viewer relative to the display device; (b) for each eye viewpoint and each of a plurality of the display elements, rendering a partial view image representing a view of the 3D model from the eye viewpoint through the display element; and (c) displaying, via each display element, the set of partial view images rendered for that display element.

公开(公告)号：US11694349B2

公开(公告)日：2023-07-04

申请号：US17028180

申请日：2020-09-22

Applicant: INTERDIGITAL CE PATENT HOLDINGS

Inventor： Julien Fleureau ,  Pierre Hellier ,  Benoit Vandame

IPC: G06T7/00 ,  G06T7/33 ,  G02B27/00 ,  G06T7/70 ,  H04N13/232 ,  H04N23/67 ,  H04N23/63 ,  G06T7/73 ,  G06T7/90 ,  H04N13/00

CPC classification number: G06T7/337 ,  G02B27/0075 ,  G06T7/001 ,  G06T7/0002 ,  G06T7/70 ,  G06T7/74 ,  G06T7/90 ,  H04N13/232 ,  H04N23/633 ,  H04N23/67 ,  G06T2200/21 ,  G06T2207/10028 ,  G06T2207/10052 ,  G06T2207/30108 ,  G06T2207/30244 ,  H04N2013/0081

Abstract: The present invention generally relates to an apparatus and a method for obtaining a registration error map representing a level of sharpness of an image. Many methods are known which allow determining the position of a camera with respect to an object, based on the knowledge of a 3D model of the object and the intrinsic parameters of the camera. However, regardless of the visual servoing technique used, there is no control in the image space and the object may get out of the camera field of view during servoing. It is proposed to obtain a registration error map relating to an image of the object of interest generated by computing an intersection of a re-focusing surface obtained from a 3D model of said object of interest and a focal stack based on acquired four-dimensional light-field data relating to said object of interest.

公开(公告)号：US20190089947A1

公开(公告)日：2019-03-21

申请号：US16179796

申请日：2018-11-02

Applicant: FotoNation Limited

Inventor： Kartik Venkataraman ,  Paul Gallagher ,  Ankit K. Jain ,  Semyon Nisenzon ,  Dan Lelescu ,  Florian Ciurea ,  Gabriel Molina

IPC: H04N13/271 ,  G01P3/38 ,  H04N13/243 ,  H04N13/232

CPC classification number: H04N13/271 ,  G01P3/38 ,  H04N13/232 ,  H04N13/243

Abstract: Systems with an array camera augmented with a conventional camera in accordance with embodiments of the invention are disclosed. In some embodiments, the array camera is used to capture a first set of image data of a scene and a conventional camera is used to capture a second set of image data for the scene. An object of interest is identified in the first set of image data. A first depth measurement for the object of interest is determined and compared to a predetermined threshold. If the first depth measurement is above the threshold, a second set of image data captured using the conventional camera is obtained. The object of interest is identified in the second set of image data and a second depth measurement for the object of interest is determined using at least a portion of the first set of image data and at least a portion of the second set of image data.

公开(公告)号：US10075696B2

公开(公告)日：2018-09-11

申请号：US14554897

申请日：2014-11-26

Applicant: THOMSON LICENSING

Inventor： Neus Sabater ,  Valter Drazic ,  Gustavo Luiz Sandri

IPC: H04N13/02 ,  G06T7/00 ,  H04N13/00

CPC classification number: H04N13/257 ,  G06T7/97 ,  G06T2207/10052 ,  H04N13/232 ,  H04N2013/0081

Abstract: The invention is related to a method of determining a disparity information associated with at least a block of pixel of a first view of a scene, a matrix of views comprising the first view and a plurality of second views of the scene. The first and second views are obtained by demultiplexing a raw image of the scene acquired with a plenoptic camera but are not demosaiced. The method comprises comparing a first color pattern associated with the first block of the first view with at least one second color pattern associated with at least one second block of at least one of the second views belonging to the row or the column comprising the first view in the matrix; selecting at least one second block if the associated second color pattern corresponds at least partially to the first color pattern; and determining the disparity information associated with the first block by using the selected at least one second block and the first block.

公开(公告)号：US20180227568A1

公开(公告)日：2018-08-09

申请号：US15426616

申请日：2017-02-07

Applicant: Siemens Healthcare GmbH

Inventor： Christoph Vetter ,  Kaloian Petkov ,  Daphne Yu

IPC: H04N13/04 ,  H04N13/00 ,  G06T15/08 ,  G06T7/557

CPC classification number: H04N13/395 ,  G06T7/557 ,  G06T15/08 ,  G06T15/205 ,  G06T2200/21 ,  G06T2207/10052 ,  G06T2207/20092 ,  G06T2210/08 ,  G06T2210/41 ,  H04N13/128 ,  H04N13/232 ,  H04N13/324 ,  H04N2013/0081

Abstract: Physically-based volume rendering generates a lightfield. The locations of scattering modeled in physically-based rendering are used to assign depths for the lightfield. The previously assigned depths and previously rendered lightfield are used for lightfield rendering, which may be performed more rapidly than the physically-based volume rendering.

公开(公告)号：US20180211402A1

公开(公告)日：2018-07-26

申请号：US15858974

申请日：2017-12-29

Applicant: FotoNation Cayman Limited

Inventor： Florian Ciurea ,  Kartik Venkataraman ,  Gabriel Molina ,  Dan Lelescu

IPC: G06T7/593 ,  G06T7/557 ,  G02B27/00 ,  G06T15/20 ,  H04N13/00 ,  H04N9/097 ,  G06T7/80

CPC classification number: G06T7/593 ,  G02B27/0075 ,  G06T7/557 ,  G06T7/85 ,  G06T15/20 ,  G06T2200/21 ,  G06T2207/10012 ,  G06T2207/10024 ,  G06T2207/10052 ,  H04N9/097 ,  H04N13/128 ,  H04N13/232 ,  H04N13/243 ,  H04N2013/0081 ,  H04N2013/0088

Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.