公开(公告)号：US20230269353A1

公开(公告)日：2023-08-24

申请号：US18308639

申请日：2023-04-27

Applicant: Matterport, Inc.

Inventor： Kyle Simek ,  David Alan Gausebeck ,  Matthew Tschudy Bell

IPC: H04N13/106 ,  H04N5/265 ,  H04N13/254 ,  H04N13/239 ,  H04N13/232 ,  H04N13/271 ,  H04N23/45

CPC classification number: H04N13/106 ,  H04N5/265 ,  H04N13/254 ,  H04N13/239 ,  H04N13/232 ,  H04N13/271 ,  H04N23/45 ,  G06T2207/20221 ,  H04N23/698

Abstract: This application generally relates to capturing and aligning panoramic image and depth data. In one embodiment, a device is provided that comprises a housing and a plurality of cameras configured to capture two-dimensional images, wherein the cameras are arranged at different positions on the housing and have different azimuth orientations relative to a center point such that the cameras have a collective field-of-view spanning up to 360° horizontally. The device further comprises a plurality of depth detection components configured to capture depth data, wherein the depth detection components are arranged at different positions on the housing and have different azimuth orientations relative to the center point such that the depth detection components have the collective field-of-view spanning up to 360° horizontally.

公开(公告)号：US20190250419A1

公开(公告)日：2019-08-15

申请号：US16390878

申请日：2019-04-22

Applicant: NIKON CORPORATION

Inventor： Toru IWANE

IPC: G02B27/22 ,  G03B35/24 ,  H04N13/232 ,  H04N13/307

CPC classification number: G02B27/2214 ,  G03B35/24 ,  H04N13/232 ,  H04N13/307

Abstract: An image display device includes: an input unit that inputs image data constituted with pixel data, each set of the pixel data being generated based upon a plurality of image signals output from a plurality of image-capturing pixels arrayed in correspondence to a plurality of photographic micro-lenses distinct from one another; a generation unit that generates display image data containing three-dimensional information based upon the image data; a display unit constituted with a plurality of display pixels disposed in a two-dimensional pattern, which emits light fluxes from the plurality of display pixels in correspondence to the display image data; and a micro-lens array that includes a plurality of micro-lenses, via which a three-dimensional image is formed by combining the light fluxes emitted from the plurality of display pixels, disposed in a two-dimensional array pattern.

公开(公告)号：US20180342075A1

公开(公告)日：2018-11-29

申请号：US15605037

申请日：2017-05-25

Applicant: Lytro, Inc.

Inventor： Zejing Wang ,  Thomas Nonn

IPC: G06T7/557 ,  H04N13/02

CPC classification number: H04N13/218 ,  H04N5/22541 ,  H04N13/111 ,  H04N13/139 ,  H04N13/232 ,  H04N2213/003

Abstract: Dense light-field data can be generated from image data that does not include light-field data, or from image data that includes sparse light-field data. In at least one embodiment, the source light-field data may include one or more sub-aperture images that may be used to reconstruct the light-field in denser form. In other embodiments, the source data can take other forms. Examples include data derived from or ancillary to a set of sub-aperture images, synthetic data, or captured image data that does not include full light-field data. Interpolation, back-projection, and/or other techniques are used in connection with source sub-aperture images or their equivalents, to generate dense light-field data.

公开(公告)号：US10085005B2

公开(公告)日：2018-09-25

申请号：US15084326

申请日：2016-03-29

Applicant: Lytro, Inc.

Inventor： Colvin Pitts ,  Yonggang Ha ,  William Houck

IPC: H04N13/111 ,  H04N13/282 ,  H04N5/225 ,  H04N13/232 ,  H04N13/275 ,  H04N13/02 ,  H04N13/00 ,  H04N13/04

CPC classification number: H04N13/111 ,  H04N5/2254 ,  H04N13/117 ,  H04N13/232 ,  H04N13/243 ,  H04N13/275 ,  H04N13/282 ,  H04N13/344

Abstract: A capture system may capture light-field data representative of an environment for use in virtual reality, augmented reality, and the like. The system may have a plurality of light-field cameras arranged to capture a light-field volume within the environment, and a processor. The processor may use the light-field volume to generate a first virtual view depicting the environment from a first virtual viewpoint. The light-field cameras may be arranged in a tiled array to define a capture surface with a ring-shaped, spherical, or other arrangement. The processor may map the pixels captured by the image sensors to light rays received in the light-field volume, and store data descriptive of the light rays in a coordinate system representative of the light-field volume.

公开(公告)号：US20180260969A1

公开(公告)日：2018-09-13

申请号：US15761090

申请日：2016-09-16

Applicant: THOMSON Licensing

Inventor： Guillaume BOISSON ,  Arno SCHUBERT ,  Laurent BLONDE

IPC: G06T7/557 ,  G06T7/62

CPC classification number: G06T7/557 ,  G06T7/62 ,  G06T2207/10052 ,  H04N5/225 ,  H04N13/232

Abstract: There are several types of plenoptic devices and camera arrays available on the market, and all these light field acquisition devices have their proprietary file format. However, there is no standard supporting the acquisition and transmission of multi-dimensional information. It is interesting to obtain information related to a correspondence between pixels of a sensor of said optical acquisition system and an object space of said optical acquisition system. Indeed, knowing which portion of the object space of an optical acquisition system a pixel belonging to the sensor of said optical acquisition system is sensing enables the improvement of signal processing operations. The notion of pixel beam, which represents a volume occupied by a set of rays of light in an object space of an optical system of a camera is thus introduce.

公开(公告)号：US20180234676A1

公开(公告)日：2018-08-16

申请号：US15871777

申请日：2018-01-15

Applicant: NextVR Inc.

Inventor： David Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC: H04N17/00 ,  H04N13/275 ,  H04N13/246 ,  G06T11/00 ,  G06T15/04

CPC classification number: H04N17/002 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G06T7/85 ,  G06T11/001 ,  G06T15/04 ,  G06T2207/10021 ,  H04N5/23238 ,  H04N13/232 ,  H04N13/246 ,  H04N13/275 ,  H04N21/41407 ,  H04N21/4402 ,  H04N21/4854 ,  H04N21/816

Abstract: Camera and/or lens calibration information is generated as part of a calibration process in video systems including 3-dimensional (3D) immersive content systems. The calibration information can be used to correct for distortions associated with the source camera and/or lens. A calibration profile can include information sufficient to allow the system to correct for camera and/or lens distortion/variation. This can be accomplished by capturing a calibration image of a physical 3D object corresponding to the simulated 3D environment, and creating the calibration profile by processing the calibration image. The calibration profile can then be used to project the source content directly into the 3D viewing space while also accounting for distortion/variation, and without first translating into an intermediate space (e.g., a rectilinear space) to account for lens distortion.

公开(公告)号：US20180197309A1

公开(公告)日：2018-07-12

申请号：US15865210

申请日：2018-01-08

Applicant: NextVR Inc.

Inventor： David Michael Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC: G06T7/80 ,  G02B27/01 ,  G06T11/00 ,  G06T19/00 ,  G06T15/04 ,  H04N21/414 ,  H04N21/4402 ,  H04N21/81 ,  H04N21/485

CPC classification number: G06T7/80 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G06T7/85 ,  G06T11/001 ,  G06T11/40 ,  G06T15/04 ,  G06T19/003 ,  G06T19/006 ,  G06T2207/10021 ,  H04N13/232 ,  H04N13/246 ,  H04N13/275 ,  H04N21/41407 ,  H04N21/4402 ,  H04N21/4854 ,  H04N21/816

Abstract: Camera and/or lens calibration information is generated as part of a calibration process in video systems including 3-dimensional (3D) immersive content systems. The calibration information can be used to correct for distortions associated with the source camera and/or lens. A calibration profile can include information sufficient to allow the system to correct for camera and/or lens distortion/variation. This can be accomplished by capturing a calibration image of a physical 3D object corresponding to the simulated 3D environment, and creating the calibration profile by processing the calibration image. The calibration profile can then be used to project the source content directly into the 3D viewing space while also accounting for distortion/variation, and without first translating into an intermediate space (e.g., a rectilinear space) to account for lens distortion.

公开(公告)号：US20180189965A1

公开(公告)日：2018-07-05

申请号：US15737301

申请日：2016-06-16

Applicant: THOMSON Licensing

Inventor： Julien FLEUREAU ,  Pierre HELLIER ,  Benoit VANDAME

IPC: G06T7/33 ,  G06T7/00 ,  G06T7/73 ,  G06T7/90

CPC classification number: G06T7/337 ,  G02B27/0075 ,  G06T7/0002 ,  G06T7/001 ,  G06T7/70 ,  G06T7/74 ,  G06T7/90 ,  G06T2200/21 ,  G06T2207/10028 ,  G06T2207/10052 ,  G06T2207/30108 ,  G06T2207/30244 ,  H04N5/2254 ,  H04N13/232 ,  H04N2013/0081

Abstract: The present invention generally relates to an apparatus and a method for obtaining a registration error map representing a level of sharpness of an image. Many methods are known which allow determining the position of a camera with respect to an object, based on the knowledge of a 3D model of the object and the intrinsic parameters of the camera. However, regardless of the visual servoing technique used, there is no control in the image space and the object may get out of the camera field of view during servoing. It is proposed to obtain a registration error map relating to an image of the object of interest generated by computing an intersection of a re-focusing surface obtained from a 3D model of said object of interest and a focal stack based on acquired four-dimensional light-field data relating to said object of interest.

公开(公告)号：US20180097993A1

公开(公告)日：2018-04-05

申请号：US15785315

申请日：2017-10-16

Applicant: FotoNation Cayman Limited

Inventor： Shree Nayar ,  Kartik Venkataraman ,  Bedabrata Pain ,  Dan Lelescu

IPC: H04N5/232 ,  H04N9/097 ,  H04N13/02 ,  H04N5/225 ,  H04N13/00

CPC classification number: H04N5/23232 ,  H04N5/2258 ,  H04N5/3415 ,  H04N9/097 ,  H04N13/232 ,  H04N13/271 ,  H04N2013/0081

Abstract: Imager arrays, array camera modules, and array cameras in accordance with embodiments of the invention utilize pixel apertures to control the amount of aliasing present in captured images of a scene. One embodiment includes a plurality of focal planes, control circuitry configured to control the capture of image information by the pixels within the focal planes, and sampling circuitry configured to convert pixel outputs into digital pixel data. In addition, the pixels in the plurality of focal planes include a pixel stack including a microlens and an active area, where light incident on the surface of the microlens is focused onto the active area by the microlens and the active area samples the incident light to capture image information, and the pixel stack defines a pixel area and includes a pixel aperture, where the size of the pixel apertures is smaller than the pixel area.

公开(公告)号：US20180067237A1

公开(公告)日：2018-03-08

申请号：US15697364

申请日：2017-09-06

Applicant: THOMSON Licensing

Inventor： Benoit VANDAME ,  Frederic Babon ,  Valter Drazic

IPC: G02B3/00 ,  H04N13/02 ,  H04N5/225 ,  G02B27/00 ,  G02B13/00

CPC classification number: H04N5/22541 ,  G02B3/0056 ,  G02B3/0075 ,  G02B13/0015 ,  G02B13/0055 ,  G02B27/0075 ,  G06T7/557 ,  H04N5/2254 ,  H04N5/2259 ,  H04N13/232

Abstract: A plenoptic imaging device is described including a micro-lens array placed between a main lens and a photosensor. The micro-lens array has a plurality of micro-lenses each configured to project a micro-image onto the photosensor, the main lens covering a central field-of-view of the scene according to capture axis. The plenoptic imaging device includes multi-faceted optical means structure having at least two facets and placed in a plane adjacent to the aperture diaphragm plane and centered on the main optical axis, each facet being configured to angularly rotated the capture axis with respect to the main optical axis so as to capture a rotated field-of-view from the central field-of-view, and so that the captured rotated field-of-views form an expanded field-of-view covering the central field-of-view.