摘要:
The present invention provides a method of generating a virtual viewpoint video image when the virtual viewpoint position is not located on a plane where a camera is disposed. In an environment in which a plurality of cameras having a horizontal optical axis are disposed in a real zone (for example, on the circumference) which surrounds an object, a video image of an arbitrary viewpoint on the circumference is generated. Further, by synthesizing video images photographed by a camera, a free viewpoint video image is generated from a virtual viewpoint (viewpoint from a high or low position) where no camera is placed. According to a method of achieving this, a travel distance of a display position is calculated by the local region synthesizing portion and this travel distance is reflected to the free viewpoint video image of a local region.
摘要:
The present invention provides a method for generating free viewpoint video image in three-dimensional movement capable of synthesizing the free viewpoint video image from a viewpoint which looks down on an object from above. This method includes a process of taking multi-viewpoint video images using a plurality of cameras located on an identical plane and a camera not located on the identical plane, a process of generating video image at a viewpoint having the same azimuth as a desired viewpoint and located on the plane from the multi-viewpoint video images of the cameras on the plane, and a process of generating video image at the desired viewpoint from video image of the camera not located on the plane and video image at the viewpoint having the same azimuth as the desired viewpoint and located on the plane.
摘要:
The present invention provides a method for generating free viewpoint video image in three-dimensional movement capable of synthesizing the free viewpoint video image from a viewpoint which looks down on an object from above. This method includes a process of taking multi-viewpoint video images using a plurality of cameras located on an identical plane and a camera not located on the identical plane, a process of generating video image at a viewpoint having the same azimuth as a desired viewpoint and located on the plane from the multi-viewpoint video images of the cameras on the plane, and a process of generating video image at the desired viewpoint from video image of the camera not located on the plane and video image at the viewpoint having the same azimuth as the desired viewpoint and located on the plane.
摘要:
The present invention relates to color correction of video signals from a plurality of cameras. The apparatus has a correction order that defines a plurality of camera pairs and an order of the camera pairs, where each camera pair specifies a reference camera and a target camera. In the correction order, each camera is treated as a target camera at least one time, and the reference camera is treated as the target camera in a previous camera pair except for the first camera pair. The apparatus corrects a value of each pixel in a target image captured by the target camera based on a reference image captured by the reference camera, and replaces the target image by the corrected target image, for each camera pair in accordance with the order of the camera pairs.
摘要:
The present invention relates to calibration of camera parameters for converting a world coordinate system, which indicates a position in the real space, to a coordinate used in an image and vice versa. The apparatus according to the invention has a detection unit, which determines corresponding pixel pairs from the captured image and the model image and outputs corresponding data indicating determined pixel pairs, and a selection unit, which selects pixel pairs to be left in the corresponding data and removes data related to an unselected pixel pair from the corresponding data for generating selected corresponding data. The apparatus further has a calculation unit, which calculates camera parameters based on the selected corresponding data.
摘要:
The present invention relate to an image generating apparatus for generating an image from a viewpoint specified by a user. According to the invention, the apparatus has a storage unit that stores data of a plurality of images, and a disparity map generating unit that generates a disparity map. The disparity map is associated with a pair of images including a first image and a second image, and indicates corresponding pixels in the first and second images.
摘要:
The present invention relates to an apparatus and a method for classifying pixels in each frame of a motion picture as foreground or background. According to the invention, the apparatus has a decision unit and adjustment unit. The decision unit classifies a pixel as a foreground pixel, a background pixel or an undefined pixel based on a first threshold, a second threshold and a distribution value of the pixel representing an occurrence probability of a pixel value of the pixel. The decision unit sorts each pixel into a foreground pixel or a background pixel based on the classification result of the decision unit.
摘要:
The present invention relates to color correction of video signals from a plurality of cameras. The apparatus has a correction order that defines a plurality of camera pairs and an order of the camera pairs, where each camera pair specifies a reference camera and a target camera. In the correction order, each camera is treated as a target camera at least one time, and the reference camera is treated as the target camera in a previous camera pair except for the first camera pair. The apparatus corrects a value of each pixel in a target image captured by the target camera based on a reference image captured by the reference camera, and replaces the target image by the corrected target image, for each camera pair in accordance with the order of the camera pairs.
摘要:
A plurality of cameras is placed so that those optical axes become parallel to the Z-axis and are in relative position t on the XY plane. Multi-view video compression coding apparatus determines depth distance Z and unit normal vector (nx, ny, nz) of the arbitrary point in the surface of the object, moves the first block by disparity vector based on t and Z, transforming the first block by linear transformation matrix based on t, Z and n, then, matching the first block to block of the second picture. Then, while changing Z and n arbitrarily, the second block of the second picture which is most similar to the first block is searched for. And the apparatus derives a prediction error between the first block and the second block, codes the prediction error, and adds Z and n to coded data.
摘要:
A plurality of cameras is placed so that those optical axes become parallel to the Z-axis and are in relative position t on the XY plane. Multi-view video compression coding apparatus determines depth distance Z and unit normal vector (nx, ny, nz) of the arbitrary point in the surface of the object, moves the first block by disparity vector based on t and Z, transforming the first block by linear transformation matrix based on t, Z and n, then, matching the first block to block of the second picture. Then, while changing Z and n arbitrarily, the second block of the second picture which is most similar to the first block is searched for. And the apparatus derives a prediction error between the first block and the second block, codes the prediction error, and adds Z and n to coded data.