摘要:
Upon observation of multi-viewpoint images, even when the viewpoint moves continuously, the image cannot normally be displayed in correspondence with the continuous movement of the viewpoint, and an image from a viewpoint closest to the current viewpoint is displayed. To prevent this, each two adjacent images of the multi-viewpoint images are interpolated by detecting corresponding pixels and generating an interpolated image in accordance with the correspondences among pixels. The interpolated image is generated in such a manner that an epipolar plane image is generated by juxtaposing corresponding lines of the multi-viewpoint image, straight lines are detected from the epipolar plane image, and the intersecting points between interpolated lines and the detected straight lines are detected as interpolated pixels. In this case, as for a point for which a straight line cannot be detected, a straight line passing the point is estimated, thereby generating an interpolated pixel. When a plurality of straight lines are detected for a pixel of interest, the priority level is assigned to the pixel of interest in correspondence with the number of detected straight lines. When the priority level is smaller than that of another pixel through which the detected straight line passes, the straight line is ignored, and an interpolated pixel is not generated.
摘要:
Each two adjacent images of multi-viewpoint images are interpolated by detecting corresponding pixels and generating an interpolated image in accordance with the correspondence among pixels. The interpolated image is generated in such a manner that an epipolar plane is generated by juxtaposing corresponding lines of the multi-viewpoint image, straight lines are detected from the epipolar plane image, and the intersecting points between interpolated lines and the detected straight lines are detected as interpolated pixels. In this case, as for a point for which a straight line cannot be detected, a straight line passing the point is estimated, thereby generating an interpolated pixel. When a plurality of straight lines are detected for a pixel of interest, a priority level is assigned to the pixel of interest in correspondence with the number of detected straight lines. When the priority level is smaller than that of another pixel through which the detected straight line passes, the straight line is ignored, and an interpolated pixel is not generated.
摘要:
An image processing apparatus detects corresponding pixels in object images picked up from a plurality of viewpoints and interpolates object images which are supposed to be seen from viewpoints other than the plurality of viewpoints on the basis of the detected corresponding pixels.
摘要:
Images picked up by a plurality of cameras are corrected and projected on a single plane. The input images are converted to projected images on a reference projection plane in accordance with reference parameters and camera parameters. Then images of an area of nx.times.ny whose center is an intersection B that is a perpendicular from a center of a lens of a m-th camera on the reference projection plane are extracted from the projected images. By extracting the area as described above, there is obtained an image which can be assumed that optical axes of each camera intersects perpendicular to the reference projection plane and the optical axes are parallel to each other. Therefore, when an epipolar plane is constructed during an image interpolation process, corresponding points form a straight line on the epipolar plane, thus it becomes easier to detect the corresponding points.
摘要:
An image processing method according to an embodiment of the present invention has the following steps: the multi-viewpoint image input step for inputting images obtained from a plurality of viewpoint positions arranged on different straight lines, the detection step (2, 7, 17, 8) for detecting a viewpoint position and its view direction in which a user is seeing at the viewpoint position, and the image generation step (11, 12, 13, 8) for generating a virtual image viewed from the predetermined viewpoint by using the images input in the multi-viewpoint image input step on the basis of the detected predetermined viewpoint position and the view direction. In the image generation step, optimal corresponding points are obtained by detecting a straight line having a width on an epipolar plane image corresponding to the input images, thereby generating an image.
摘要:
There are provided a multi-viewpoint image database for holding images from a plurality of different viewpoints, a viewpoint detector for detecting a position of the observer's viewpoint, and a viewpoint parameter calculating portion for obtaining a viewpoint parameter from an output from the viewpoint detector. Further, a pixel value producing portion is provided for calculating a parameter necessary for reconstruction of image from the type of display screen and the viewpoint parameter, calculating with the parameter to which pixel in the images in the multi-viewpoint image database each pixel in a reconstructed image corresponds, and extracting corresponding pixels from the multi-viewpoint image database.
摘要:
The present invention relates to an image data processing apparatus for generating an image corresponding to a view point, which is constituted by multi view points image data hold means for holding a plurality of image data having mutually different positions as view points, corresponding point trace detection means for sequentially detecting a coefficient which defines a trace of mutually corresponding points among the multi view points image data and member for outputting the coefficient of each of a plurality of the corresponding point traces present in the multi view points image data.
摘要:
A first process to be executed by an apparatus and a second process to be executed by an apparatus to obtain a composite image by compositing a real space image with a virtual space image are determined by negotiation. The apparatus (101) transmits data necessary for executing the second process to the apparatus. The apparatus executes the second process by using the data and transmits the process result to the apparatus. The apparatus receives the process result by the apparatus and executes the first process. The apparatus displays a composite image obtained on the basis of the result of the first process or a composite image obtained on the basis of the process result and the received process result.
摘要:
There is disclosed a mixed reality presentation apparatus which generates and displays a three-dimensional virtual image on a see-through display device so as to allow a plurality of players to play a multi-player game in a mixed reality environment. The apparatus has a CCD camera for detecting the mallet positions of the plurality of players, and a sensor for detecting the view point position of each player in the environment of the multi-player game. The apparatus generates a three-dimensional virtual image that represents a game result of the multi-player game that has progressed in accordance with changes in mallet position detected by the CCD camera and is viewed from the view point position of each player detected by the sensor, and outputs the generated image to the corresponding see-through display device. The apparatus determines the motion of each player by detecting infrared rays output from the corresponding mallet on the basis of an image captured by the CCD camera. The view point position detected by the sensor is corrected by specifying the marker in an image obtained by a camera attached to the head of each player, and comparing the marker position in that image with an actual marker position.
摘要:
A first process to be executed by an apparatus and a second process to be executed by an apparatus to obtain a composite image by compositing a real space image with a virtual space image are determined by negotiation. The apparatus (101) transmits data necessary for executing the second process to the apparatus. The apparatus executes the second process by using the data and transmits the process result to the apparatus. The apparatus receives the process result by the apparatus and executes the first process. The apparatus displays a composite image obtained on the basis of the result of the first process or a composite image obtained on the basis of the process result and the received process result.