Multi-viewpoint image processing method and apparatus
    1.
    发明授权
    Multi-viewpoint image processing method and apparatus 失效
    多视点图像处理方法和装置

    公开(公告)号:US06608622B1

    公开(公告)日:2003-08-19

    申请号:US08543121

    申请日:1995-10-13

    IPC分类号: G06T1700

    CPC分类号: G06T15/205 G06T15/10

    摘要: An image processing method according to an embodiment of the present invention has the following steps: the multi-viewpoint image input step for inputting images obtained from a plurality of viewpoint positions arranged on different straight lines, the detection step (2, 7, 17, 8) for detecting a viewpoint position and its view direction in which a user is seeing at the viewpoint position, and the image generation step (11, 12, 13, 8) for generating a virtual image viewed from the predetermined viewpoint by using the images input in the multi-viewpoint image input step on the basis of the detected predetermined viewpoint position and the view direction. In the image generation step, optimal corresponding points are obtained by detecting a straight line having a width on an epipolar plane image corresponding to the input images, thereby generating an image.

    摘要翻译: 根据本发明的实施例的图像处理方法具有以下步骤:多视点图像输入步骤,用于输入从布置在不同直线上的多个视点位置获得的图像,检测步骤(2,7,17​​, 8),用于检测用户在视点位置观看的视点位置及其观看方向,以及图像生成步骤(11,12,13,8),用于通过使用图像生成从预定视点观看的虚像 基于检测到的预定视点位置和视图方向在多视点图像输入步骤中输入。 在图像生成步骤中,通过检测对应于输入图像的对数平面图像上的宽度的直线来获得最佳对应点,从而生成图像。

    Display apparatus and information processing method
    3.
    发明授权
    Display apparatus and information processing method 失效
    显示装置和信息处理方法

    公开(公告)号:US06970166B2

    公开(公告)日:2005-11-29

    申请号:US10266683

    申请日:2002-10-09

    CPC分类号: G06T19/006 G06T11/00

    摘要: A display apparatus for displaying a virtual image superposed upon a real world image, which can automatically set the focus of a lens to the virtual image, a virtual world image object having a high importance degree or a real world image object having a high importance degree. The display apparatus has a lens for capturing light from a real world, a lens state control unit for controlling a state of the lens including a focus, a storage unit for storing computer image data, a computer image generation unit for generating a computer image by using the computer image data stored in the storage unit in accordance with lens state information of the lens state and the like; and a synthesis display unit for synthesizing an image captured via the lens and the generated computer image and displaying a synthetic image.

    摘要翻译: 一种显示装置,用于显示叠加在真实世界图像上的虚拟图像,该虚拟图像可以自动将透镜的焦点设置为虚拟图像,具有高重要度的虚拟世界图像对象或具有高重要度的真实世界图像对象 。 该显示装置具有用于捕获来自现实世界的光的透镜,用于控制包括聚焦的透镜的状态的透镜状态控制单元,用于存储计算机图像数据的存储单元,用于生成计算机图像的计算机图像生成单元 根据透镜状态等的透镜状态信息,使用存储在存储单元中的计算机图像数据; 以及合成显示单元,用于合成通过透镜捕获的图像和生成的计算机图像并显示合成图像。

    Display apparatus and information processing method
    4.
    发明授权
    Display apparatus and information processing method 有权
    显示装置和信息处理方法

    公开(公告)号:US07411588B2

    公开(公告)日:2008-08-12

    申请号:US11126355

    申请日:2005-05-11

    IPC分类号: G06T15/00

    CPC分类号: G06T19/006 G06T11/00

    摘要: A display apparatus for displaying a virtual image superposed upon a real world image, which can automatically set the focus of a lens to the virtual image, a virtual world image object having a high importance degree or a real world image object having a high importance degree. The display apparatus has a lens for capturing light from a real world, a lens state control unit for controlling a state of the lens including a focus, a storage unit for storing computer image data, a computer image generation unit for generating a computer image by using the computer image data stored in the storage unit in accordance with lens state information of the lens state and the like; and a synthesis display unit for synthesizing an image captured via the lens and the generated computer image and displaying a synthetic image.

    摘要翻译: 一种显示装置,用于显示叠加在真实世界图像上的虚拟图像,该虚拟图像可以自动将透镜的焦点设置为虚拟图像,具有高重要度的虚拟世界图像对象或具有高重要度的真实世界图像对象 。 该显示装置具有用于捕获来自现实世界的光的透镜,用于控制包括聚焦的透镜的状态的透镜状态控制单元,用于存储计算机图像数据的存储单元,用于生成计算机图像的计算机图像生成单元 根据透镜状态等的透镜状态信息,使用存储在存储单元中的计算机图像数据; 以及合成显示单元,用于合成通过透镜捕获的图像和生成的计算机图像并显示合成图像。

    Image forming method and apparatus
    6.
    发明授权
    Image forming method and apparatus 有权
    图像形成方法和装置

    公开(公告)号:US06628820B2

    公开(公告)日:2003-09-30

    申请号:US09866669

    申请日:2001-05-30

    IPC分类号: G06K900

    摘要: Upon observation of multi-viewpoint images, even when the viewpoint moves continuously, the image cannot normally be displayed in correspondence with the continuous movement of the viewpoint, and an image from a viewpoint closest to the current viewpoint is displayed. To prevent this, each two adjacent images of the multi-viewpoint images are interpolated by detecting corresponding pixels and generating an interpolated image in accordance with the correspondences among pixels. The interpolated image is generated in such a manner that an epipolar plane image is generated by juxtaposing corresponding lines of the multi-viewpoint image, straight lines are detected from the epipolar plane image, and the intersecting points between interpolated lines and the detected straight lines are detected as interpolated pixels. In this case, as for a point for which a straight line cannot be detected, a straight line passing the point is estimated, thereby generating an interpolated pixel. When a plurality of straight lines are detected for a pixel of interest, the priority level is assigned to the pixel of interest in correspondence with the number of detected straight lines. When the priority level is smaller than that of another pixel through which the detected straight line passes, the straight line is ignored, and an interpolated pixel is not generated.

    摘要翻译: 在观察多视点图像时,即使视点连续移动,与视点的连续移动相对应地不能正常地显示图像,并且显示来自最接近当前视点的视点的图像。 为了防止这种情况,通过检测相应的像素并根据像素之间的对应关系生成内插图像来内插多视点图像的每两个相邻图像。 以这样的方式生成内插图像,即通过并列多视点图像的相应行来生成对极平面图像,从极坐标图像检测直线,并且插入线和检测到的直线之间的交点是 检测为内插像素。 在这种情况下,对于不能检测到直线的点,估计通过点的直线,从而生成内插像素。 当针对感兴趣的像素检测到多条直线时,根据所检测的直线的数量将优先级分配给感兴趣的像素。 当优先级小于检测到的直线通过的另一像素的优先级时,忽略直线,并且不产生内插像素。

    Image processing method and apparatus
    7.
    发明授权
    Image processing method and apparatus 失效
    图像处理方法和装置

    公开(公告)号:US5937105A

    公开(公告)日:1999-08-10

    申请号:US9187

    申请日:1998-01-20

    摘要: Images picked up by a plurality of cameras are corrected and projected on a single plane. The input images are converted to projected images on a reference projection plane in accordance with reference parameters and camera parameters. Then images of an area of nx.times.ny whose center is an intersection B that is a perpendicular from a center of a lens of a m-th camera on the reference projection plane are extracted from the projected images. By extracting the area as described above, there is obtained an image which can be assumed that optical axes of each camera intersects perpendicular to the reference projection plane and the optical axes are parallel to each other. Therefore, when an epipolar plane is constructed during an image interpolation process, corresponding points form a straight line on the epipolar plane, thus it becomes easier to detect the corresponding points.

    摘要翻译: 由多个相机拍摄的图像被校正并投影在单个平面上。 根据参考参数和相机参数,将输入图像转换为参考投影平面上的投影图像。 然后从投影图像中提取其中心是从参考投影平面上的第m个相机的透镜的中心垂直的交点B的nxxny的区域的图像。 通过如上所述提取区域,获得了可以假设每个照相机的光轴垂直于参考投影平面并且光轴彼此平行的图像。 因此,当在图像插值处理期间构造对极平面时,相应的点在对极平面上形成直线,因此更容易检测相应的点。

    Image processing method and apparatus for generating an image from the viewpoint of an observer on the basis of images obtained from a plurality of viewpoints
    9.
    发明授权
    Image processing method and apparatus for generating an image from the viewpoint of an observer on the basis of images obtained from a plurality of viewpoints 失效
    基于从多个视点获得的图像,从观察者的角度生成图像的图像处理方法和装置

    公开(公告)号:US06263100B1

    公开(公告)日:2001-07-17

    申请号:US08838177

    申请日:1997-04-16

    IPC分类号: G06K936

    摘要: Each two adjacent images of multi-viewpoint images are interpolated by detecting corresponding pixels and generating an interpolated image in accordance with the correspondence among pixels. The interpolated image is generated in such a manner that an epipolar plane is generated by juxtaposing corresponding lines of the multi-viewpoint image, straight lines are detected from the epipolar plane image, and the intersecting points between interpolated lines and the detected straight lines are detected as interpolated pixels. In this case, as for a point for which a straight line cannot be detected, a straight line passing the point is estimated, thereby generating an interpolated pixel. When a plurality of straight lines are detected for a pixel of interest, a priority level is assigned to the pixel of interest in correspondence with the number of detected straight lines. When the priority level is smaller than that of another pixel through which the detected straight line passes, the straight line is ignored, and an interpolated pixel is not generated.

    摘要翻译: 通过检测相应的像素并根据像素之间的对应关系生成内插图像,来对多视点图像的每两个相邻图像进行内插。 内插图像以通过并列多视点图像的相应行生成对极平面的方式产生,从极坐标图像检测直线,并且检测插入线和检测到的直线之间的交点 作为内插像素。 在这种情况下,对于不能检测到直线的点,估计通过点的直线,从而生成内插像素。 当针对感兴趣的像素检测到多条直线时,对应于所检测的直线的数目,将优先级分配给感兴趣的像素。 当优先级小于检测到的直线通过的另一像素的优先级时,忽略直线,并且不产生内插像素。