Image forming method and apparatus
    1.
    发明授权
    Image forming method and apparatus 有权
    图像形成方法和装置

    公开(公告)号:US06628820B2

    公开(公告)日:2003-09-30

    申请号:US09866669

    申请日:2001-05-30

    IPC分类号: G06K900

    摘要: Upon observation of multi-viewpoint images, even when the viewpoint moves continuously, the image cannot normally be displayed in correspondence with the continuous movement of the viewpoint, and an image from a viewpoint closest to the current viewpoint is displayed. To prevent this, each two adjacent images of the multi-viewpoint images are interpolated by detecting corresponding pixels and generating an interpolated image in accordance with the correspondences among pixels. The interpolated image is generated in such a manner that an epipolar plane image is generated by juxtaposing corresponding lines of the multi-viewpoint image, straight lines are detected from the epipolar plane image, and the intersecting points between interpolated lines and the detected straight lines are detected as interpolated pixels. In this case, as for a point for which a straight line cannot be detected, a straight line passing the point is estimated, thereby generating an interpolated pixel. When a plurality of straight lines are detected for a pixel of interest, the priority level is assigned to the pixel of interest in correspondence with the number of detected straight lines. When the priority level is smaller than that of another pixel through which the detected straight line passes, the straight line is ignored, and an interpolated pixel is not generated.

    摘要翻译: 在观察多视点图像时,即使视点连续移动,与视点的连续移动相对应地不能正常地显示图像,并且显示来自最接近当前视点的视点的图像。 为了防止这种情况,通过检测相应的像素并根据像素之间的对应关系生成内插图像来内插多视点图像的每两个相邻图像。 以这样的方式生成内插图像,即通过并列多视点图像的相应行来生成对极平面图像,从极坐标图像检测直线,并且插入线和检测到的直线之间的交点是 检测为内插像素。 在这种情况下,对于不能检测到直线的点,估计通过点的直线,从而生成内插像素。 当针对感兴趣的像素检测到多条直线时,根据所检测的直线的数量将优先级分配给感兴趣的像素。 当优先级小于检测到的直线通过的另一像素的优先级时,忽略直线,并且不产生内插像素。

    Image processing method and apparatus for generating an image from the viewpoint of an observer on the basis of images obtained from a plurality of viewpoints
    2.
    发明授权
    Image processing method and apparatus for generating an image from the viewpoint of an observer on the basis of images obtained from a plurality of viewpoints 失效
    基于从多个视点获得的图像,从观察者的角度生成图像的图像处理方法和装置

    公开(公告)号:US06263100B1

    公开(公告)日:2001-07-17

    申请号:US08838177

    申请日:1997-04-16

    IPC分类号: G06K936

    摘要: Each two adjacent images of multi-viewpoint images are interpolated by detecting corresponding pixels and generating an interpolated image in accordance with the correspondence among pixels. The interpolated image is generated in such a manner that an epipolar plane is generated by juxtaposing corresponding lines of the multi-viewpoint image, straight lines are detected from the epipolar plane image, and the intersecting points between interpolated lines and the detected straight lines are detected as interpolated pixels. In this case, as for a point for which a straight line cannot be detected, a straight line passing the point is estimated, thereby generating an interpolated pixel. When a plurality of straight lines are detected for a pixel of interest, a priority level is assigned to the pixel of interest in correspondence with the number of detected straight lines. When the priority level is smaller than that of another pixel through which the detected straight line passes, the straight line is ignored, and an interpolated pixel is not generated.

    摘要翻译: 通过检测相应的像素并根据像素之间的对应关系生成内插图像,来对多视点图像的每两个相邻图像进行内插。 内插图像以通过并列多视点图像的相应行生成对极平面的方式产生,从极坐标图像检测直线,并且检测插入线和检测到的直线之间的交点 作为内插像素。 在这种情况下,对于不能检测到直线的点,估计通过点的直线,从而生成内插像素。 当针对感兴趣的像素检测到多条直线时,对应于所检测的直线的数目,将优先级分配给感兴趣的像素。 当优先级小于检测到的直线通过的另一像素的优先级时,忽略直线,并且不产生内插像素。

    Image processing method and apparatus
    4.
    发明授权
    Image processing method and apparatus 失效
    图像处理方法和装置

    公开(公告)号:US5937105A

    公开(公告)日:1999-08-10

    申请号:US9187

    申请日:1998-01-20

    摘要: Images picked up by a plurality of cameras are corrected and projected on a single plane. The input images are converted to projected images on a reference projection plane in accordance with reference parameters and camera parameters. Then images of an area of nx.times.ny whose center is an intersection B that is a perpendicular from a center of a lens of a m-th camera on the reference projection plane are extracted from the projected images. By extracting the area as described above, there is obtained an image which can be assumed that optical axes of each camera intersects perpendicular to the reference projection plane and the optical axes are parallel to each other. Therefore, when an epipolar plane is constructed during an image interpolation process, corresponding points form a straight line on the epipolar plane, thus it becomes easier to detect the corresponding points.

    摘要翻译: 由多个相机拍摄的图像被校正并投影在单个平面上。 根据参考参数和相机参数,将输入图像转换为参考投影平面上的投影图像。 然后从投影图像中提取其中心是从参考投影平面上的第m个相机的透镜的中心垂直的交点B的nxxny的区域的图像。 通过如上所述提取区域,获得了可以假设每个照相机的光轴垂直于参考投影平面并且光轴彼此平行的图像。 因此,当在图像插值处理期间构造对极平面时,相应的点在对极平面上形成直线,因此更容易检测相应的点。

    Multi-viewpoint image processing method and apparatus
    5.
    发明授权
    Multi-viewpoint image processing method and apparatus 失效
    多视点图像处理方法和装置

    公开(公告)号:US06608622B1

    公开(公告)日:2003-08-19

    申请号:US08543121

    申请日:1995-10-13

    IPC分类号: G06T1700

    CPC分类号: G06T15/205 G06T15/10

    摘要: An image processing method according to an embodiment of the present invention has the following steps: the multi-viewpoint image input step for inputting images obtained from a plurality of viewpoint positions arranged on different straight lines, the detection step (2, 7, 17, 8) for detecting a viewpoint position and its view direction in which a user is seeing at the viewpoint position, and the image generation step (11, 12, 13, 8) for generating a virtual image viewed from the predetermined viewpoint by using the images input in the multi-viewpoint image input step on the basis of the detected predetermined viewpoint position and the view direction. In the image generation step, optimal corresponding points are obtained by detecting a straight line having a width on an epipolar plane image corresponding to the input images, thereby generating an image.

    摘要翻译: 根据本发明的实施例的图像处理方法具有以下步骤:多视点图像输入步骤,用于输入从布置在不同直线上的多个视点位置获得的图像,检测步骤(2,7,17​​, 8),用于检测用户在视点位置观看的视点位置及其观看方向,以及图像生成步骤(11,12,13,8),用于通过使用图像生成从预定视点观看的虚像 基于检测到的预定视点位置和视图方向在多视点图像输入步骤中输入。 在图像生成步骤中,通过检测对应于输入图像的对数平面图像上的宽度的直线来获得最佳对应点,从而生成图像。

    IMAGE PROCESSING SYSTEM, IMAGE PROCESSING APPARATUS, IMAGE SENSING APPARATUS, AND CONTROL METHOD THEREOF
    8.
    发明申请
    IMAGE PROCESSING SYSTEM, IMAGE PROCESSING APPARATUS, IMAGE SENSING APPARATUS, AND CONTROL METHOD THEREOF 有权
    图像处理系统,图像处理装置,图像感测装置及其控制方法

    公开(公告)号:US20070242086A1

    公开(公告)日:2007-10-18

    申请号:US11734073

    申请日:2007-04-11

    IPC分类号: G09G5/00

    CPC分类号: G06T19/006

    摘要: A first process to be executed by an apparatus and a second process to be executed by an apparatus to obtain a composite image by compositing a real space image with a virtual space image are determined by negotiation. The apparatus (101) transmits data necessary for executing the second process to the apparatus. The apparatus executes the second process by using the data and transmits the process result to the apparatus. The apparatus receives the process result by the apparatus and executes the first process. The apparatus displays a composite image obtained on the basis of the result of the first process or a composite image obtained on the basis of the process result and the received process result.

    摘要翻译: 通过协商确定要由设备执行的第一处理和由设备执行的第二处理,以通过将真实空间图像与虚拟空间图像合成来获得合成图像。 该装置(101)向该装置发送执行第二处理所需的数据。 该装置通过使用数据执行第二处理,并将处理结果发送给装置。 装置接收装置的处理结果并执行第一处理。 该装置显示基于根据处理结果和接收到的处理结果获得的第一处理的结果或合成图像获得的合成图像。

    Apparatus for presenting mixed reality shared among operators
    9.
    发明授权
    Apparatus for presenting mixed reality shared among operators 失效
    提供运营商共享的混合现实的装置

    公开(公告)号:US06522312B2

    公开(公告)日:2003-02-18

    申请号:US09045993

    申请日:1998-03-23

    IPC分类号: G09G500

    摘要: There is disclosed a mixed reality presentation apparatus which generates and displays a three-dimensional virtual image on a see-through display device so as to allow a plurality of players to play a multi-player game in a mixed reality environment. The apparatus has a CCD camera for detecting the mallet positions of the plurality of players, and a sensor for detecting the view point position of each player in the environment of the multi-player game. The apparatus generates a three-dimensional virtual image that represents a game result of the multi-player game that has progressed in accordance with changes in mallet position detected by the CCD camera and is viewed from the view point position of each player detected by the sensor, and outputs the generated image to the corresponding see-through display device. The apparatus determines the motion of each player by detecting infrared rays output from the corresponding mallet on the basis of an image captured by the CCD camera. The view point position detected by the sensor is corrected by specifying the marker in an image obtained by a camera attached to the head of each player, and comparing the marker position in that image with an actual marker position.

    摘要翻译: 公开了一种混合现实呈现装置,其在透视显示装置上生成和显示三维虚拟图像,以允许多个玩家在混合现实环境中玩多玩家游戏。 该装置具有用于检测多个玩家的槌位置的CCD照相机,以及用于检测多玩家游戏环境中的每个玩家的视点位置的传感器。 该装置生成表示根据CCD摄像机检测到的槌位置变化而进行的多玩家游戏的游戏结果的三维虚像,并且从传感器检测到的各玩家的视点位置观察 并将生成的图像输出到相应的透视显示装置。 该装置基于CCD摄像机拍摄的图像,通过检测从相应的槌输出的红外线来确定每个玩家的运动。 通过指定由安装在每个游戏者的头部的相机获得的图像中的标记,并将该图像中的标记位置与实际标记位置进行比较来校正由传感器检测的视点位置。

    Image processing system, image processing apparatus, image sensing apparatus, and control method thereof
    10.
    发明授权
    Image processing system, image processing apparatus, image sensing apparatus, and control method thereof 有权
    图像处理系统,图像处理装置,图像感测装置及其控制方法

    公开(公告)号:US08345952B2

    公开(公告)日:2013-01-01

    申请号:US11734073

    申请日:2007-04-11

    IPC分类号: G06K9/00

    CPC分类号: G06T19/006

    摘要: A first process to be executed by an apparatus and a second process to be executed by an apparatus to obtain a composite image by compositing a real space image with a virtual space image are determined by negotiation. The apparatus (101) transmits data necessary for executing the second process to the apparatus. The apparatus executes the second process by using the data and transmits the process result to the apparatus. The apparatus receives the process result by the apparatus and executes the first process. The apparatus displays a composite image obtained on the basis of the result of the first process or a composite image obtained on the basis of the process result and the received process result.

    摘要翻译: 通过协商确定要由设备执行的第一处理和由设备执行的第二处理,以通过将真实空间图像与虚拟空间图像合成来获得合成图像。 该装置(101)向该装置发送执行第二处理所需的数据。 该装置通过使用数据执行第二处理,并将处理结果发送给装置。 装置接收装置的处理结果并执行第一处理。 该装置显示基于根据处理结果和接收到的处理结果获得的第一处理的结果或合成图像获得的合成图像。