公开(公告)号：US20070268316A1

公开(公告)日：2007-11-22

申请号：US11751772

申请日：2007-05-22

申请人： Yoshiki Kajita ,  Akihiro Katayama ,  Shinji Uchiyama ,  Masahiro Suzuki ,  Takuya Tsujimoto

发明人： Yoshiki Kajita ,  Akihiro Katayama ,  Shinji Uchiyama ,  Masahiro Suzuki ,  Takuya Tsujimoto

IPC分类号： G09G5/00

CPC分类号： G06T5/002 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/011 ,  G02B2027/0138 ,  G02B2027/014 ,  G06T5/006 ,  G06T19/006 ,  G09G5/36 ,  G09G2340/12

摘要： A display apparatus with an image-capturing function includes an outputting unit configured to output an image signal to an external apparatus, an inputting unit configured to input an image signal from the external apparatus, an image-capturing unit, a display unit, an image-capture-distortion corrector configured to perform image-capture-distortion correction on an image signal captured by the image-capturing unit, a display-distortion corrector configured to perform display-distortion correction, and a controller configured to control whether or not the image-capture-distortion corrector is to perform the image-capture-distortion correction, and whether or not the display-distortion corrector is to perform the display-distortion correction. Therefore, distortion caused by the image-capturing system and display system of the display apparatus with an image-capturing function can be appropriately corrected in the overall system including the display apparatus with an image-capturing function and the external apparatus.

摘要翻译： 具有图像拍摄功能的显示装置包括：输出单元，被配置为将图像信号输出到外部设备;输入单元，被配置为输入来自外部设备的图像信号，图像捕获单元，显示单元，图像 - 捕获失真校正器，被配置为对由所述图像捕获单元捕获的图像信号执行图像捕获失真校正，被配置为执行显示失真校正的显示失真校正器，以及控制器，被配置为控制所述图像 捕获 - 失真校正器将执行图像捕获失真校正，以及显示失真校正器是否执行显示失真校正。 因此，可以在具有图像拍摄功能的显示装置的整个系统和外部装置中适当地校正由具有图像拍摄功能的显示装置的图像拍摄系统和显示系统引起的失真。

公开(公告)号：US08953057B2

公开(公告)日：2015-02-10

申请号：US11751772

申请日：2007-05-22

申请人： Yoshiki Kajita ,  Akihiro Katayama ,  Shinji Uchiyama ,  Masahiro Suzuki ,  Takuya Tsujimoto

发明人： Yoshiki Kajita ,  Akihiro Katayama ,  Shinji Uchiyama ,  Masahiro Suzuki ,  Takuya Tsujimoto

IPC分类号： H04N5/228 ,  G06K9/40 ,  G06T5/00

CPC分类号： G06T5/002 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/011 ,  G02B2027/0138 ,  G02B2027/014 ,  G06T5/006 ,  G06T19/006 ,  G09G5/36 ,  G09G2340/12

摘要： A display apparatus with an image-capturing function includes an outputting unit configured to output an image signal to an external apparatus, an inputting unit configured to input an image signal from the external apparatus, an image-capturing unit, a display unit, an image-capture-distortion corrector configured to perform image-capture-distortion correction on an image signal captured by the image-capturing unit, a display-distortion corrector configured to perform display-distortion correction, and a controller configured to control whether or not the image-capture-distortion corrector is to perform the image-capture-distortion correction, and whether or not the display-distortion corrector is to perform the display-distortion correction. Therefore, distortion caused by the image-capturing system and display system of the display apparatus with an image-capturing function can be appropriately corrected in the overall system including the display apparatus with an image-capturing function and the external apparatus.

摘要翻译： 具有图像拍摄功能的显示装置包括：输出单元，被配置为将图像信号输出到外部设备;输入单元，被配置为输入来自外部设备的图像信号，图像捕获单元，显示单元，图像 - 捕获失真校正器，被配置为对由所述图像捕获单元捕获的图像信号执行图像捕获失真校正，被配置为执行显示失真校正的显示失真校正器，以及控制器，被配置为控制所述图像 捕获 - 失真校正器将执行图像捕获失真校正，以及显示失真校正器是否执行显示失真校正。 因此，可以在具有图像拍摄功能的显示装置的整个系统和外部装置中适当地校正由具有图像拍摄功能的显示装置的图像拍摄系统和显示系统引起的失真。

公开(公告)号：US20070242086A1

公开(公告)日：2007-10-18

申请号：US11734073

申请日：2007-04-11

申请人： Takuya Tsujimoto ,  Hiroyuki Yamamoto ,  Akihiro Katayama ,  Tomohiko Shimoyama

发明人： Takuya Tsujimoto ,  Hiroyuki Yamamoto ,  Akihiro Katayama ,  Tomohiko Shimoyama

IPC分类号： G09G5/00

CPC分类号： G06T19/006

摘要： A first process to be executed by an apparatus and a second process to be executed by an apparatus to obtain a composite image by compositing a real space image with a virtual space image are determined by negotiation. The apparatus (101) transmits data necessary for executing the second process to the apparatus. The apparatus executes the second process by using the data and transmits the process result to the apparatus. The apparatus receives the process result by the apparatus and executes the first process. The apparatus displays a composite image obtained on the basis of the result of the first process or a composite image obtained on the basis of the process result and the received process result.

摘要翻译： 通过协商确定要由设备执行的第一处理和由设备执行的第二处理，以通过将真实空间图像与虚拟空间图像合成来获得合成图像。 该装置（101）向该装置发送执行第二处理所需的数据。 该装置通过使用数据执行第二处理，并将处理结果发送给装置。 装置接收装置的处理结果并执行第一处理。 该装置显示基于根据处理结果和接收到的处理结果获得的第一处理的结果或合成图像获得的合成图像。

公开(公告)号：US08345952B2

公开(公告)日：2013-01-01

申请号：US11734073

申请日：2007-04-11

申请人： Takuya Tsujimoto ,  Hiroyuki Yamamoto ,  Akihiro Katayama ,  Tomohiko Shimoyama

发明人： Takuya Tsujimoto ,  Hiroyuki Yamamoto ,  Akihiro Katayama ,  Tomohiko Shimoyama

IPC分类号： G06K9/00

CPC分类号： G06T19/006

摘要： A first process to be executed by an apparatus and a second process to be executed by an apparatus to obtain a composite image by compositing a real space image with a virtual space image are determined by negotiation. The apparatus (101) transmits data necessary for executing the second process to the apparatus. The apparatus executes the second process by using the data and transmits the process result to the apparatus. The apparatus receives the process result by the apparatus and executes the first process. The apparatus displays a composite image obtained on the basis of the result of the first process or a composite image obtained on the basis of the process result and the received process result.

摘要翻译： 通过协商确定要由设备执行的第一处理和由设备执行的第二处理，以通过将真实空间图像与虚拟空间图像合成来获得合成图像。 该装置（101）向该装置发送执行第二处理所需的数据。 该装置通过使用数据执行第二处理，并将处理结果发送给装置。 装置接收装置的处理结果并执行第一处理。 该装置显示基于根据处理结果和接收到的处理结果获得的第一处理的结果或合成图像获得的合成图像。

公开(公告)号：US06256035B1

公开(公告)日：2001-07-03

申请号：US08931366

申请日：1997-09-16

申请人： Akihiro Katayama ,  Shinji Uchiyama

发明人： Akihiro Katayama ,  Shinji Uchiyama

IPC分类号： G06T1500

CPC分类号： G06T15/205

摘要： An object put on a rotational table is photographed from a plurality of visual point positions by a camera, a part of an image group inputted by the photographing is projected to a light space, a correspondence relation between a part of the projected image group and the light space is formed, an image at an arbitrary visual point position is generated on the basis of the formed correspondence relation, and the generated image is displayed, so that there is no need to perform an arithmetic operation to convert into the light group for all of the picture elements of the actual photographed images.

摘要翻译： 通过照相机从多个视点位置拍摄放置在旋转台上的物体，将通过拍摄输入的图像组的一部分投影到光空间，投影图像组的一部分与 形成光空间，根据形成的对应关系产生任意视点位置的图像，并且显示所生成的图像，使得不需要进行算术运算，以将其全部转换为光组 的实际拍摄图像的图片元素。

公开(公告)号：US6151028A

公开(公告)日：2000-11-21

申请号：US38685

申请日：1998-03-09

申请人： Atsushi Kumagai ,  Akihiro Katayama ,  Shinji Uchiyama

发明人： Atsushi Kumagai ,  Akihiro Katayama ,  Shinji Uchiyama

IPC分类号： G06T19/00 ,  G06T15/10

CPC分类号： G06T15/00

摘要： In order to enable plural users to share a virtual environment which includes not only simple shape data, but also data of an object having a highly complicated shape, a terminal equipment displays the virtual environment. The virtual environment is obtained when viewed by a user of the terminal equipment on the basis of tree-structure data composing the shape data, light space data and the like as components. The tree-structure data is changed when the shape data or the light space data is subjected to a process such as movement or the like. The changed information of the tree-structure data is transmitted to a server, and the server changes data in a data memory device based on the received changed information. The changed information is transmitted to another terminal equipment which displays the virtual environment obtained when viewed by the user of the another terminal equipment on the basis of the received changed information.

摘要翻译： 为了使多个用户能够共享不仅包括简单形状数据的虚拟环境，还包括具有高度复杂形状的对象的数据，终端设备显示虚拟环境。 基于构成形状数据，光空间数据等的树结构数据作为组件，由终端设备的用户观看虚拟环境。 当形状数据或光空间数据经受诸如运动等的处理时，树结构数据被改变。 树结构数据的改变的信息被发送到服务器，并且服务器基于接收的改变的信息来改变数据存储装置中的数据。 变更的信息被发送到另一个终端设备，该终端设备基于接收到的改变的信息显示由另一个终端设备的用户观看时获得的虚拟环境。

公开(公告)号：US06400373B1

公开(公告)日：2002-06-04

申请号：US08943699

申请日：1997-10-03

申请人： Shinji Uchiyama ,  Akihiro Katayama

发明人： Shinji Uchiyama ,  Akihiro Katayama

IPC分类号： G06T1160

CPC分类号： G06T17/00

摘要： A virtual space using a geometric model for forming a virtual environment is input, nongeometric model object expression data based on a multi-viewpoint image is acquired, geometric information is added to the acquired nongeometric model object expression data, and the nongeometric model object expression data is used as an object arranged or operated in the virtual space using the added geometric information or automatically moving in the space. The same effect as that obtained when the shape data of an object having a very complex shape is generated or reproduced can be easily obtained without generating or reproducing the shape data. In addition, the entire virtual space can be generated without holding an enormous amount of light space data, so that the object can be operated in the three-dimensional space.

摘要翻译： 输入使用几何模型形成虚拟环境的虚拟空间，获取基于多视点图像的非几何模型对象表达数据，将几何信息添加到所获取的非几何模型对象表达数据中，并且将非对称模型对象表达数据 被用作使用添加的几何信息在虚拟空间中布置或操作的对象或在空间中自动移动的对象。 可以容易地获得与生成或再现形状非常复杂的物体的形状数据时相同的效果，而不产生或再现形状数据。 此外，可以在不保持大量的光空间数据的情况下生成整个虚拟空间，从而可以在三维空间中操作对象。

公开(公告)号：US06400362B1

公开(公告)日：2002-06-04

申请号：US09038686

申请日：1998-03-09

申请人： Shinji Uchiyama ,  Akihiro Katayama ,  Atsushi Kumagai

发明人： Shinji Uchiyama ,  Akihiro Katayama ,  Atsushi Kumagai

IPC分类号： G06T1100

CPC分类号： G06T15/00

摘要： A virtual space including a plurality of different data is generated on the basis of a tree structure including, as construction elements, shape data, light space data, and the like, change processing such as addition, deletion, replacement, and the like of the construction element is done for the tree structure as a basis of the generated virtual environment, and the virtual environment is regenerated. The change processing can be done more efficiently for the virtual environment made up of various kinds of data.

摘要翻译： 基于包括作为构造元素，形状数据，光空间数据等的树结构生成包括多个不同数据的虚拟空间，诸如添加，删除，替换等的改变处理 完成树结构作为生成的虚拟环境的基础，并重新生成虚拟环境。 可以对由各种数据组成的虚拟环境更有效地进行改变处理。

公开(公告)号：US06268862B1

公开(公告)日：2001-07-31

申请号：US08812388

申请日：1997-03-05

申请人： Shinji Uchiyama ,  Akihiro Katayama ,  Masahiro Shibata

发明人： Shinji Uchiyama ,  Akihiro Katayama ,  Masahiro Shibata

IPC分类号： G06T1700

CPC分类号： G06T15/10

摘要： A three-dimensional space is generated using shape model data and its surface characteristic and pattern, a space is rebuilt from the three-dimensional space as an image in accordance with a drawing specification determined by the viewpoint position, direction, angle of view, and the like, and an image is generated from light space data using the drawing specification. The images generated based on the shape model data and the light space data are fused, thereby easily generating and fusing shape model data and an actually taken image, and displaying an image with high reality.

摘要翻译： 使用形状模型数据及其表面特征和图案生成三维空间，根据由视点位置，方向，视角确定的绘图规格，从三维空间重建作为图像的空间的空间 并且使用图示规格从光空间数据生成图像。 基于形状模型数据和光空间数据生成的图像被融合，从而容易地生成和融合形状模型数据和实际拍摄的图像，并且显示高现实的图像。

公开(公告)号：US06445807B1

公开(公告)日：2002-09-03

申请号：US08819093

申请日：1997-03-18

申请人： Akihiro Katayama ,  Shinji Uchiyama ,  Masahiro Shibata

发明人： Akihiro Katayama ,  Shinji Uchiyama ,  Masahiro Shibata

IPC分类号： G06K900

CPC分类号： G06T15/10

摘要： The images of an object taken at a plurality of viewpoint positions are input together with information indicating the plurality of viewpoint positions, and the viewpoint position of an observer is detected. One of the input images is selected on the basis of the detected viewpoint position of the observer, and the scan line of the image is determined in accordance with the viewpoint position of the observer and the viewpoint position upon taking the selected image, thereby generating an image from the viewpoint position of the observer. In this manner, distortion of the image to be generated is suppressed. On the other hand, input multi-viewpoint images are converted into light rays that travel in a space, and each light ray is stored in a light space corresponding to a plane, which is one of a plurality of radially arranged reference planes and has an angle the plane makes with the light ray, which angle is closest to right angles. On the basis of the image, pixel positions, and pixel values calculated from the stored light rays, a desired image is generated, thereby broadening the observation range within which movement of the viewpoint position is allowed, and suppressing the required data volume.

摘要翻译： 在多个视点位置拍摄的对象的图像与指示多个视点位置的信息一起输入，并且检测观察者的视点位置。 基于检测到的观察者的视点位置来选择输入图像之一，并且在拍摄所选择的图像时根据观察者的视点位置和视点位置来确定图像的扫描线，从而生成 来自观察者的视点位置的图像。 以这种方式，抑制了要产生的图像的失真。 另一方面，输入多视点图像被转换为​​在空间中行进的光线，并且每个光线存储在与作为多个径向布置的参考平面中的一个的平面相对应的光空间中，并且具有 平面与光线成角度，该角度最接近直角。 基于从所存储的光线计算的图像，像素位置和像素值，生成期望的图像，从而扩大允许视点位置的移动并抑制所需数据量的观察范围。