公开(公告)号：US08659624B2

公开(公告)日：2014-02-25

申请号：US12580430

申请日：2009-10-16

申请人： Taichi Matsui

发明人： Taichi Matsui

IPC分类号： G09G5/00 ,  G09G5/02

CPC分类号： G06T15/50 ,  G06T19/006

摘要： Based on an observer's position and observing direction measured in the real world and positions of a virtual light source and virtual object in a virtual world, a brightness adjustment value of the virtual light source is adjusted in a way that, when light from the virtual light source is blocked by an observer, brightness of the virtual object observed by the observer is reduced as if the observer were observing in the real world. As a result, a mixed reality presentation system that achieves a sense of reality is provided.

摘要翻译： 基于在虚拟世界中在现实世界中测量的观察者的位置和观察方向以及虚拟光源和虚拟对象的位置，虚拟光源的亮度调整值被调整为：当来自虚拟光的光 源被观察者阻挡，观察者观察到的虚拟对象的亮度就像观察者在现实世界中观察一样被减少。 因此，提供了实现现实感的混合现实呈现系统。

公开(公告)号：US07589747B2

公开(公告)日：2009-09-15

申请号：US10951684

申请日：2004-09-29

申请人： Taichi Matsui ,  Masahiro Suzuki

发明人： Taichi Matsui ,  Masahiro Suzuki

IPC分类号： G09G5/00

CPC分类号： G06T19/006 ,  G06T7/30 ,  H04N13/239 ,  H04N13/279 ,  H04N13/344

摘要： A mixed reality space image generation method for generating a mixed reality space image formed by superimposing a virtual space image onto a real space image obtained by capturing a real space, includes a first image superimposing step of superimposing a first virtual space image onto a real space image based on an occlusion by a real object, wherein the first virtual space image is an outer appearance of the real object, and obtaining information of location and orientation of the real object. In addition, a second virtual image is set based on the information of location and orientation of the real object, and a second image superimposing step superimposes the second virtual space image onto the superimposed image generated in the first image superimposing step without considering the occlusion, wherein the second virtual space image is an annotation associated with the real object.

摘要翻译： 一种混合现实空间图像生成方法，用于生成通过将虚拟空间图像叠加到通过捕获真实空间而获得的实际空间图像上形成的混合现实空间图像，包括：第一图像叠加步骤，将第一虚拟空间图像叠加到实际空间 基于真实对象的遮挡的图像，其中所述第一虚拟空间图像是所述真实对象的外观，以及获得所述真实对象的位置和取向的信息。 此外，基于真实对象的位置和取向的信息来设置第二虚拟图像，并且第二图像叠加步骤将第二虚拟空间图像叠加到在第一图像叠加步骤中生成的叠加图像上而不考虑遮挡， 其中所述第二虚拟空间图像是与所述真实对象相关联的注释。

公开(公告)号：US20090051758A1

公开(公告)日：2009-02-26

申请号：US11909236

申请日：2006-04-19

申请人： Takaaki Endo ,  Taichi Matsui ,  Hideo Noro

发明人： Takaaki Endo ,  Taichi Matsui ,  Hideo Noro

IPC分类号： H04N13/04

CPC分类号： G06F3/012 ,  B33Y80/00 ,  G06F3/011 ,  G06T7/73 ,  G06T19/006

摘要： The position and orientation of the viewpoint of the observer are acquired (2030), the moving amount of a movable part is acquired (2032), a movable part of a virtual object is moved based on the moving amount of the movable part of a physical object, and an image which is observed from the viewpoint of the observer is generated (2040).

摘要翻译： 获取观察者的视点的位置和方向（2030），获取可移动部分的移动量（2032），虚拟对象的可移动部分基于物理的可移动部分的移动量而移动 生成从观察者的观点观察到的图像（2040）。

公开(公告)号：US06704042B2

公开(公告)日：2004-03-09

申请号：US09456293

申请日：1999-12-08

申请人： Taichi Matsui ,  Hiroaki Sato ,  Hideo Noro ,  Tomohiko Matsuura

发明人： Taichi Matsui ,  Hiroaki Sato ,  Hideo Noro ,  Tomohiko Matsuura

IPC分类号： H04N1500

CPC分类号： H04N19/597 ,  H04N13/10 ,  H04N13/139 ,  H04N13/161 ,  H04N13/194 ,  H04N2213/007

摘要： When stereoscopic video data is distributed through a network, some terminal cannot process the distributed stereoscopic video data because the format of the data does not correspond to the terminal. Likewise, when video data are input from a plurality of types of cameras with different stereoscopic video data formats, data of an incompatible format cannot be processed. In order to prevent this problem, there is provided a stereoscopic video apparatus which inputs stereoscopic video data, converts the format of the input stereoscopic video data into a format suitable to output operation, and outputs the converted stereoscopic video data to a network.

摘要翻译： 当通过网络分发立体视频数据时，由于数据格式与终端不对应，某些终端无法处理分布式立体视频数据。 类似地，当从具有不同立体视频数据格式的多种类型的相机输入视频数据时，不能处理不兼容格式的数据。 为了防止这个问题，提供了一种输入立体视频数据的立体视频设备，将输入的立体视频数据的格式转换为适合于输出操作的格式，并将转换的立体视频数据输出到网络。

公开(公告)号：US20080030461A1

公开(公告)日：2008-02-07

申请号：US11830356

申请日：2007-07-30

申请人： Taichi Matsui ,  Yasuhiro Okuno

发明人： Taichi Matsui ,  Yasuhiro Okuno

IPC分类号： G09G5/00

CPC分类号： G06F3/011 ,  G06F3/03542 ,  G06T7/73

摘要： The pointing position of a pointing device is measured based on position and orientation information of the pointing device. The pointing position is measured based on the pointing position in a sensed image obtained by sensing the pointing position of the pointing device by an image sensing device, and position and orientation information of the image sensing device. A real pointing position of the pointing device is measured based on these measurement results. A virtual pointing device which points to a virtual image to be combined with a real image is generated using the same reference as that used to measure the real pointing position. A virtual pointing position of the virtual pointing device is measured.

摘要翻译： 基于指示装置的位置和方向信息测量指示装置的指向位置。 基于通过感测图像感测装置指示装置的指示位置获得的感测图像中的指示位置以及图像感测装置的位置和方位信息来测量指向位置。 基于这些测量结果测量指示设备的实际指向位置。 使用与用于测量实际指向位置相同的参考生成指向要与真实图像组合的虚拟图像的虚拟指点设备。 测量虚拟指点设备的虚拟指向位置。

公开(公告)号：US20060221098A1

公开(公告)日：2006-10-05

申请号：US11390437

申请日：2006-03-28

申请人： Taichi Matsui ,  Yasuo Katano

发明人： Taichi Matsui ,  Yasuo Katano

IPC分类号： G09G5/00

CPC分类号： G06T7/74 ,  G06T7/80 ,  G06T2207/20092

摘要： An instruction is detected which indicates that a physical object having a fixed plane where the physical object can be moved, and a virtual object rendered so as to be positioned on the plane where the physical object can be moved, are observed as being in a predetermined positional relationship. Then, a difference between a position and orientation value of the virtual object and a position and orientation value of the physical object is acquired at the time when the instruction is detected, so that the difference is used as a correction value to correct the positional difference between the physical object and the virtual object.

摘要翻译： 检测出指示物理对象能够被移动的具有固定平面的物体以及被放置在能够移动物体的平面上的虚拟物体的指示为预定的 位置关系 然后，在检测到指示时获取虚拟物体的位置和姿态值与物体的位置和姿态值之间的差异，从而将该差值用作校正值以校正位置差异 物理对象和虚拟对象之间。

公开(公告)号：US20060050070A1

公开(公告)日：2006-03-09

申请号：US11217804

申请日：2005-09-01

申请人： Taichi Matsui

发明人： Taichi Matsui

IPC分类号： G06T15/00

CPC分类号： G06T19/006

摘要： An information processing method and an information processing apparatus for preventing a user from experiencing fear in a virtual environment due to the area surrounding their feet being invisible because of CG masking the real space are provided. The information processing method and apparatus acquire the position and posture of the user when generating an image of a virtual reality and combining the image of the virtual reality with an image of real space to present the combined image to the user. When the user is inside a virtual building, the information processing method and apparatus generate objects inside the virtual building and a transparent object and combine the generated objects with an image of real space. By displaying the combined image, the image of real space is displayed at the feet of the user.

摘要翻译： 提供了一种信息处理方法和信息处理设备，用于防止用户在虚拟环境中由于其围绕其周围的区域而不可见，因为CG掩盖了真实空间。 信息处理方法和装置在生成虚拟现实的图像时获取用户的位置和姿势，并将虚拟现实的图像与真实空间的图像相结合，以向用户呈现组合的图像。 当用户在虚拟建筑物内时，信息处理方法和设备在虚拟建筑物内部生成对象和透明对象，并将生成的对象与真实空间的图像组合。 通过显示组合图像，实时空间的图像显示在用户脚下。

公开(公告)号：US20050073531A1

公开(公告)日：2005-04-07

申请号：US10954196

申请日：2004-10-01

申请人： Tsuyoshi Kuroki ,  Taichi Matsui

发明人： Tsuyoshi Kuroki ,  Taichi Matsui

IPC分类号： G06T19/00 ,  G06T15/00

CPC分类号： G06T19/006

摘要： A three-dimensional CG manipulation apparatus has a real object, a position and orientation sensor provided to the real object, a support base, a position and orientation sensor provided to the support base, a head-mounted display, a position and orientation sensor provided to the head-mounted display, a sensor information acquisition unit for acquiring information from the sensors, a state determination unit for determining the current state of the real object and support base, a CG data management unit for managing CG data to be displayed, and an image generation unit for generating an image to be displayed on the head-mounted display. In a mixed realty system that presents an image formed by superimposing a virtual CG image on a real object to the user, a manipulation such as replacement or the like can be easily made for the virtual CG image without interrupting the user's operation.

摘要翻译： 三维CG操纵装置具有实际物体，提供给真实物体的位置和方位传感器，支撑基座，设置在支撑基座上的位置和方位传感器，头戴式显示器，提供的位置和方位传感器 用于从所述传感器获取信息的传感器信息获取单元，用于确定所述真实对象和支持库的当前状态的状态判定单元，用于管理要显示的CG数据的CG数据管理单元;以及 图像生成单元，用于生成要显示在头戴式显示器上的图像。 在通过将虚拟CG图像叠加在真实对象上而形成的图像的混合物体系统中，可以容易地对虚拟CG图像进行诸如替换等的操作，而不会中断用户的操作。

公开(公告)号：US08350897B2

公开(公告)日：2013-01-08

申请号：US11909236

申请日：2006-04-19

申请人： Takaaki Endo ,  Taichi Matsui ,  Hideo Noro

发明人： Takaaki Endo ,  Taichi Matsui ,  Hideo Noro

IPC分类号： H04N9/47

CPC分类号： G06F3/012 ,  B33Y80/00 ,  G06F3/011 ,  G06T7/73 ,  G06T19/006

摘要： The position and orientation of the viewpoint of the observer are acquired (2030), the moving amount of a movable part is acquired (2032), a movable part of a virtual object is moved based on the moving amount of the movable part of a physical object, and an image which is observed from the viewpoint of the observer is generated (2040).

摘要翻译： 获取观察者的视点的位置和方向（2030），获取可移动部分的移动量（2032），虚拟对象的可移动部分基于物理的可移动部分的移动量而移动 生成从观察者的观点观察到的图像（2040）。

公开(公告)号：US07292240B2

公开(公告)日：2007-11-06

申请号：US11217511

申请日：2005-09-01

申请人： Yasuhiro Okuno ,  Taichi Matsui

发明人： Yasuhiro Okuno ,  Taichi Matsui

IPC分类号： G06T15/00

CPC分类号： G06F3/04815 ,  G06T15/20 ,  G06T19/006

摘要： An actual-size observation mode in which an observer performs observation by being immersed in a virtual three-dimensional space in an actual size and a reduced-size observation mode in which the observer performs observation by reducing a virtual three-dimensional space computer graphics image are provided. A virtual reality presentation device includes an observation mode setting unit for setting, as an observation mode, the actual-size observation mode or the reduced-size observation mode; a position and orientation information acquisition unit for acquiring position and orientation information of the observer; and a generation unit for generating a computer graphics image from computer graphics data representing the virtual three-dimensional space in accordance with the set observation mode and the position and orientation information.

摘要翻译： 实际尺寸观察模式，其中观察者通过浸入在实际尺寸的虚拟三维空间中进行观察，并且观察者通过减少虚拟三维空间计算机图形图像观察者执行观察的缩小尺寸观察模式 被提供。 虚拟现实呈现装置包括：观察模式设定单元，用于设置实际尺寸观察模式或缩小尺寸观察模式作为观察模式; 位置和姿势信息获取单元，用于获取观察者的位置和方向信息; 以及生成单元，用于根据设置的观察模式和位置​​和取向信息从表示虚拟三维空间的计算机图形数据生成计算机图形图像。