公开(公告)号：US06930685B1

公开(公告)日：2005-08-16

申请号：US09512836

申请日：2000-02-25

申请人： Yukio Sakagawa ,  Akihiro Katayama ,  Daisuke Kotake ,  Masakazu Fujiki

发明人： Yukio Sakagawa ,  Akihiro Katayama ,  Daisuke Kotake ,  Masakazu Fujiki

IPC分类号： G06T15/60 ,  G06T15/80 ,  H04N5/262

CPC分类号： G06T15/80 ,  G06T15/60

摘要： There is provided an image processing apparatus for describing a real image as a virtual object using space data formed based on a photo image of the real object, and generating a virtual image of the virtual object using the space data. The image processing apparatus captures the photo image of the real object from a real camera viewpoint position while illuminating the real object by an illumination light source placed at a real illumination position. The captured photo image is converted into space data in the form of an object for each pixel, and the space data is stored in a memory together with various illumination conditions at the real illumination position to allow a search at a later time.

公开(公告)号：US07673246B2

公开(公告)日：2010-03-02

申请号：US10314286

申请日：2002-12-09

申请人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake ,  Yukio Sakagawa

发明人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake ,  Yukio Sakagawa

IPC分类号： G06F3/00

CPC分类号： G06T15/205

摘要： An image information processing apparatus is provided to generate, from previously held image data, a display image according to a viewpoint designated by a user, and to communicate with a control apparatus which can communicate with plural image information processing apparatuses respectively generating display images and has a controller for controlling viewpoint information shared by the plural image information processing apparatuses on the basis of viewpoint information sent from the image information processing apparatus. This apparatus comprises a transmitter to calculate the viewpoint information based on a user's instruction and transmit it to the controller, a receiver to receive from the controller the viewpoint information for generating the display image, and an image generator to read the image data corresponding to the viewpoint information from the previously held image data for generating the display image, and generate and output the display image to a display.

摘要翻译： 提供一种图像信息处理装置，用于根据用户指定的视点从先前保存的图像数据生成显示图像，并且与可以与分别生成显示图像的多个图像信息处理装置通信的控制装置进行通信，并具有 控制器，用于基于从图像信息处理设备发送的视点信息来控制由多个图像信息处理设备共享的视点信息。 该装置包括基于用户指令计算视点信息并将其发送到控制器的发送器，从控制器接收用于生成显示图像的视点信息的接收器和用于读取对应于图像数据的图像数据的图像生成器 来自先前保持的用于生成显示图像的图像数据的视点信息，并且生成并将显示图像输出到显示器。

公开(公告)号：US06757441B1

公开(公告)日：2004-06-29

申请号：US09653002

申请日：2000-08-31

申请人： Akihiro Katayama ,  Daisuke Kotake ,  Yukio Sakagawa

发明人： Akihiro Katayama ,  Daisuke Kotake ,  Yukio Sakagawa

IPC分类号： G06K936

CPC分类号： G06T9/007

摘要： There is disclosed an image data encoding/decoding method and apparatus which can efficiently encode multi-viewpoint image data obtained by sensing a single object from many viewpoints, and can obtain decoded data in units of pixels at high speed. Reference images which are not encoded are set every predetermined number of images (S701), and encoding is done using only the relationship with this reference image. An orthogonal transform is used in encoding, and an inverse transform formula for each pixel in a block is expanded and stored upon computing the orthogonal transform (S704). The coefficients after the orthogonal transform are fixed-length encoded in units of pixels (S705). Upon decoding, fixed-length encoded data corresponding to desired pixels are decoded, and pixel data are decoded by substituting coefficients obtained by decoding in the expansions generated upon encoding.

摘要翻译： 公开了一种图像数据编码/解码方法和装置，其可以有效地编码通过从多个视点感测单个对象而获得的多视点图像数据，并且可以以高速度以像素为单位获得解码数据。 对每个预定数量的图像设置未编码的参考图像（S701），并且仅使用与该参考图像的关系来完成编码。 在编码中使用正交变换，并且在计算正交变换时扩展并存储块中的每个像素的逆变换公式（S704）。 正交变换后的系数以像素为单位进行固定长度编码（S705）。 在解码时，对应于期望像素的固定长度编码数据进行解码，并且通过将通过解码获得的系数代入在编码时生成的扩展中来对像素数据进行解码。

公开(公告)号：US06674922B1

公开(公告)日：2004-01-06

申请号：US09499300

申请日：2000-02-07

申请人： Daisuke Kotake ,  Yukio Sakagawa ,  Akihiro Katayama

发明人： Daisuke Kotake ,  Yukio Sakagawa ,  Akihiro Katayama

IPC分类号： G06K932

CPC分类号： G06T3/4007 ,  G06T15/04 ,  G06T15/205

摘要： An image processing apparatus includes recording unit which has recorded image information appended with quantized space information in units of pixels, setting unit for setting a resolution higher than that of the recorded image information, reconstruction unit for reconstructing an image by reading out image information from the recording unit at the recorded resolution irrespective of the resolution set by the setting unit, and interpolation unit for making pixel interpolation of the reconstructed image with the resolution of the reconstructed image matching the resolution set by the setting unit.

摘要翻译： 一种图像处理装置，包括以像素为单位记录附加有量化空间信息的图像信息的记录单元，用于设置分辨率高于记录图像信息的分辨率的设置单​​元，用于通过从图像信息中读出图像信息来重建图像的重建单元 记录单元以与设置单元设置的分辨率无关的记录分辨率，以及内插单元，用于对具有与设置单元设置的分辨率相匹配的重建图像的分辨率进行重构图像的像素插值。

公开(公告)号：US07388982B2

公开(公告)日：2008-06-17

申请号：US10721875

申请日：2003-11-26

申请人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake ,  Yukio Sakagawa

发明人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake ,  Yukio Sakagawa

IPC分类号： G06K9/00

CPC分类号： G06T15/205 ,  G06T3/4038 ,  G06T5/007 ,  G06T7/30 ,  G06T2207/20212 ,  H04N5/23238

摘要： There are disclosed an image processing method and apparatus for generating a panoramic image in which the hue or brightness discontinuities generated at the seams of source images are reduced. According to the image processing method of this invention, upon compositing source images (221, 222) having an overlap portion, the hue or brightness of each source image is converted (H211, H221) using a reference image which has overlap portions with both the source images to be composited, and the converted images (241, 242) are composited, thereby reducing the hue or brightness discontinuities generated at the seam of images.

摘要翻译： 公开了一种用于生成全景图像的图像处理方法和装置，其中在源图像的接缝处产生的色调或亮度不连续性被减小。 根据本发明的图像处理方法，在合成具有重叠部分的源图像（221,222）之后，使用与图像重叠部分的参考图像对每个源图像的色调或亮度进行转换（H 211，H 221） 要复合的源图像和经转换的图像（241,242）被合成，从而减少在图像接缝处产生的色调或亮度不连续性。

公开(公告)号：US20050190181A1

公开(公告)日：2005-09-01

申请号：US11115162

申请日：2005-04-27

申请人： Yukio Sakagawa ,  Akihiro Katayama ,  Daisuke Kotake ,  Masakazu Fujiki

发明人： Yukio Sakagawa ,  Akihiro Katayama ,  Daisuke Kotake ,  Masakazu Fujiki

IPC分类号： G06T15/60 ,  G06T15/80 ,  G01N23/04 ,  G06T15/00

CPC分类号： G06T15/80 ,  G06T15/60

摘要： There is provided an image processing apparatus for describing a real image as a virtual object using space data formed based on a photo image of the real object, and generating a virtual image of the virtual object using the space data. The image processing apparatus captures the photo image of the real object from a real camera viewpoint position while illuminating the real object by an illumination light source placed at a real illumination position. The captured photo image is converted into space data in the form of an object for each pixel, and the space data is stored in a memory together with various illumination conditions at the real illumination position to allow a search at a later time.

摘要翻译： 提供了一种图像处理装置，用于使用基于真实对象的照片图像形成的空间数据将真实图像描述为虚拟对象，并且使用空间数据生成虚拟对象的虚拟图像。 图像处理装置通过放置在实际照明位置的照明光源照射真实物体，从实际照相机视点位置捕获真实物体的照片图像。 拍摄的照片图像被转换为​​每个像素的对象形式的空间数据，并且空间数据与实际照明位置处的各种照明条件一起存储在存储器中，以允许在稍后的时间进行搜索。

公开(公告)号：US06825837B1

公开(公告)日：2004-11-30

申请号：US09642091

申请日：2000-08-21

申请人： Yukio Sakagawa ,  Akihiro Katayama ,  Daisuke Kotake

发明人： Yukio Sakagawa ,  Akihiro Katayama ,  Daisuke Kotake

IPC分类号： G06T1500

CPC分类号： G06T15/205 ,  G06T19/003

摘要： In a space rendering method for rendering a virtual space, ray space data of virtual objects in the virtual space are stored in an external database (29). When space data of a virtual object located within a predetermined range from the indicated position is not present in an internal memory (27), the space data is downloaded from the database (29) to the internal memory (27), and the virtual space is rendered on the basis of the downloaded space data.

摘要翻译： 在用于渲染虚拟空间的空间渲染方法中，虚拟空间中的虚拟对象的射线空间数据被存储在外部数据库（29）中。 当位于指示位置的预定范围内的虚拟对象的空间数据不存在于内部存储器（27）中时，空间数据从数据库（29）下载到内部存储器（27），虚拟空间 根据下载的空间数据进行渲染。

公开(公告)号：US06774898B1

公开(公告)日：2004-08-10

申请号：US09653271

申请日：2000-08-31

申请人： Akihiro Katayama ,  Yukio Sakagawa ,  Daisuke Kotake

发明人： Akihiro Katayama ,  Yukio Sakagawa ,  Daisuke Kotake

IPC分类号： G06T1700

CPC分类号： G06T15/00

摘要： There is disclosed a progressive display method upon rendering and displaying a virtual object expressed by RS data. When RS data is generated and recorded on the basis of real image data, map data that represents correspondence between a real image space and ray space is divided into a plurality of layers, and the resolutions of the individual layers are hierarchically changed, thus storing hierarchical map data. Upon rendering a virtual image from an arbitrary viewpoint position, rendering is done by looking up the hierarchical map data in turn in ascending order of resolution. Also, there are disclosed a downloading method of selectively downloading RS data and VRML data, and a rendering method of downloaded data. RS data with high resolution is stored in an external memory, and VRML data having a required memory size is stored in an internal memory. In principle, a virtual image is generated by rendering RS data to allow the user to experience the virtual space. When downloading of RS data is not in time, an image rendered based on VRML data is displayed.

摘要翻译： 公开了在呈现和显示由RS数据表示的虚拟对象时的逐行显示方法。 当基于真实图像数据生成和记录RS数据时，将表示真实图像空间和射线空间之间的对应关系的地图数据分成多个层，并且各层的分辨率被分层地改变，从而存储分层 地图数据。 在从任意视点位置呈现虚拟图像时，通过依次以分辨率的升序查找分层地图数据来进行渲染。 此外，公开了一种选择性地下载RS数据和VRML数据的下载方法，以及下载数据的呈现方法。 具有高分辨率的RS数据被存储在外部存储器中，并且具有所需存储器大小的VRML数据被存储在内部存储器中。 原则上，通过渲染RS数据来生成虚拟图像，以允许用户体验虚拟空间。 当RS数据的下载不及时时，显示基于VRML数据的图像。

公开(公告)号：US07626596B2

公开(公告)日：2009-12-01

申请号：US10988615

申请日：2004-11-16

申请人： Daisuke Kotake ,  Akihiro Katayama ,  Yukio Sakagawa ,  Takaaki Endo ,  Masahiro Suzuki

发明人： Daisuke Kotake ,  Akihiro Katayama ,  Yukio Sakagawa ,  Takaaki Endo ,  Masahiro Suzuki

IPC分类号： G09G5/00

CPC分类号： G06T15/205 ,  G06T19/003 ,  G06T2219/004

摘要： In an image reproducing method capable of displaying annotations in virtual space constituted by a group of real panoramic images, if an object for which an annotation is to be displayed falls within the field of view at the position of the observer, the object is adopted as the display position of the annotation. If the object is not within the field of view, then the direction of forward travel of the observer is adopted as the annotation display position. If the object is in a state of transition, then the annotation display position is decided by interpolation.

摘要翻译： 在能够在由真实全景图像组构成的虚拟空间中显示注释的图像再现方法中，如果要在其上显示注释的对象落在观察者位置的视野内，则将该对象作为 注释的显示位置。 如果对象不在视野内，则采用观察者前进方向作为注释显示位置。 如果对象处于转换状态，则通过插值确定注释显示位置。

公开(公告)号：US07518636B2

公开(公告)日：2009-04-14

申请号：US10779791

申请日：2004-02-18

申请人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake ,  Yukio Sakagawa

发明人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake ,  Yukio Sakagawa

IPC分类号： H04N5/228

CPC分类号： H04N5/23248 ,  H04N5/23238 ,  H04N5/23258 ,  H04N5/23267

摘要： Shakiness of a panoramic video can be reduced by an image processing method comprising: setting a common coordinate system which can be transformed from individual coordinate systems of a plurality of image sensing devices; estimating postures of at least one of the plurality of image sensing devices; calculating an estimated posture of the common coordinate system using at least one of the estimated posture of the plurality of image sensing devices; calculating a correction transform for reducing a shakiness of the common coordinate system using the estimated posture of the common coordinate system; calculating a correction transform for reducing a shakiness of each of the plurality of image sensing devices using the correction transform; applying the corresponding correction transform to a sensed image which is sensed by each of the plurality of image sensing devices; and composing a panoramic image by joining a plurality of transformed sensed images.

摘要翻译： 可以通过图像处理方法来减少全景视频的抖动，包括：设置可以从多个图像感测装置的各个坐标系变换的公共坐标系; 估计所述多个图像感测装置中的至少一个的姿势; 使用所述多个图像感测装置的估计姿势中的至少一个来计算所述公共坐标系的估计姿势; 使用所述公共坐标系的估计姿态来计算用于减小所述公共坐标系的抖动的校正变换; 计算用于使用所述校正变换来减少所述多个图像感测装置中的每一个的抖动的校正变换; 将相应的校正变换应用于由所述多个图像感测装置中的每一个感测到的感测图像; 以及通过连接多个变换的感测图像来构成全景图像。