公开(公告)号：US07411594B2

公开(公告)日：2008-08-12

申请号：US10331549

申请日：2002-12-31

申请人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake

发明人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake

IPC分类号： G06T3/60 ,  G09G5/00

CPC分类号： G06T15/20 ,  G09B29/10

摘要： In order to improve the ease of operation of a conventional walk-through system using panoramic photographic images, a system is provided with a view calculating unit for calculating view information in accordance with a user instruction from an operation unit, the view information including view position information and view direction information; a panoramic image storing unit for storing a plurality of panoramic images; a path storing unit for storing path information of the panoramic images; an allowable path calculating unit for calculating allowable path information at a next dividing point in accordance with the view information and the path information; and an image generating unit for generating a cut-out image from the panoramic image in accordance with the view information, generating a sign figure representative of the allowable path in accordance with the allowable path information, and synthesizing the cut-out image and the sign figure to generate a display image.

摘要翻译： 为了提高使用全景摄影图像的常规步行系统的操作的便利性，系统设置有用于根据来自操作单元的用户指令来计算视图信息的视图计算单元，视图信息包括视点位置 信息和查看方向信息; 全景图像存储单元，用于存储多个全景图像; 路径存储单元，用于存储全景图像的路径信息; 允许路径计算单元，用于根据视图信息和路径信息来计算下一分割点处的可允许路径信息; 以及图像生成单元，用于根据视图信息从全景图像生成切出图像，根据允许路径信息生成表示允许路径的符号图形，并且合成切出图像和符号 图来生成显示图像。

公开(公告)号：US07673246B2

公开(公告)日：2010-03-02

申请号：US10314286

申请日：2002-12-09

申请人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake ,  Yukio Sakagawa

发明人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake ,  Yukio Sakagawa

IPC分类号： G06F3/00

CPC分类号： G06T15/205

摘要： An image information processing apparatus is provided to generate, from previously held image data, a display image according to a viewpoint designated by a user, and to communicate with a control apparatus which can communicate with plural image information processing apparatuses respectively generating display images and has a controller for controlling viewpoint information shared by the plural image information processing apparatuses on the basis of viewpoint information sent from the image information processing apparatus. This apparatus comprises a transmitter to calculate the viewpoint information based on a user's instruction and transmit it to the controller, a receiver to receive from the controller the viewpoint information for generating the display image, and an image generator to read the image data corresponding to the viewpoint information from the previously held image data for generating the display image, and generate and output the display image to a display.

摘要翻译： 提供一种图像信息处理装置，用于根据用户指定的视点从先前保存的图像数据生成显示图像，并且与可以与分别生成显示图像的多个图像信息处理装置通信的控制装置进行通信，并具有 控制器，用于基于从图像信息处理设备发送的视点信息来控制由多个图像信息处理设备共享的视点信息。 该装置包括基于用户指令计算视点信息并将其发送到控制器的发送器，从控制器接收用于生成显示图像的视点信息的接收器和用于读取对应于图像数据的图像数据的图像生成器 来自先前保持的用于生成显示图像的图像数据的视点信息，并且生成并将显示图像输出到显示器。

公开(公告)号：US07103232B2

公开(公告)日：2006-09-05

申请号：US09818627

申请日：2001-03-28

申请人： Daisuke Kotake ,  Akihiro Katayama

发明人： Daisuke Kotake ,  Akihiro Katayama

IPC分类号： G06K9/20

CPC分类号： G06T15/205

摘要： Each of the panoramic images corresponding to a plurality of positions of a viewpoint is compressed and stored as partial images obtained by dividing each panoramic image by a predetermined field of view. The panoramic image has a field of view wider than a display field of view of an image to be displayed on a display unit. A partial image containing an image to be reproduced is selected based on the information about the position and the direction of a viewpoint and the display field of view, and an image corresponding to the position and the direction of a viewpoint is generated and displayed from the selected partial image. Thus, when virtual space in the walk-through system is designed using the IBR technology, stored image data can be efficiently reproduced.

摘要翻译： 对应于视点的多个位置的每个全景图像被压缩并存储为通过将每个全景图像除以预定视场而获得的部分图像。 全景图像具有比要显示在显示单元上的图像的显示视野更宽的视野。 基于关于视点的位置和方向的信息以及显示视野来选择包含要再现的图像的部分图像，并且从视点的位置和方向生成并显示与视点的位置和方向对应的图像 选择部分图像。 因此，当使用IBR技术设计步行系统中的虚拟空间时，可以有效地再现存储的图像数据。

公开(公告)号：US06757441B1

公开(公告)日：2004-06-29

申请号：US09653002

申请日：2000-08-31

申请人： Akihiro Katayama ,  Daisuke Kotake ,  Yukio Sakagawa

发明人： Akihiro Katayama ,  Daisuke Kotake ,  Yukio Sakagawa

IPC分类号： G06K936

CPC分类号： G06T9/007

摘要： There is disclosed an image data encoding/decoding method and apparatus which can efficiently encode multi-viewpoint image data obtained by sensing a single object from many viewpoints, and can obtain decoded data in units of pixels at high speed. Reference images which are not encoded are set every predetermined number of images (S701), and encoding is done using only the relationship with this reference image. An orthogonal transform is used in encoding, and an inverse transform formula for each pixel in a block is expanded and stored upon computing the orthogonal transform (S704). The coefficients after the orthogonal transform are fixed-length encoded in units of pixels (S705). Upon decoding, fixed-length encoded data corresponding to desired pixels are decoded, and pixel data are decoded by substituting coefficients obtained by decoding in the expansions generated upon encoding.

摘要翻译： 公开了一种图像数据编码/解码方法和装置，其可以有效地编码通过从多个视点感测单个对象而获得的多视点图像数据，并且可以以高速度以像素为单位获得解码数据。 对每个预定数量的图像设置未编码的参考图像（S701），并且仅使用与该参考图像的关系来完成编码。 在编码中使用正交变换，并且在计算正交变换时扩展并存储块中的每个像素的逆变换公式（S704）。 正交变换后的系数以像素为单位进行固定长度编码（S705）。 在解码时，对应于期望像素的固定长度编码数据进行解码，并且通过将通过解码获得的系数代入在编码时生成的扩展中来对像素数据进行解码。

公开(公告)号：US06674922B1

公开(公告)日：2004-01-06

申请号：US09499300

申请日：2000-02-07

申请人： Daisuke Kotake ,  Yukio Sakagawa ,  Akihiro Katayama

发明人： Daisuke Kotake ,  Yukio Sakagawa ,  Akihiro Katayama

IPC分类号： G06K932

CPC分类号： G06T3/4007 ,  G06T15/04 ,  G06T15/205

摘要： An image processing apparatus includes recording unit which has recorded image information appended with quantized space information in units of pixels, setting unit for setting a resolution higher than that of the recorded image information, reconstruction unit for reconstructing an image by reading out image information from the recording unit at the recorded resolution irrespective of the resolution set by the setting unit, and interpolation unit for making pixel interpolation of the reconstructed image with the resolution of the reconstructed image matching the resolution set by the setting unit.

摘要翻译： 一种图像处理装置，包括以像素为单位记录附加有量化空间信息的图像信息的记录单元，用于设置分辨率高于记录图像信息的分辨率的设置单​​元，用于通过从图像信息中读出图像信息来重建图像的重建单元 记录单元以与设置单元设置的分辨率无关的记录分辨率，以及内插单元，用于对具有与设置单元设置的分辨率相匹配的重建图像的分辨率进行重构图像的像素插值。

公开(公告)号：US20090009522A1

公开(公告)日：2009-01-08

申请号：US12169926

申请日：2008-07-09

申请人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake

发明人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake

IPC分类号： G06T13/00

CPC分类号： G06T15/20 ,  G09B29/10

摘要： In order to improve the operationality of a walk-through system using panorama photography images, the system is provided with a view calculating unit for calculating view information in accordance with a user instruction from an operation unit, the view information including view position information and view direction information; a panorama image storing unit for storing a plurality of panorama images; a path storing unit for storing path information of the panorama images; an advancable path calculating unit for calculating advancable path information at a next dividing point in accordance with the view information and the path information; and an image generating unit for generating a cut-out image from the panorama image in accordance with the view information, generating a sign figure representative of the advancable path in accordance with the advancable path information, and synthesizing the cut-out image and the sign figure to generate a display image.

摘要翻译： 为了提高使用全景拍摄图像的步行系统的操作性，系统设置有用于根据来自操作单元的用户指令来计算视图信息的视图计算单元，包括视图位置信息和视图的视图信息 方向信息; 全景图像存储单元，用于存储多个全景图像; 路径存储单元，用于存储全景图像的路径信息; 用于根据视图信息和路径信息在下一个分割点处计算可行路径信息的可行路径计算单元; 以及图像生成单元，用于根据视图信息从全景图像生成切出图像，根据可推荐路径信息生成代表可行路径的符号图形，并且合成切出图像和符号 图来生成显示图像。

公开(公告)号：US06930685B1

公开(公告)日：2005-08-16

申请号：US09512836

申请日：2000-02-25

申请人： Yukio Sakagawa ,  Akihiro Katayama ,  Daisuke Kotake ,  Masakazu Fujiki

发明人： Yukio Sakagawa ,  Akihiro Katayama ,  Daisuke Kotake ,  Masakazu Fujiki

IPC分类号： G06T15/60 ,  G06T15/80 ,  H04N5/262

CPC分类号： G06T15/80 ,  G06T15/60

摘要： There is provided an image processing apparatus for describing a real image as a virtual object using space data formed based on a photo image of the real object, and generating a virtual image of the virtual object using the space data. The image processing apparatus captures the photo image of the real object from a real camera viewpoint position while illuminating the real object by an illumination light source placed at a real illumination position. The captured photo image is converted into space data in the form of an object for each pixel, and the space data is stored in a memory together with various illumination conditions at the real illumination position to allow a search at a later time.

公开(公告)号：US07791618B2

公开(公告)日：2010-09-07

申请号：US12169926

申请日：2008-07-09

申请人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake

发明人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake

IPC分类号： G06T3/60 ,  G09G5/00

CPC分类号： G06T15/20 ,  G09B29/10

摘要： In order to improve the operationality of a walk-through system using panorama photography images, the system is provided with a view calculating unit for calculating view information in accordance with a user instruction from an operation unit, the view information including view position information and view direction information; a panorama image storing unit for storing a plurality of panorama images; a path storing unit for storing path information of the panorama images; an advancable path calculating unit for calculating advancable path information at a next dividing point in accordance with the view information and the path information; and an image generating unit for generating a cut-out image from the panorama image in accordance with the view information, generating a sign figure representative of the advancable path in accordance with the advancable path information, and synthesizing the cut-out image and the sign figure to generate a display image.

摘要翻译： 为了提高使用全景拍摄图像的步行系统的操作性，系统设置有用于根据来自操作单元的用户指令来计算视图信息的视图计算单元，包括视图位置信息和视图的视图信息 方向信息; 全景图像存储单元，用于存储多个全景图像; 路径存储单元，用于存储全景图像的路径信息; 用于根据视图信息和路径信息在下一个分割点处计算可行路径信息的可行路径计算单元; 以及图像生成单元，用于根据视图信息从全景图像生成切出图像，根据可推荐路径信息生成代表可行路径的符号图形，并且合成切出图像和符号 图来生成显示图像。

公开(公告)号：US07626596B2

公开(公告)日：2009-12-01

申请号：US10988615

申请日：2004-11-16

申请人： Daisuke Kotake ,  Akihiro Katayama ,  Yukio Sakagawa ,  Takaaki Endo ,  Masahiro Suzuki

发明人： Daisuke Kotake ,  Akihiro Katayama ,  Yukio Sakagawa ,  Takaaki Endo ,  Masahiro Suzuki

IPC分类号： G09G5/00

CPC分类号： G06T15/205 ,  G06T19/003 ,  G06T2219/004

摘要： In an image reproducing method capable of displaying annotations in virtual space constituted by a group of real panoramic images, if an object for which an annotation is to be displayed falls within the field of view at the position of the observer, the object is adopted as the display position of the annotation. If the object is not within the field of view, then the direction of forward travel of the observer is adopted as the annotation display position. If the object is in a state of transition, then the annotation display position is decided by interpolation.

摘要翻译： 在能够在由真实全景图像组构成的虚拟空间中显示注释的图像再现方法中，如果要在其上显示注释的对象落在观察者位置的视野内，则将该对象作为 注释的显示位置。 如果对象不在视野内，则采用观察者前进方向作为注释显示位置。 如果对象处于转换状态，则通过插值确定注释显示位置。

公开(公告)号：US07518636B2

公开(公告)日：2009-04-14

申请号：US10779791

申请日：2004-02-18

申请人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake ,  Yukio Sakagawa

发明人： Takaaki Endo ,  Akihiro Katayama ,  Masahiro Suzuki ,  Daisuke Kotake ,  Yukio Sakagawa

IPC分类号： H04N5/228

CPC分类号： H04N5/23248 ,  H04N5/23238 ,  H04N5/23258 ,  H04N5/23267

摘要： Shakiness of a panoramic video can be reduced by an image processing method comprising: setting a common coordinate system which can be transformed from individual coordinate systems of a plurality of image sensing devices; estimating postures of at least one of the plurality of image sensing devices; calculating an estimated posture of the common coordinate system using at least one of the estimated posture of the plurality of image sensing devices; calculating a correction transform for reducing a shakiness of the common coordinate system using the estimated posture of the common coordinate system; calculating a correction transform for reducing a shakiness of each of the plurality of image sensing devices using the correction transform; applying the corresponding correction transform to a sensed image which is sensed by each of the plurality of image sensing devices; and composing a panoramic image by joining a plurality of transformed sensed images.

摘要翻译： 可以通过图像处理方法来减少全景视频的抖动，包括：设置可以从多个图像感测装置的各个坐标系变换的公共坐标系; 估计所述多个图像感测装置中的至少一个的姿势; 使用所述多个图像感测装置的估计姿势中的至少一个来计算所述公共坐标系的估计姿势; 使用所述公共坐标系的估计姿态来计算用于减小所述公共坐标系的抖动的校正变换; 计算用于使用所述校正变换来减少所述多个图像感测装置中的每一个的抖动的校正变换; 将相应的校正变换应用于由所述多个图像感测装置中的每一个感测到的感测图像; 以及通过连接多个变换的感测图像来构成全景图像。