公开(公告)号：US07386163B2

公开(公告)日：2008-06-10

申请号：US10387647

申请日：2003-03-13

申请人： Kohtaro Sabe ,  Kenta Kawamoto ,  Takeshi Ohashi ,  Masaki Fukuchi ,  Atsushi Okubo ,  Steffen Gutmann

发明人： Kohtaro Sabe ,  Kenta Kawamoto ,  Takeshi Ohashi ,  Masaki Fukuchi ,  Atsushi Okubo ,  Steffen Gutmann

IPC分类号： G06K9/00 ,  H04N15/00 ,  H04N7/00 ,  H04N7/18 ,  G06F19/00 ,  G06F17/10 ,  G01C22/00

CPC分类号： G06K9/00664 ,  G06T7/97

摘要： An obstacle recognition apparatus is provided which can recognize an obstacle by accurately extracting a floor surface. It includes a distance image generator (222) to produce a distance image using a disparity image and homogeneous transform matrix, a plane detector (223) to detect plane parameters on the basis of the distance image from the distance image generator (222), a coordinate transformer (224) to transform the homogeneous transform matrix into a coordinate of a ground-contact plane of a robot apparatus (1), and a floor surface detector (225) to detect a floor surface using the plane parameters from the plane detector (223) and result of coordinate transformation from the coordinate transformer (224) and supply the plane parameters to an obstacle recognition block (226). The obstacle recognition block (226) selects one of points on the floor surface using the plane parameters of the floor surface detected by the floor surface detector (225) and recognizes an obstacle on the basis of the selected point.

摘要翻译： 提供了能够通过精确地提取地板面来识别障碍物的障碍物识别装置。 它包括使用视差图像和均匀变换矩阵产生距离图像的距离图像生成器（222），基于距离图像生成器（222）的距离图像检测平面参数的平面检测器（223）， 将所述均匀变换矩阵变换为机器人装置（1）的接地面的坐标的坐标变换器（224）和使用来自所述平面检测器的平面参数来检测地板面的地板面检测器（225） 223）和从坐标变换器（224）的坐标变换的结果，并将平面参数提供给障碍物识别块（226）。 障碍物识别块（226）使用由地板表面检测器（225）检测到的地板表面的平面参数来选择地板表面上的一个点，并基于所选择的点识别障碍物。

公开(公告)号：US08289321B2

公开(公告)日：2012-10-16

申请号：US10593150

申请日：2005-03-17

申请人： Steffen Gutmann ,  Masaki Fukuchi ,  Kohtaro Sabe ,  Kenta Kawamoto

发明人： Steffen Gutmann ,  Masaki Fukuchi ,  Kohtaro Sabe ,  Kenta Kawamoto

IPC分类号： G06T15/30

CPC分类号： G06K9/00664 ,  B62D57/024 ,  G06K9/00201 ,  G06T7/13 ,  G06T7/73 ,  G06T2207/30252

摘要： In a plane detection apparatus, a plane detection unit (3) includes a line fitting block (4) to select a group of distance data points being in one plane from distance data forming an image and extract lines from the distance data point group, and a region growing block (5) to detect one or more planar regions existing in the image from a group of all lines included in the image and extracted by the line fitting block (4). The line fitting block (4) first draws a line D1 connecting end points of the distance data point group, searches a point of interest brk whose distance to the line L1 is largest, segments the data point group by the point of interest brk when the distance is larger than a predetermined threshold, and determines a line L2 by the least-squares method when the distance is smaller than the predetermined threshold. In case there exists a larger number of data points than a predetermine number on one side of the line L2, the data point group is determined to be in a zig-zag shape, the data point group is segmented by the point of interest brk. These operations are done repeatedly. Thus, a plurality of planes robust against noises is detected simultaneously and accurately from distance data including measurement noises.

摘要翻译： 在平面检测装置中，平面检测装置（3）包括线拟合块（4），用于从形成图像的距离数据中选择位于一个平面中的一组距离数据点，并从距离数据点组提取线， 区域生长块（5），用于检测图像中存在的一个或多个平面区域，所述平面区域包括在所述图像中并由所述线拟合块（4）提取。 线拟合块（4）首先画出连接距离数据点组的端点的线D1，搜索距离线L1的距离最大的兴趣点brk，当数据点组的距离为 距离大于预定阈值，并且当距离小于预定阈值时，通过最小二乘法确定线路L2。 在线L2的一侧存在比预定数更多的数据点的情况下，数据点组被确定为Z字形，数据点组被兴趣点brk分割。 这些操作重复完成。 因此，从包括测量噪声的距离数据同时且准确地检测到抵抗噪声的多个平面。

公开(公告)号：US20060025888A1

公开(公告)日：2006-02-02

申请号：US11165047

申请日：2005-06-24

申请人： Steffen Gutmann ,  Masaki Fukuchi ,  Kohtaro Sabe ,  James Bruce

发明人： Steffen Gutmann ,  Masaki Fukuchi ,  Kohtaro Sabe ,  James Bruce

IPC分类号： G06F19/00

CPC分类号： G06K9/00664 ,  G06T7/593

摘要： An environment map building method and an environment map building apparatus can express the surrounding embodiment with a high resolution in the height direction in a manner robust relative to observation noises. The present invention provides an environment map building apparatus for building a three-dimensional environment map to be used for three-dimensionally determining a region allowing a moving body to move therein according to external environment conditions, which comprises an external environment conditions detecting section that detects external environment conditions, a three-dimensional map building section that builds a three-dimensional map showing the state of occupancy of a three-dimensional grid on the basis of the external environment conditions detected by the external environment conditions detecting section, a relative-to-base-plane height map building section that builds a relative-to-base-plane height map showing heights from a two-dimensional base plane on the basis of the external environment conditions detected by the external environment conditions detecting section, and a height map information modifying section that modifies the information of the relative-to-base-plane height map on the basis of the information on the three-dimensional map.

摘要翻译： 环境地图构建方法和环境地图构建装置可以以相对于观察噪声鲁棒的方式在高度方向上以高分辨率表达周围的实施例。 本发明提供了一种用于构建三维环境图的环境地图构建装置，其用于三维地确定允许移动体根据外部环境条件在其中移动的区域，该外部环境条件包括外部环境条件检测部分，其检测 外部环境条件，基于由外部环境条件检测部检测到的外部环境条件构建表示三维网格的占有状态的三维地图的三维地图构建部，相对于 - 基平面高度图构建部，其基于由外部环境条件检测部检测到的外部环境条件，构建从二维基面显示高度的相对基准面高度图，以及高度图 信息修改部分，其修改相对于基站的信息， 平面高度图基于三维地图上的信息。

公开(公告)号：US07912583B2

公开(公告)日：2011-03-22

申请号：US11165047

申请日：2005-06-24

申请人： Steffen Gutmann ,  Masaki Fukuchi ,  Kohtaro Sabe ,  James R. Bruce

发明人： Steffen Gutmann ,  Masaki Fukuchi ,  Kohtaro Sabe ,  James R. Bruce

IPC分类号： G06F19/00 ,  G01C21/00

CPC分类号： G06K9/00664 ,  G06T7/593

摘要： An environment map building method and an environment map building apparatus can express the surrounding embodiment with a high resolution in the height direction in a manner robust relative to observation noises. The present invention provides an environment map building apparatus for building a three-dimensional environment map to be used for three-dimensionally determining a region allowing a moving body to move therein according to external environment conditions, which comprises an external environment conditions detecting section that detects external environment conditions, a three-dimensional map building section that builds a three-dimensional map showing the state of occupancy of a three-dimensional grid on the basis of the external environment conditions detected by the external environment conditions detecting section, a relative-to-base-plane height map building section that builds a relative-to-base-plane height map showing heights from a two-dimensional base plane on the basis of the external environment conditions detected by the external environment conditions detecting section, and a height map information modifying section that modifies the information of the relative-to-base-plane height map on the basis of the information on the three-dimensional map.

摘要翻译： 环境地图构建方法和环境地图构建装置可以以相对于观察噪声鲁棒的方式在高度方向上以高分辨率表达周围的实施例。 本发明提供了一种用于构建三维环境图的环境地图构建装置，其用于三维地确定允许移动体根据外部环境条件在其中移动的区域，该外部环境条件包括外部环境条件检测部分，其检测 外部环境条件，基于由外部环境条件检测部检测到的外部环境条件构建表示三维网格的占有状态的三维地图的三维地图构建部，相对于 - 基平面高度图构建部，其基于由外部环境条件检测部检测到的外部环境条件，构建从二维基面显示高度的相对基准面高度图，以及高度图 信息修改部分，其修改相对于基站的信息， 平面高度图基于三维地图上的信息。

公开(公告)号：US20070257910A1

公开(公告)日：2007-11-08

申请号：US10593150

申请日：2005-03-17

申请人： Steffen Gutmann ,  Masaki Fukuchi ,  Kotaro Sabe ,  Kenta Kawamoto

发明人： Steffen Gutmann ,  Masaki Fukuchi ,  Kotaro Sabe ,  Kenta Kawamoto

IPC分类号： G06T17/00

CPC分类号： G06K9/00664 ,  B62D57/024 ,  G06K9/00201 ,  G06T7/13 ,  G06T7/73 ,  G06T2207/30252

摘要： In a plane detection apparatus, a plane detection unit (3) includes a line fitting block (4) to select a group of distance data points being in one plane from distance data forming an image and extract lines from the distance data point group, and a region growing block (5) to detect one or more planar regions existing in the image from a group of all lines included in the image and extracted by the line fitting block (4). The line fitting block (4) first draws a line D1 connecting end points of the distance data point group, searches a point of interest brk whose distance to the line L1 is largest, segments the data point group by the point of interest brk when the distance is larger than a predetermined threshold, and determines a line L2 by the least-squares method when the distance is smaller than the predetermined threshold. In case there exists a larger number of data points than a predetermine number on one side of the line L2, the data point group is determined to be in a zig-zag shape, the data point group is segmented by the point of interest brk. These operations are done repeatedly. Thus, a plurality of planes robust against noises is detected simultaneously and accurately from distance data including measurement noises.

摘要翻译： 在平面检测装置中，平面检测装置（3）包括线拟合块（4），用于从形成图像的距离数据中选择位于一个平面中的一组距离数据点，并从距离数据点组提取线， 区域生长块（5），用于检测图像中存在的一个或多个平面区域，所述平面区域包括在所述图像中并由所述线拟合块（4）提取。 线拟合块（4）首先画出连接距离数据点组的端点的线D1，搜索距离线L 1最大的距离的兴趣点brk，将数据点组划分为兴趣点brk 当距离大于预定阈值时，并且当距离小于预定阈值时，通过最小二乘法确定线路L 2。 在线L2的一侧存在比预定数量多的数据点的情况下，数据点组被确定为Z字形，数据点组被兴趣点分割 。 这些操作重复完成。 因此，从包括测量噪声的距离数据同时且准确地检测到抵抗噪声的多个平面。

公开(公告)号：US07865267B2

公开(公告)日：2011-01-04

申请号：US10941813

申请日：2004-09-16

申请人： Kohtaro Sabe ,  Steffen Gutmann

发明人： Kohtaro Sabe ,  Steffen Gutmann

IPC分类号： G06F19/00

CPC分类号： G06K9/00691 ,  G05D1/0251 ,  G05D1/0274 ,  G05D2201/0217 ,  G06K9/00201

摘要： An environment recognizing device and an environment recognizing method can draw an environment map for judging if it is possible to move a region where one or more than one steps are found above or below a floor, a route planning device and a route planning method that can appropriately plan a moving route, using such an environment map and a robot equipped with such an environment recognizing device and a route planning device. The robot comprises an environment recognizing section including a plurality of plane extracting section 401 adapted to compute plane parameters from a parallax image or a distance image and extract a plurality of planes including the floor surface, an obstacle recognizing section 402 adapted to recognize obstacles on the plurality of planes including the floor surface and an environment map updating section 403 adapted to draw an environment map (obstacle map) for each of the planes on the basis of the result of recognition of the obstacle recognizing section 402 and update the existing environment maps and a route planning section 404 adapted to plan a route on the basis of the environment maps. The route planning section 404 selects a plane as route coordinate when an obstacle is found on it in the environment map of the floor surface but not found in the environment map of the plane.

摘要翻译： 环境识别装置和环境识别方法可以画出用于判断是否可能移动在地板上方或下方发现一个或多个步骤的区域的环境地图，路线规划装置和路线规划方法，其可以 使用这样的环境地图和配备有这样的环境识别装置的机器人以及路径规划装置，适当地规划移动路线。 机器人包括环境识别部分，其包括适于从视差图像或距离图像计算平面参数的多个平面提取部分401，并且提取包括地面的多个平面;障碍物识别部分402，适于识别 包括地面的多个平面和适于根据障碍物识别部402的识别结果绘制每个平面的环境地图（障碍图）的环境地图更新部403，并且更新现有的环境地图和 路线规划部404，其适于基于环境图来规划路线。 路线规划部404在平面的环境地图中没有发现在地面的环境地图中发现障碍物时，选择平面作为路线坐标。

公开(公告)号：US20050131581A1

公开(公告)日：2005-06-16

申请号：US10941813

申请日：2004-09-16

申请人： Kohtaro Sabe ,  Steffen Gutmann

发明人： Kohtaro Sabe ,  Steffen Gutmann

IPC分类号： B25J5/00 ,  B25J13/08 ,  G05D1/02 ,  G06K9/00 ,  G06T1/00 ,  G06T7/00 ,  G06F19/00

CPC分类号： G06K9/00691 ,  G05D1/0251 ,  G05D1/0274 ,  G05D2201/0217 ,  G06K9/00201

摘要： An environment recognizing device and an environment recognizing method can draw an environment map for judging if it is possible to move a region where one or more than one steps are found above or below a floor, a route planning device and a route planning method that can appropriately plan a moving route, using such an environment map and a robot equipped with such an environment recognizing device and a route planning device. The robot comprises an environment recognizing section including a plurality of plane extracting section 401 adapted to compute plane parameters from a parallax image or a distance image and extract a plurality of planes including the floor surface, an obstacle recognizing section 402 adapted to recognize obstacles on the plurality of planes including the floor surface and an environment map updating section 403 adapted to draw an environment map (obstacle map) for each of the planes on the basis of the result of recognition of the obstacle recognizing section 402 and update the existing environment maps and a route planning section 404 adapted to plan a route on the basis of the environment maps. The route planning section 404 selects a plane as route coordinate when an obstacle is found on it in the environment map of the floor surface but not found in the environment map of the plane.

摘要翻译： 环境识别装置和环境识别方法可以画出用于判断是否可能移动在地板上方或下方发现一个或多个步骤的区域的环境地图，路线规划装置和路线规划方法，其可以 使用这样的环境地图和配备有这样的环境识别装置的机器人以及路径规划装置，适当地规划移动路线。 机器人包括环境识别部分，其包括适于从视差图像或距离图像计算平面参数的多个平面提取部分401，并且提取包括地面的多个平面;障碍物识别部分402，适于识别 包括地面的多个平面和适于根据障碍物识别部402的识别结果绘制每个平面的环境地图（障碍图）的环境地图更新部403，并且更新现有的环境地图和 路线规划部404，其适于基于环境图来规划路线。 路线规划部404在平面的环境地图中没有发现在地面的环境地图中发现障碍物时，选择平面作为路线坐标。

公开(公告)号：US20060064202A1

公开(公告)日：2006-03-23

申请号：US10525431

申请日：2003-08-22

申请人： Steffen Gutmann ,  Masaki Fukuchi

发明人： Steffen Gutmann ,  Masaki Fukuchi

IPC分类号： G06F19/00

CPC分类号： G06K9/00664 ,  G05D1/0221 ,  G05D1/0234 ,  G05D1/0251 ,  G05D1/0274 ,  G05D2201/0214 ,  G05D2201/0217

摘要： An environment identifying apparatus (400) is adapted to be mounted in a robot apparatus that moves in an identifiable unique environment in which a plurality of landmarks are located so as to identify the current environment by means of a plurality of registered environments. The environment identifying apparatus comprises an environment map building section (402) for recognizing the landmarks in the current environment, computing the movement/state quantity of the robot apparatus itself and building an environment map of the current environment containing information on the positions of the landmarks in the current environment on the basis of the landmarks and the movement/state quantity, an environment map storage section (403) having a data base of registered environment maps containing positional information on the landmarks and environment IDs, an environment identifying section (404) for identifying the current environment on the basis of the degree of similarity between the environment map of the current environment and each of the registered environment maps and an environment exploring section (405) for exploring a new environment.

摘要翻译： 环境识别装置（400）适于安装在机器人装置中，该机器人装置在可识别的独特环境中移动多个地标，以便通过多个注册环境识别当前环境。 环境识别装置包括用于识别当前环境中的地标的环境地图建立部分（402），计算机器人装置自身的移动/状态量并构建包含关于地标位置的信息的当前环境的环境地图 在当前环境中，基于地标和移动/状态量，具有包含有关地标和环境ID的位置信息的注册环境地图的数据库的环境地图存储部（403），环境识别部（404） 用于基于当前环境的环境地图和每个注册环境地图之间的相似程度以及用于探索新环境的环境探索部分（405）来识别当前环境。

公开(公告)号：US07873447B2

公开(公告)日：2011-01-18

申请号：US11745947

申请日：2007-05-08

申请人： Kenichiro Oi ,  Masahiro Fujita ,  Takayuki Yoshigahara ,  Steffen Gutmann ,  Masaki Fukuchi

发明人： Kenichiro Oi ,  Masahiro Fujita ,  Takayuki Yoshigahara ,  Steffen Gutmann ,  Masaki Fukuchi

IPC分类号： G06F17/00

CPC分类号： G01C21/12 ,  G01C22/02

摘要： The present invention provides a position estimation apparatus capable of determining whether an estimated value deviates from an actual value and trying a process to correct the estimated value if the estimated value is determined to be incorrect. The position estimation apparatus employs a position prediction unit configured to produce a prediction of the position of a mobile object having an odometry sensor mounted thereon, an environment observation unit configured to keep track of each feature point in the environment of the mobile object, a prediction-error check unit configured to determine whether the position prediction produced by the position prediction unit is correct or incorrect, a position-prediction correction unit configured to correct a wrong position prediction and a position/posture updating unit configured to update the position and/or posture of the mobile object on the basis of a correct position prediction.

摘要翻译： 本发明提供一种位置估计装置，其能够确定估计值是否偏离实际值，并且如果估计值被确定为不正确则尝试过程来校正估计值。 位置估计装置使用位置预测单元，其被配置为产生安装有测距传感器的移动体的位置的预测，环境观测单元，被配置为跟踪移动体的环境中的每个特征点，预测 错误检查单元，被配置为确定位置预测单元产生的位置预测是正确还是不正确;位置预测校正单元，被配置为校正错误的位置预测;以及位置/姿势更新单元，被配置为更新位置和/或 基于正确位置预测的移动物体的姿态。

公开(公告)号：US07263412B2

公开(公告)日：2007-08-28

申请号：US10470456

申请日：2002-11-27

申请人： Steffen Gutmann ,  Masaki Fukuchi

发明人： Steffen Gutmann ,  Masaki Fukuchi

IPC分类号： G06F19/00

CPC分类号： G06K9/00664 ,  G05D1/0231 ,  G05D1/0246 ,  G05D1/0272

摘要： A self-localization system uses both of a global search apparatus, which is based on grid-based Markov localization, and a local search apparatus, which uses an extended Kalman filter. If an observation result by the global search apparatus is valid, then updating of an observation result by the local search apparatus is permitted, but if the observation result is not valid, then updating of the observation result by the local search apparatus is not performed. On the other hand, if the observation result by the local search apparatus is valid, then a state of the local search is outputted, but if the observation result is not valid, then the local search apparatus is re-initialized. Accordingly, the self-localization of a robot can be performed based on sensor information of the robot and motion information performed by the robot in an environment including artificial landmarks.

摘要翻译： 自定位系统使用基于网格的马尔可夫定位的全局搜索装置和使用扩展卡尔曼滤波器的本地搜索装置。 如果全局搜索装置的观察结果有效，则允许由本地搜索装置更新观察结果，但是如果观察结果无效，则不进行本地搜索装置的观察结果的更新。 另一方面，如果本地搜索装置的观察结果有效，则输出本地搜索的状态，但是如果观察结果无效，则本地搜索装置被重新初始化。 因此，可以基于机器人的传感器信息和机器人在包括人造地标的环境中执行的运动信息来执行机器人的自定位。