公开(公告)号：US20110187746A1

公开(公告)日：2011-08-04

申请号：US12984847

申请日：2011-01-05

申请人： Yasuhiro SUTO ,  Masaki Fukuchi ,  Kenichiro Oi ,  Jingjing Guo ,  Kouichi Matsuda

发明人： Yasuhiro SUTO ,  Masaki Fukuchi ,  Kenichiro Oi ,  Jingjing Guo ,  Kouichi Matsuda

IPC分类号： G09G5/00

CPC分类号： G06T19/006 ,  G02B27/0172 ,  G02B2027/014 ,  G06T11/60 ,  G06T19/003 ,  G09G5/00

摘要： There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.

摘要翻译： 提供了一种图像处理装置，包括：数据存储单元，存储指示一个或多个物理对象的外观特征的特征数据; 环境地图构建单元，用于基于通过对实际空间进行成像获得的输入图像和特征数据构建环境地图，所述环境地图表示存在于所述实际空间中的物理对象的位置; 控制单元，用于获取用于在实际空间中执行的一组操作程序的过程数据，所述过程数据定义每个过程的方向与指定要显示方向的位置的位置信息之间的对应关系; 以及叠加单元，用于通过使用过程数据在基于环境地图确定的输入图像中的位置和位置信息上叠加用于每个过程的方向来生成输出图像。

公开(公告)号：US20110044504A1

公开(公告)日：2011-02-24

申请号：US12855075

申请日：2010-08-12

申请人： Kenichiro OI ,  Masaki Fukuchi

发明人： Kenichiro OI ,  Masaki Fukuchi

IPC分类号： G06K9/00

CPC分类号： G06T7/0042 ,  G06T7/73

摘要： An information processing device, including: a three-dimensional information generating section for obtaining position and attitude of a moving camera or three-dimensional positions of feature points by successively receiving captured images from different viewpoints, and updating status data using observation information which includes tracking information of the feature points, the status data including three-dimensional positions of the feature points within the images and position and attitude information of the camera; and a submap generating section for generating submaps by dividing an area for which the three-dimensional position is to be calculated. The three-dimensional information generating section obtains position and attitude of the camera or three-dimensional positions of the feature points by generating status data corresponding to the submaps not including information about feature points outside of a submap area for each of the generated submaps and updating the generated status data corresponding to the submaps.

摘要翻译： 一种信息处理设备，包括：三维信息产生部分，用于通过从不同视点连续接收捕获的图像来获得运动相机的位置和姿态或特征点的三维位置，以及使用包括跟踪的观察信息来更新状态数据 特征点的信息，包括图像内的特征点的三维位置的状态数据以及相机的位置和姿态信息; 以及子图生成部，其通过划分要计算三维位置的区域来生成子图。 三维信息生成部通过生成与不包含关于每个生成的子图下的子图区域以外的特征点的信息对应的状态数据，来获取相机的位置和姿态或特征点的三维位置，并且更新 生成的状态数据对应于子地图。

公开(公告)号：US20050267634A1

公开(公告)日：2005-12-01

申请号：US11133403

申请日：2005-05-19

申请人： Masaki Fukuchi ,  Takayuki Yoshigahara ,  Kohtaro Sabe ,  Takeshi Ohashi

发明人： Masaki Fukuchi ,  Takayuki Yoshigahara ,  Kohtaro Sabe ,  Takeshi Ohashi

IPC分类号： B25J5/00 ,  B25J9/16 ,  G06F19/00 ,  H04J3/00 ,  H04J3/02 ,  H04L12/43 ,  H04L29/06 ,  H04N7/08 ,  H04N7/081 ,  H04N7/173 ,  H04N7/18

CPC分类号： H04N21/4345 ,  H04L29/06027 ,  H04L65/602 ,  H04L65/604 ,  H04N21/2187 ,  H04N21/2362 ,  H04N21/2365 ,  H04N21/4347 ,  Y10S707/99945 ,  Y10S707/99948

摘要： An image transmission device and method, a transmitting device and method, a receiving device and method, and robot apparatus are capable of effectively transmitting the image data of multiple channels by using the existing systems which are formed on the premise of transmitting and receiving of the image data through single transmission line. At a transmitting side, the image data of multiple channels to be input is multiplexed with switching the channels by frame, and prescribed image information is added to each of the multiplexed image data of each frame. At a receiving side, the image information added to each of the image data for each frame respectively transmitted from the transmitting means are analyzed, and dividing means for dividing for each frame and outputting the multiplexed image data transmitted from the transmitting means to the corresponding channels is provided based on the analysis result.

摘要翻译： 图像传输装置和方法，发送装置和方法，接收装置和方法以及机器人装置能够通过使用在发送和接收的方式形成的现有系统来有效地发送多个信道的图像数据 图像数据通过单一传输线。 在发送侧，将要输入的多个信道的图像数据通过逐帧切换而多路复用，并且将规定的图像信息添加到每帧的多路复用图像数据中。 在接收侧，对从发送装置分别发送的每帧的每个图像数据添加的图像信息进行分析，并且对每个帧进行分割，并将从发送装置发送的复用图像数据输出到相应的信道 是基于分析结果提供的。

公开(公告)号：US09292974B2

公开(公告)日：2016-03-22

申请号：US13824140

申请日：2012-09-04

申请人： Akihiko Kaino ,  Masaki Fukuchi ,  Tatsuki Kashitani ,  Kenichiro Ooi ,  Jingjing Guo

发明人： Akihiko Kaino ,  Masaki Fukuchi ,  Tatsuki Kashitani ,  Kenichiro Ooi ,  Jingjing Guo

IPC分类号： G06T19/00 ,  G06T7/00

CPC分类号： G06T19/006 ,  G06T7/70 ,  G06T7/73 ,  G06T19/20 ,  G06T2207/10021 ,  G06T2207/30244 ,  G06T2219/004 ,  H04N7/183

摘要： An information processing system that acquires video data captured by an image pickup unit; detects an object from the video data; detects a condition corresponding to the image pickup unit; and controls a display to display content associated with the object at a position other than a detected position of the object based on the condition corresponding to the image pickup unit.

摘要翻译： 一种获取由图像拾取单元捕获的视频数据的信息处理系统; 从视频数据中检测对象; 检测与图像拾取单元相对应的条件; 并且基于与图像拾取单元相对应的条件，控制显示器以在对象的检测位置以外的位置处显示与对象相关联的内容。

公开(公告)号：US08861785B2

公开(公告)日：2014-10-14

申请号：US12855075

申请日：2010-08-12

申请人： Kenichiro Oi ,  Masaki Fukuchi

发明人： Kenichiro Oi ,  Masaki Fukuchi

IPC分类号： G06K9/00 ,  G06T7/00

CPC分类号： G06T7/0042 ,  G06T7/73

摘要： An information processing device, including: a three-dimensional information generating section for obtaining position and attitude of a moving camera or three-dimensional positions of feature points by successively receiving captured images from different viewpoints, and updating status data using observation information which includes tracking information of the feature points, the status data including three-dimensional positions of the feature points within the images and position and attitude information of the camera; and a submap generating section for generating submaps by dividing an area for which the three-dimensional position is to be calculated. The three-dimensional information generating section obtains position and attitude of the camera or three-dimensional positions of the feature points by generating status data corresponding to the submaps not including information about feature points outside of a submap area for each of the generated submaps and updating the generated status data corresponding to the submaps.

摘要翻译： 一种信息处理设备，包括：三维信息产生部分，用于通过从不同视点连续接收捕获的图像来获得运动相机的位置和姿态或特征点的三维位置，以及使用包括跟踪的观察信息来更新状态数据 特征点的信息，包括图像内的特征点的三维位置的状态数据以及相机的位置和姿态信息; 以及子图生成部，其通过划分要计算三维位置的区域来生成子图。 三维信息生成部通过生成与不包含关于每个生成的子图下的子图区域以外的特征点的信息对应的状态数据，来获取相机的位置和姿态或特征点的三维位置，并且更新 生成的状态数据对应于子地图。

公开(公告)号：US20110187726A1

公开(公告)日：2011-08-04

申请号：US13015566

申请日：2011-01-27

申请人： YASUHIRO SUTO ,  Kouichi Matsuda ,  Masaki Fukuchi ,  Kenichiro Oi ,  Jingjing Guo

发明人： YASUHIRO SUTO ,  Kouichi Matsuda ,  Masaki Fukuchi ,  Kenichiro Oi ,  Jingjing Guo

IPC分类号： G06T13/00

CPC分类号： G06T13/00

摘要： There is provided an image processing device including: a data storage unit having feature data stored therein, the feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space using an imaging device and the feature data stored in the data storage unit, the environment map representing a position of a physical object present in the real space; an information generating unit for generating animation data for displaying a status of communication via a communication interface on a screen, using the environment map built by the environment map building unit; and an image superimposing unit for generating an output image by superimposing an animation according to the animation data generated by the information generating unit on the input image.

摘要翻译： 提供了一种图像处理装置，包括：具有存储在其中的特征数据的数据存储单元，所述特征数据指示一个或多个物理对象的外观特征; 环境地图构建单元，用于基于通过使用成像装置对存在的真实空间进行成像获得的输入图像和存储在数据存储单元中的特征数据来构建环境地图，所述环境地图表示存在于实际中的物理对象的位置 空间; 信息生成单元，使用由环境地图建立单元构成的环境地图，生成用于通过屏幕上的通信接口显示通信状态的动画数据; 以及图像叠加单元，用于通过根据由信息生成单元生成的动画数据将动画叠加在输入图像上来生成输出图像。

公开(公告)号：US20110170742A1

公开(公告)日：2011-07-14

申请号：US12983424

申请日：2011-01-03

申请人： Masaki Fukuchi ,  Kouichi Matsuda ,  Yasuhiro Suto ,  Kenichiro Ol ,  Jingjing Guo

发明人： Masaki Fukuchi ,  Kouichi Matsuda ,  Yasuhiro Suto ,  Kenichiro Ol ,  Jingjing Guo

IPC分类号： G06K9/00

CPC分类号： G06F3/005 ,  G06K9/3241 ,  G08C2201/20 ,  H04N5/4403 ,  H04N21/4108 ,  H04N21/42204 ,  H04N21/42209 ,  H04N21/4222 ,  H04N21/42222 ,  H04N21/4223 ,  H04N21/43615 ,  H04N21/44008 ,  H04N2005/4408 ,  H04N2005/4428 ,  H04N2005/4435

摘要： There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.

摘要翻译： 提供了一种图像处理装置，包括：数据存储单元，其存储用于识别用户可操作的对象的对象标识数据和指示每个对象的外观特征的特征数据; 环境地图存储单元，其存储表示存在于实际空间中并且基于通过使用成像装置对实际空间进行成像而获得的输入图像生成的一个或多个对象的位置的环境地图，以及存储在数据存储单元中的特征数据 ; 以及选择单元，其基于所述对象识别数据选择被识别为可操作的对象，所述对象包括在存储在所述环境地图存储单元中的环境地图中的对象中，作为由用户可能的操作对象的候选对象 。

公开(公告)号：US20050267636A1

公开(公告)日：2005-12-01

申请号：US11137081

申请日：2005-05-25

申请人： Masaki Fukuchi ,  Takayuki Yoshigahara ,  Kohtaro Sabe ,  Takeshi Ohashi

发明人： Masaki Fukuchi ,  Takayuki Yoshigahara ,  Kohtaro Sabe ,  Takeshi Ohashi

IPC分类号： B25J5/00 ,  B25J9/16 ,  G06F19/00 ,  H04J3/00 ,  H04J3/02 ,  H04L12/43 ,  H04L29/06 ,  H04N7/08 ,  H04N7/081 ,  H04N7/173 ,  H04N7/18

CPC分类号： H04N21/4345 ,  H04L29/06027 ,  H04L65/602 ,  H04L65/604 ,  H04N21/2187 ,  H04N21/2362 ,  H04N21/2365 ,  H04N21/4347 ,  Y10S707/99945 ,  Y10S707/99948

摘要： An image transmission device and method, a transmitting device and method, a receiving device and method, and robot apparatus are capable of effectively transmitting the image data of multiple channels by using the existing systems which are formed on the premise of transmitting and receiving of the image data through single transmission line. At a transmitting side, the image data of multiple channels to be input is multiplexed with switching the channels by frame, and prescribed image information is added to each of the multiplexed image data of each frame. At a receiving side, the image information added to each of the image data for each frame respectively transmitted from the transmitting means are analyzed, and dividing means for dividing for each frame and outputting the multiplexed image data transmitted from the transmitting means to the corresponding channels is provided based on the analysis result.

公开(公告)号：US20050216123A1

公开(公告)日：2005-09-29

申请号：US11133011

申请日：2005-05-19

申请人： Masaki Fukuchi ,  Takayuki Yoshigahara ,  Kohtaro Sabe ,  Takeshi Ohashi

发明人： Masaki Fukuchi ,  Takayuki Yoshigahara ,  Kohtaro Sabe ,  Takeshi Ohashi

IPC分类号： B25J5/00 ,  B25J9/16 ,  G06F19/00 ,  H04J3/00 ,  H04J3/02 ,  H04L12/43 ,  H04L29/06 ,  H04N7/08 ,  H04N7/081 ,  H04N7/173 ,  H04N7/18

CPC分类号： H04N21/4345 ,  H04L29/06027 ,  H04L65/602 ,  H04L65/604 ,  H04N21/2187 ,  H04N21/2362 ,  H04N21/2365 ,  H04N21/4347 ,  Y10S707/99945 ,  Y10S707/99948

摘要： An image transmission device and methods a transmitting device and method, a receiving device and method, and robot apparatus are capable of effectively transmitting the image data of multiple channels by using the existing systems which are formed on the premise of transmitting and receiving of the image data through single transmission line. At a transmitting side, the image data of multiple channels to be input is multiplexed with switching the channels by frame, and prescribed image information is added to each of the multiplexed image data of each frame. At a receiving side, the image information added to each of the image data for each frame respectively transmitted from the transmitting means are analyzed, and dividing means for dividing for each frame and outputting the multiplexed image data transmitted from the transmitting means to the corresponding channels is provided based on the analysis result.

摘要翻译： 图像发送装置和方法，发送装置和方法，接收装置和方法以及机器人装置能够通过使用在发送和接收图像的前提下形成的现有系统来有效地发送多个信道的图像数据 数据通过单传输线。 在发送侧，将要输入的多个信道的图像数据通过逐帧切换而多路复用，并且将规定的图像信息添加到每帧的多路复用图像数据中。 在接收侧，对从发送装置分别发送的每帧的每个图像数据添加的图像信息进行分析，并且对每个帧进行分割，并将从发送装置发送的复用图像数据输出到相应的通道 是基于分析结果提供的。

公开(公告)号：US08994752B2

公开(公告)日：2015-03-31

申请号：US13015566

申请日：2011-01-27

申请人： Yasuhiro Suto ,  Kouichi Matsuda ,  Masaki Fukuchi ,  Kenichiro Oi ,  Jingjing Guo

发明人： Yasuhiro Suto ,  Kouichi Matsuda ,  Masaki Fukuchi ,  Kenichiro Oi ,  Jingjing Guo

IPC分类号： G09G5/00 ,  G06T13/00

CPC分类号： G06T13/00

摘要： There is provided an image processing device including: a data storage unit having feature data stored therein, the feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space using an imaging device and the feature data stored in the data storage unit, the environment map representing a position of a physical object present in the real space; an information generating unit for generating animation data for displaying a status of communication via a communication interface on a screen, using the environment map built by the environment map building unit; and an image superimposing unit for generating an output image by superimposing an animation according to the animation data generated by the information generating unit on the input image.

摘要翻译： 提供了一种图像处理装置，包括：具有存储在其中的特征数据的数据存储单元，所述特征数据指示一个或多个物理对象的外观特征; 环境地图构建单元，用于基于通过使用成像装置对存在的真实空间进行成像获得的输入图像和存储在数据存储单元中的特征数据来构建环境地图，所述环境地图表示存在于实际中的物理对象的位置 空间; 信息生成单元，使用由环境地图建立单元构成的环境地图，生成用于通过屏幕上的通信接口显示通信状态的动画数据; 以及图像叠加单元，用于通过根据由信息生成单元生成的动画数据将动画叠加在输入图像上来生成输出图像。