公开(公告)号：US20140306811A1

公开(公告)日：2014-10-16

申请号：US14313327

申请日：2014-06-24

Applicant: Electronics and Telecommunications Research Institute

Inventor： Mun Sung HAN ,  Young Giu Jung ,  Hyun Kim ,  Jae Hong Kim ,  Joo Chan Sohn

IPC: G08C23/00

CPC classification number: G08C23/00 ,  G06F3/017 ,  G06F3/038 ,  G06F2203/0381 ,  G10L15/22

Abstract: A system for integrating gestures and sounds including: a gesture recognition unit that extracts gesture feature information corresponding to user commands from image information and acquires gesture recognition information from the gesture feature information; a background recognition unit acquiring background sound information using a predetermined background sound model from sound information; a sound recognition unit that extracts sound feature information corresponding to user commands from the sound information and extracts the sound feature information based on the the background sound information and acquires sound recognition information from the sound feature information; and an integration unit that generates integration information by integrating the gesture recognition information and the sound recognition information.

Abstract translation: 一种用于整合手势和声音的系统，包括：手势识别单元，从图像信息中提取与用户命令对应的手势特征信息，并从手势特征信息获取手势识别信息; 背景识别单元，使用来自声音信息的预定背景声音模型获取背景声音信息; 声音识别单元，从声音信息中提取与用户命令相对应的声音特征信息，并且基于背景声音信息提取声音特征信息，并从声音特征信息获取声音识别信息; 以及整合单元，其通过对手势识别信息和声音识别信息进行积分来生成积分信息。