公开(公告)号：US09773179B2

公开(公告)日：2017-09-26

申请号：US15006763

申请日：2016-01-26

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC ,  Carnegie Mellon University

Inventor： Francisco Vicente ,  Zehua Huang ,  Xuehan Xiong ,  Fernando De La Torre ,  Wende Zhang ,  Dan Levi ,  Debbie E. Nachtegall

IPC: G08B23/00 ,  G06K9/00 ,  B60Q9/00 ,  G06T7/73

CPC classification number: G06K9/00845 ,  B60Q9/00 ,  G06K9/00268 ,  G06K9/0061 ,  G06T7/75 ,  G06T2207/30201 ,  G06T2207/30268

Abstract: A method for monitoring a vehicle operator can be executed by a controller and includes the following steps: (a) receiving image data of a vehicle operator's head; (b) tracking facial feature points of the vehicle operator based on the image data; (c) creating a 3D model of the vehicle operator's head based on the facial feature points in order to determine a 3D position of the vehicle operator's head; (d) determining a gaze direction of the vehicle operator based on a position of the facial feature points and the 3D model of the vehicle operator's head; (e) determining a gaze vector based on the gaze direction and the 3D position of the vehicle operator's head; and (f) commanding an indicator to activate when the gaze vector is outside a predetermined parameter.

公开(公告)号：US09405982B2

公开(公告)日：2016-08-02

申请号：US14041016

申请日：2013-09-30

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC ,  CARNEGIE MELLON UNIVERSITY

Inventor： Wende Zhang ,  Dan Levi ,  Debbie E. Nachtegall ,  Fernando De La Torre ,  Dong Huang

IPC: G06K9/00

CPC classification number: G06K9/00845 ,  G06K9/00597 ,  G06K9/0061

Abstract: A method for detecting an eyes-off-the-road condition based on an estimated gaze direction of a driver of a vehicle includes monitoring facial feature points of the driver within image input data captured by an in-vehicle camera device. A location for each of a plurality of eye features for an eyeball of the driver is detected based on the monitored facial features. A head pose of the driver is estimated based on the monitored facial feature points. The gaze direction of the driver is estimated based on the detected location for each of the plurality of eye features and the estimated head pose.

Abstract translation: 基于车辆的驾驶员的估计的注视方向来检测目标偏离路况的方法包括监视由车载摄像机装置拍摄的图像输入数据内的驾驶员的面部特征点。 基于所监视的面部特征来检测针对驾驶员的眼球的多个眼睛特征中的每一个的位置。 基于被监测的面部特征点估计驾驶员头部姿势。 基于检测到的多个眼睛特征中的每一个的位置和估计的头部姿势来估计驾驶员的视线方向。