-
公开(公告)号:US08942419B1
公开(公告)日:2015-01-27
申请号:US13621067
申请日:2012-09-15
IPC分类号: G06K9/00
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing a camera that is attached to a head-mounted display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.
摘要翻译: 描述了用于确定眼睛位置和/或基于闪光来确定眼睛运动的方法和系统。 示例性的计算机实现的方法包括:(a)使附接到头戴式显示器(HMD)的照相机记录眼睛的视频; (b)在记录眼睛的视频的同时,使根据预定图案使附接到HMD并且大体上指向眼睛的多个光源接通和断开,其中预定模式使得在 在记录眼睛的视频的任何给定时间,至少两个光源被接通; (c)分析眼睛的视频以检测对应于多个光源的受控闪光; 和(d)基于受控的闪光来确定眼睛位置的度量。
-
公开(公告)号:US20150098620A1
公开(公告)日:2015-04-09
申请号:US14571402
申请日:2014-12-16
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing a camera that is attached to a head-mounted display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.
摘要翻译: 描述了用于确定眼睛位置和/或基于闪光来确定眼睛运动的方法和系统。 示例性的计算机实现的方法包括:(a)使附接到头戴式显示器(HMD)的照相机记录眼睛的视频; (b)在记录眼睛的视频的同时,使根据预定图案使附接到HMD并且大体上指向眼睛的多个光源接通和断开,其中预定模式使得在 在记录眼睛的视频的任何给定时间,至少两个光源被接通; (c)分析眼睛的视频以检测对应于多个光源的受控闪光; 和(d)基于受控的闪光来确定眼睛位置的度量。
-
3.
公开(公告)号:US08913789B1
公开(公告)日:2014-12-16
申请号:US13621083
申请日:2012-09-15
申请人: Thad Eugene Starner , Yong Zhao , Joshua Weaver , Hayes Solos Raffle , Edward Allen Keyes , Bo Wu
发明人: Thad Eugene Starner , Yong Zhao , Joshua Weaver , Hayes Solos Raffle , Edward Allen Keyes , Bo Wu
IPC分类号: G06K9/00
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing an imaging device that is attached to a head-mountable display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.
摘要翻译: 描述了用于确定眼睛位置和/或基于闪光来确定眼睛运动的方法和系统。 示例性的计算机实现的方法包括:(a)使附接到可头戴式显示器(HMD)的成像装置记录眼睛的视频; (b)在记录眼睛的视频的同时,使根据预定图案使附接到HMD并且大体上指向眼睛的多个光源接通和断开,其中预定模式使得在 在记录眼睛的视频的任何给定时间,至少两个光源被接通; (c)分析眼睛的视频以检测对应于多个光源的受控闪光; 和(d)基于受控的闪光来确定眼睛位置的度量。
-
公开(公告)号:US08878749B1
公开(公告)日:2014-11-04
申请号:US13620904
申请日:2012-09-15
申请人: Bo Wu , Yong Zhao , Thad Eugene Starner , Hayes Solos Raffle
发明人: Bo Wu , Yong Zhao , Thad Eugene Starner , Hayes Solos Raffle
IPC分类号: G09G5/00
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Systems and methods are described for improving gaze estimation based on glints. An example method may be executable to receive glint-location data indicating a location for each of one or more glints that are reflected from an eye. The glint-location data may be captured by an imaging device that is attached to a head-mountable display (HMD). The method may be further executable to determine a plurality of normalized pupil locations comprising at least a first and a second normalized pupil location. Each normalized pupil location may be determined based on the glint-location data for a different combinatoric subset of the one or more glints. The method may be further executable to determine a regression model to fit the plurality of normalized pupil locations to an expected gaze location, and perform a gaze-tracking process based on the regression model.
摘要翻译: 描述了用于改善基于闪烁的注视估计的系统和方法。 示例性方法可以被执行以接收指示从眼睛反射的一个或多个闪光中的每一个的位置的闪烁位置数据。 闪光位置数据可以由连接到可头戴式显示器(HMD)的成像装置捕获。 该方法可以进一步执行以确定包括至少第一和第二归一化瞳孔位置的多个归一化瞳孔位置。 可以基于一个或多个闪烁的不同组合子集的闪烁位置数据来确定每个归一化光瞳位置。 该方法可以进一步执行以确定回归模型以将多个归一化瞳孔位置拟合到预期凝视位置,并且基于回归模型执行凝视跟踪过程。
-
公开(公告)号:US09746915B1
公开(公告)日:2017-08-29
申请号:US13657492
申请日:2012-10-22
申请人: Hayes Solos Raffle , Thad Eugene Starner , Mat Balez , Michael Patrick Johnson , Yong Zhao , Bo Wu , David Sparks , Nirmal J. Patel
发明人: Hayes Solos Raffle , Thad Eugene Starner , Mat Balez , Michael Patrick Johnson , Yong Zhao , Bo Wu , David Sparks , Nirmal J. Patel
IPC分类号: G06F3/01
CPC分类号: G06F3/013 , G06F3/017 , G06F3/0346
摘要: Examples of methods and systems for providing calibration for eye gesture recognition are described. In some examples, calibration can be executed via a head-mountable device. A method for calibration of a system may account for changes in orientation of the head-mountable device, update recognition of the eye gestures, or increase efficiency of the system, for example. The head-mountable device may be configured to receive signals indicative of eye gestures from an eye gesture-detection system and in response to receiving a second command confirming that the signal is indicative of an eye gesture command, to make adjustments to the eye gesture recognition system and/or the reference signals. The head-mountable device may calibrate an eye gesture recognition system via implicit or explicit calibration, for example.
-
公开(公告)号:US09171198B1
公开(公告)日:2015-10-27
申请号:US13563238
申请日:2012-07-31
CPC分类号: H04N5/23219 , G02B27/01 , G02B27/017 , G02B2027/0178 , G02B2027/0187 , G06F3/012 , G06F3/017 , G06K9/00281 , G06K9/00604 , H04N5/232 , H04N5/23212 , H04N5/23293
摘要: This disclosure relates to winking to capture image data using an image capture device that is associated with a head-mountable device (HMD). An illustrative method includes detecting a wink gesture at an HMD. The method also includes causing an image capture device to capture image data, in response to detecting the wink gesture at the HMD.
摘要翻译: 本公开涉及使用与头戴式装置(HMD)相关联的图像捕获装置捕获图像数据的闪光。 说明性方法包括在HMD处检测眨眼手势。 该方法还包括使得图像捕获装置响应于检测到HMD处的眨眼手势来捕获图像数据。
-
公开(公告)号:US20130257709A1
公开(公告)日:2013-10-03
申请号:US13550791
申请日:2012-07-17
IPC分类号: G06F3/01
摘要: This disclosure relates to proximity sensing for wink detection. An illustrative method includes receiving data from a receiver portion of a proximity sensor. The receiver portion is disposed at a side section of a head-mountable device (HMD). When a wearer wears the HMD, the receiver portion is arranged to receive light reflected from an eye area of the wearer, the proximity sensor detects a movement of the eye area, and the data represents the movement. The method includes determining that the data corresponds to a wink gesture. The method also includes selecting a computing action to perform, based on the wink gesture. The method further includes performing the computing action.
摘要翻译: 本公开涉及用于眨眼检测的接近感测。 说明性方法包括从接近传感器的接收器部分接收数据。 接收器部分设置在可头戴式装置(HMD)的侧部。 当佩戴者穿戴HMD时,接收器部分被布置成接收从佩戴者的眼睛区域反射的光,接近传感器检测眼睛区域的移动,并且数据表示移动。 该方法包括确定数据对应于眨眼手势。 该方法还包括基于眨眼手势选择执行计算动作。 该方法还包括执行计算动作。
-
公开(公告)号:US09128522B2
公开(公告)日:2015-09-08
申请号:US13550791
申请日:2012-07-17
摘要: This disclosure relates to proximity sensing for wink detection. An illustrative method includes receiving data from a receiver portion of a proximity sensor. The receiver portion is disposed at a side section of a head-mountable device (HMD). When a wearer wears the HMD, the receiver portion is arranged to receive light reflected from an eye area of the wearer, the proximity sensor detects a movement of the eye area, and the data represents the movement. The method includes determining that the data corresponds to a wink gesture. The method also includes selecting a computing action to perform, based on the wink gesture. The method further includes performing the computing action.
摘要翻译: 本公开涉及用于眨眼检测的接近感测。 说明性方法包括从接近传感器的接收器部分接收数据。 接收器部分设置在可头戴式装置(HMD)的侧部。 当穿戴者穿戴HMD时,接收器部分被布置成接收从佩戴者的眼睛区域反射的光,接近传感器检测眼睛区域的移动,并且数据表示移动。 该方法包括确定数据对应于眨眼手势。 该方法还包括基于眨眼手势选择执行计算动作。 该方法还包括执行计算动作。
-
公开(公告)号:US09418617B1
公开(公告)日:2016-08-16
申请号:US13801772
申请日:2013-03-13
CPC分类号: G02B27/0093 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/013 , G06F3/0482 , G09G3/001
摘要: Examples methods and systems for distinguishing winks from other eye motions are described. In some examples, a method for distinguishing winks from other eye motions may account for changes in orientation of a computing device relative to a user, calibrate eye gesture recognition, or increase efficiency of the computing device. A computing device may be configured to receive sensor data corresponding to an eye and determine a distribution of magnitude changes in the sensor data over an interval of time. The computing device may identify clusters that correspond to ranges of magnitude changes within the distribution and use the clusters as reference data to identify ranges of sensor data for different types of eye motions, including differentiating winks from clusters indicative of ranges of normal eye activity and blinks.
摘要翻译: 描述用于区分眨眼与其他眼睛运动的示例方法和系统。 在一些示例中,用于区分眨眼与其他眼睛运动的方法可以解释计算设备相对于用户的取向的变化,校准眼睛手势识别或增加计算设备的效率。 计算设备可以被配置为接收对应于眼睛的传感器数据,并且在一段时间间隔内确定传感器数据中的幅度变化的分布。 计算设备可以识别与分布内的幅度变化范围相对应的群集,并且使用群集作为参考数据,以识别用于不同类型的眼睛运动的传感器数据的范围,包括区分来自指示正常眼睛活动范围和闪烁的群集的眨眼 。
-
-
-
-
-
-
-
-
-