-
1.
公开(公告)号:US08913789B1
公开(公告)日:2014-12-16
申请号:US13621083
申请日:2012-09-15
申请人: Thad Eugene Starner , Yong Zhao , Joshua Weaver , Hayes Solos Raffle , Edward Allen Keyes , Bo Wu
发明人: Thad Eugene Starner , Yong Zhao , Joshua Weaver , Hayes Solos Raffle , Edward Allen Keyes , Bo Wu
IPC分类号: G06K9/00
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing an imaging device that is attached to a head-mountable display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.
摘要翻译: 描述了用于确定眼睛位置和/或基于闪光来确定眼睛运动的方法和系统。 示例性的计算机实现的方法包括:(a)使附接到可头戴式显示器(HMD)的成像装置记录眼睛的视频; (b)在记录眼睛的视频的同时,使根据预定图案使附接到HMD并且大体上指向眼睛的多个光源接通和断开,其中预定模式使得在 在记录眼睛的视频的任何给定时间,至少两个光源被接通; (c)分析眼睛的视频以检测对应于多个光源的受控闪光; 和(d)基于受控的闪光来确定眼睛位置的度量。
-
公开(公告)号:US08942419B1
公开(公告)日:2015-01-27
申请号:US13621067
申请日:2012-09-15
IPC分类号: G06K9/00
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing a camera that is attached to a head-mounted display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.
摘要翻译: 描述了用于确定眼睛位置和/或基于闪光来确定眼睛运动的方法和系统。 示例性的计算机实现的方法包括:(a)使附接到头戴式显示器(HMD)的照相机记录眼睛的视频; (b)在记录眼睛的视频的同时,使根据预定图案使附接到HMD并且大体上指向眼睛的多个光源接通和断开,其中预定模式使得在 在记录眼睛的视频的任何给定时间,至少两个光源被接通; (c)分析眼睛的视频以检测对应于多个光源的受控闪光; 和(d)基于受控的闪光来确定眼睛位置的度量。
-
公开(公告)号:US20150098620A1
公开(公告)日:2015-04-09
申请号:US14571402
申请日:2014-12-16
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing a camera that is attached to a head-mounted display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.
摘要翻译: 描述了用于确定眼睛位置和/或基于闪光来确定眼睛运动的方法和系统。 示例性的计算机实现的方法包括:(a)使附接到头戴式显示器(HMD)的照相机记录眼睛的视频; (b)在记录眼睛的视频的同时,使根据预定图案使附接到HMD并且大体上指向眼睛的多个光源接通和断开,其中预定模式使得在 在记录眼睛的视频的任何给定时间,至少两个光源被接通; (c)分析眼睛的视频以检测对应于多个光源的受控闪光; 和(d)基于受控的闪光来确定眼睛位置的度量。
-
公开(公告)号:US08878749B1
公开(公告)日:2014-11-04
申请号:US13620904
申请日:2012-09-15
申请人: Bo Wu , Yong Zhao , Thad Eugene Starner , Hayes Solos Raffle
发明人: Bo Wu , Yong Zhao , Thad Eugene Starner , Hayes Solos Raffle
IPC分类号: G09G5/00
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Systems and methods are described for improving gaze estimation based on glints. An example method may be executable to receive glint-location data indicating a location for each of one or more glints that are reflected from an eye. The glint-location data may be captured by an imaging device that is attached to a head-mountable display (HMD). The method may be further executable to determine a plurality of normalized pupil locations comprising at least a first and a second normalized pupil location. Each normalized pupil location may be determined based on the glint-location data for a different combinatoric subset of the one or more glints. The method may be further executable to determine a regression model to fit the plurality of normalized pupil locations to an expected gaze location, and perform a gaze-tracking process based on the regression model.
摘要翻译: 描述了用于改善基于闪烁的注视估计的系统和方法。 示例性方法可以被执行以接收指示从眼睛反射的一个或多个闪光中的每一个的位置的闪烁位置数据。 闪光位置数据可以由连接到可头戴式显示器(HMD)的成像装置捕获。 该方法可以进一步执行以确定包括至少第一和第二归一化瞳孔位置的多个归一化瞳孔位置。 可以基于一个或多个闪烁的不同组合子集的闪烁位置数据来确定每个归一化光瞳位置。 该方法可以进一步执行以确定回归模型以将多个归一化瞳孔位置拟合到预期凝视位置,并且基于回归模型执行凝视跟踪过程。
-
公开(公告)号:US09746915B1
公开(公告)日:2017-08-29
申请号:US13657492
申请日:2012-10-22
申请人: Hayes Solos Raffle , Thad Eugene Starner , Mat Balez , Michael Patrick Johnson , Yong Zhao , Bo Wu , David Sparks , Nirmal J. Patel
发明人: Hayes Solos Raffle , Thad Eugene Starner , Mat Balez , Michael Patrick Johnson , Yong Zhao , Bo Wu , David Sparks , Nirmal J. Patel
IPC分类号: G06F3/01
CPC分类号: G06F3/013 , G06F3/017 , G06F3/0346
摘要: Examples of methods and systems for providing calibration for eye gesture recognition are described. In some examples, calibration can be executed via a head-mountable device. A method for calibration of a system may account for changes in orientation of the head-mountable device, update recognition of the eye gestures, or increase efficiency of the system, for example. The head-mountable device may be configured to receive signals indicative of eye gestures from an eye gesture-detection system and in response to receiving a second command confirming that the signal is indicative of an eye gesture command, to make adjustments to the eye gesture recognition system and/or the reference signals. The head-mountable device may calibrate an eye gesture recognition system via implicit or explicit calibration, for example.
-
公开(公告)号:US20130176533A1
公开(公告)日:2013-07-11
申请号:US13631594
申请日:2012-09-28
IPC分类号: A61B3/113
CPC分类号: A61B3/113 , A61F2009/00846 , G01B11/167 , G01B11/25 , G01B11/2513 , G06F3/013 , G06K9/00604 , G06K9/2036
摘要: Exemplary methods and systems help provide for tracking an eye. An exemplary method may involve: causing the projection of a pattern onto an eye, wherein the pattern comprises at least one line, and receiving data regarding deformation of the at least one line of the pattern. The method further includes correlating the data to iris, sclera, and pupil orientation to determine a position of the eye, and causing an item on a display to move in correlation with the eye position.
摘要翻译: 示例性的方法和系统有助于跟踪眼睛。 示例性方法可以包括:将图案投影到眼睛上,其中图案包括至少一条线,并且接收关于图案的至少一条线的变形的数据。 该方法还包括将数据与虹膜,巩膜和瞳孔取向相关联以确定眼睛的位置,并使得显示器上的物体与眼睛位置相关地移动。
-
公开(公告)号:US09354445B1
公开(公告)日:2016-05-31
申请号:US13601900
申请日:2012-08-31
CPC分类号: G02B27/0093 , G02B27/01 , G02B27/017 , G02B2027/0178 , G02B2027/0187 , G06F3/013 , A61B3/113
摘要: Example methods and systems determine a position of a portion of a human eye based on electromagnetic radiation reflected from the surface of the human eye. A sensor associated with a computing device can be calibrated in response to an event. The computing device can receive data indicative of electromagnetic radiation reflected from a human eye. The computing device can determine a position of a portion of the human eye based on the received data indicative of electromagnetic radiation. The computing device can generate an indication including the position of the portion of the human eye. The computing device can transmit the indication from the computing device. In some embodiments, the data indicative of electromagnetic information can be provided by electromagnetic emitter/sensors mounted on a wearable computing device directed toward a human eye of a wearer of the wearable computing device.
摘要翻译: 示例性方法和系统基于从人眼表面反射的电磁辐射来确定人眼的一部分的位置。 可以响应于事件来校准与计算设备相关联的传感器。 计算设备可以接收指示从人眼反射的电磁辐射的数据。 计算设备可以基于指示电磁辐射的接收数据来确定人眼的一部分的位置。 计算装置可以产生包括人眼部分的位置的指示。 计算设备可以从计算设备发送指示。 在一些实施例中,指示电磁信息的数据可以由安装在可佩戴的计算装置上的电磁发射器/传感器来提供,该装置指向穿戴式计算装置的佩戴者的人眼。
-
公开(公告)号:US09052804B1
公开(公告)日:2015-06-09
申请号:US13417508
申请日:2012-03-12
IPC分类号: G09G5/00 , G06F3/0484 , G06F3/01 , G06F3/00 , G06F1/16
CPC分类号: G06F17/3079 , G02B27/0172 , G02B2027/0178 , G06F1/163 , G06F3/005 , G06F3/011 , G06F3/017 , G06F3/0304 , G06F3/04842 , G06F3/0488 , G06F17/3084 , G06T19/006
摘要: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device, where the video data comprises at least a first frame and a second frame. The method further includes, based on the video data, detecting an area in the first frame that is at least partially bounded by a pointing device and, based on the video data, detecting in the second frame that the area is at least partially occluded by the pointing device. The method still further includes initiating a search on the area.
摘要翻译: 公开了用于发起对象的搜索的方法和装置。 在一个实施例中,公开了一种方法,其包括在可穿戴计算设备上接收由相机记录的视频数据,其中所述视频数据至少包括第一帧和第二帧。 该方法还包括:基于视频数据,检测至少部分地由指示设备界限的第一帧中的区域,并且基于视频数据,在第二帧中检测该区域至少部分地被 指点设备。 该方法还包括在该区域上启动搜索。
-
公开(公告)号:US09197864B1
公开(公告)日:2015-11-24
申请号:US13617608
申请日:2012-09-14
申请人: Thad Eugene Starner , Joshua Weaver
发明人: Thad Eugene Starner , Joshua Weaver
CPC分类号: G06T7/0042 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06F3/013 , G06F17/30256 , G06F17/30268 , G06Q30/02 , H04N5/2253 , H04N5/23222 , H04N5/23293 , H04N5/23296 , H04N5/2628 , H04N7/181
摘要: Methods and systems for intelligently zooming to and capturing a first image of a feature of interest are provided. The feature of interest may be determined based on a first interest criteria. The captured image may be provided to a user, who may indicate a level of interest in the feature of interest. The level of interest may be based upon to store the captured image and capture another image. The level of interest may be a gradient value, or a binary value. The level of interest may be based upon to determine whether to store the captured image, and if so, a resolution at which the captured image is to be stored. The level of interest may also be based upon to determine whether to zoom to and capture a second image of a second feature of interest based on the first interest criteria or a second interest criteria.
摘要翻译: 提供了用于智能缩放并捕获感兴趣特征的第一图像的方法和系统。 感兴趣的特征可以基于第一兴趣标准来确定。 捕获的图像可以被提供给用户,谁可以指示感兴趣的特征中的兴趣级别。 感兴趣的级别可以基于存储捕获的图像并捕获另一图像。 感兴趣的级别可以是梯度值或二进制值。 感兴趣的级别可以基于确定是否存储捕获的图像,并且如果是,则存储捕获的图像的分辨率。 感兴趣的级别还可以基于确定是否基于第一兴趣标准或第二兴趣标准来放大并捕获感兴趣的第二特征的第二图像。
-
公开(公告)号:US09277334B1
公开(公告)日:2016-03-01
申请号:US13425821
申请日:2012-03-21
申请人: Adrian Wong , Thad Eugene Starner , Joshua Weaver
发明人: Adrian Wong , Thad Eugene Starner , Joshua Weaver
CPC分类号: G06F21/32 , H04R1/1041 , H04R25/606 , H04R29/001 , H04R2460/13 , H04R2499/11
摘要: A wearable computing device is authenticated using bone conduction. When a user wears the device, a bone conduction speaker and a bone conduction microphone on the device contact the user's head at positions proximate the user's skull. A calibration process is performed by transmitting a signal from the speaker through the skull and receiving a calibration signal at the microphone. An authentication process is subsequently performed by transmitting another signal from the speaker through the skull and an authentication signal is received at the microphone. In the event that frequency response characteristics of the authentication signal match the frequency response characteristics of the calibration signal, the user is authenticated and the device is enabled for user interaction without requiring the user to input any additional data.
摘要翻译: 使用骨传导认证穿戴式计算设备。 当用户佩戴该装置时,该装置上的骨传导扬声器和骨传导麦克风在用户头骨附近的位置接触用户的头部。 通过从扬声器通过头骨传送信号并在麦克风处接收校准信号来执行校准过程。 随后通过从扬声器通过颅骨发送另一个信号并在麦克风接收认证信号来执行认证处理。 在认证信号的频率响应特性与校准信号的频率响应特性匹配的情况下,用户被认证,并且该设备被启用用于用户交互,而不需要用户输入任何附加数据。
-
-
-
-
-
-
-
-
-