-
公开(公告)号:US09052804B1
公开(公告)日:2015-06-09
申请号:US13417508
申请日:2012-03-12
IPC分类号: G09G5/00 , G06F3/0484 , G06F3/01 , G06F3/00 , G06F1/16
CPC分类号: G06F17/3079 , G02B27/0172 , G02B2027/0178 , G06F1/163 , G06F3/005 , G06F3/011 , G06F3/017 , G06F3/0304 , G06F3/04842 , G06F3/0488 , G06F17/3084 , G06T19/006
摘要: Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device, where the video data comprises at least a first frame and a second frame. The method further includes, based on the video data, detecting an area in the first frame that is at least partially bounded by a pointing device and, based on the video data, detecting in the second frame that the area is at least partially occluded by the pointing device. The method still further includes initiating a search on the area.
摘要翻译: 公开了用于发起对象的搜索的方法和装置。 在一个实施例中,公开了一种方法,其包括在可穿戴计算设备上接收由相机记录的视频数据,其中所述视频数据至少包括第一帧和第二帧。 该方法还包括:基于视频数据,检测至少部分地由指示设备界限的第一帧中的区域,并且基于视频数据,在第二帧中检测该区域至少部分地被 指点设备。 该方法还包括在该区域上启动搜索。
-
公开(公告)号:US20130176533A1
公开(公告)日:2013-07-11
申请号:US13631594
申请日:2012-09-28
IPC分类号: A61B3/113
CPC分类号: A61B3/113 , A61F2009/00846 , G01B11/167 , G01B11/25 , G01B11/2513 , G06F3/013 , G06K9/00604 , G06K9/2036
摘要: Exemplary methods and systems help provide for tracking an eye. An exemplary method may involve: causing the projection of a pattern onto an eye, wherein the pattern comprises at least one line, and receiving data regarding deformation of the at least one line of the pattern. The method further includes correlating the data to iris, sclera, and pupil orientation to determine a position of the eye, and causing an item on a display to move in correlation with the eye position.
摘要翻译: 示例性的方法和系统有助于跟踪眼睛。 示例性方法可以包括:将图案投影到眼睛上,其中图案包括至少一条线,并且接收关于图案的至少一条线的变形的数据。 该方法还包括将数据与虹膜,巩膜和瞳孔取向相关联以确定眼睛的位置,并使得显示器上的物体与眼睛位置相关地移动。
-
公开(公告)号:US08942419B1
公开(公告)日:2015-01-27
申请号:US13621067
申请日:2012-09-15
IPC分类号: G06K9/00
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing a camera that is attached to a head-mounted display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.
摘要翻译: 描述了用于确定眼睛位置和/或基于闪光来确定眼睛运动的方法和系统。 示例性的计算机实现的方法包括:(a)使附接到头戴式显示器(HMD)的照相机记录眼睛的视频; (b)在记录眼睛的视频的同时,使根据预定图案使附接到HMD并且大体上指向眼睛的多个光源接通和断开,其中预定模式使得在 在记录眼睛的视频的任何给定时间,至少两个光源被接通; (c)分析眼睛的视频以检测对应于多个光源的受控闪光; 和(d)基于受控的闪光来确定眼睛位置的度量。
-
公开(公告)号:US08878749B1
公开(公告)日:2014-11-04
申请号:US13620904
申请日:2012-09-15
申请人: Bo Wu , Yong Zhao , Thad Eugene Starner , Hayes Solos Raffle
发明人: Bo Wu , Yong Zhao , Thad Eugene Starner , Hayes Solos Raffle
IPC分类号: G09G5/00
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Systems and methods are described for improving gaze estimation based on glints. An example method may be executable to receive glint-location data indicating a location for each of one or more glints that are reflected from an eye. The glint-location data may be captured by an imaging device that is attached to a head-mountable display (HMD). The method may be further executable to determine a plurality of normalized pupil locations comprising at least a first and a second normalized pupil location. Each normalized pupil location may be determined based on the glint-location data for a different combinatoric subset of the one or more glints. The method may be further executable to determine a regression model to fit the plurality of normalized pupil locations to an expected gaze location, and perform a gaze-tracking process based on the regression model.
摘要翻译: 描述了用于改善基于闪烁的注视估计的系统和方法。 示例性方法可以被执行以接收指示从眼睛反射的一个或多个闪光中的每一个的位置的闪烁位置数据。 闪光位置数据可以由连接到可头戴式显示器(HMD)的成像装置捕获。 该方法可以进一步执行以确定包括至少第一和第二归一化瞳孔位置的多个归一化瞳孔位置。 可以基于一个或多个闪烁的不同组合子集的闪烁位置数据来确定每个归一化光瞳位置。 该方法可以进一步执行以确定回归模型以将多个归一化瞳孔位置拟合到预期凝视位置,并且基于回归模型执行凝视跟踪过程。
-
公开(公告)号:US20150098620A1
公开(公告)日:2015-04-09
申请号:US14571402
申请日:2014-12-16
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing a camera that is attached to a head-mounted display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.
摘要翻译: 描述了用于确定眼睛位置和/或基于闪光来确定眼睛运动的方法和系统。 示例性的计算机实现的方法包括:(a)使附接到头戴式显示器(HMD)的照相机记录眼睛的视频; (b)在记录眼睛的视频的同时,使根据预定图案使附接到HMD并且大体上指向眼睛的多个光源接通和断开,其中预定模式使得在 在记录眼睛的视频的任何给定时间,至少两个光源被接通; (c)分析眼睛的视频以检测对应于多个光源的受控闪光; 和(d)基于受控的闪光来确定眼睛位置的度量。
-
公开(公告)号:US09746915B1
公开(公告)日:2017-08-29
申请号:US13657492
申请日:2012-10-22
申请人: Hayes Solos Raffle , Thad Eugene Starner , Mat Balez , Michael Patrick Johnson , Yong Zhao , Bo Wu , David Sparks , Nirmal J. Patel
发明人: Hayes Solos Raffle , Thad Eugene Starner , Mat Balez , Michael Patrick Johnson , Yong Zhao , Bo Wu , David Sparks , Nirmal J. Patel
IPC分类号: G06F3/01
CPC分类号: G06F3/013 , G06F3/017 , G06F3/0346
摘要: Examples of methods and systems for providing calibration for eye gesture recognition are described. In some examples, calibration can be executed via a head-mountable device. A method for calibration of a system may account for changes in orientation of the head-mountable device, update recognition of the eye gestures, or increase efficiency of the system, for example. The head-mountable device may be configured to receive signals indicative of eye gestures from an eye gesture-detection system and in response to receiving a second command confirming that the signal is indicative of an eye gesture command, to make adjustments to the eye gesture recognition system and/or the reference signals. The head-mountable device may calibrate an eye gesture recognition system via implicit or explicit calibration, for example.
-
7.
公开(公告)号:US08913789B1
公开(公告)日:2014-12-16
申请号:US13621083
申请日:2012-09-15
申请人: Thad Eugene Starner , Yong Zhao , Joshua Weaver , Hayes Solos Raffle , Edward Allen Keyes , Bo Wu
发明人: Thad Eugene Starner , Yong Zhao , Joshua Weaver , Hayes Solos Raffle , Edward Allen Keyes , Bo Wu
IPC分类号: G06K9/00
CPC分类号: G06T7/0044 , A61B3/00 , A61B3/113 , G01S17/06 , G02B27/01 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G03B29/00 , G03B2213/025 , G06F3/013 , G06K9/00604 , G06K9/0061 , G06T7/74 , G06T2207/10016 , G06T2207/10152 , G06T2207/30201 , G09G3/003 , G09G5/00 , G09G2354/00 , H04N5/225
摘要: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing an imaging device that is attached to a head-mountable display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.
摘要翻译: 描述了用于确定眼睛位置和/或基于闪光来确定眼睛运动的方法和系统。 示例性的计算机实现的方法包括:(a)使附接到可头戴式显示器(HMD)的成像装置记录眼睛的视频; (b)在记录眼睛的视频的同时,使根据预定图案使附接到HMD并且大体上指向眼睛的多个光源接通和断开,其中预定模式使得在 在记录眼睛的视频的任何给定时间,至少两个光源被接通; (c)分析眼睛的视频以检测对应于多个光源的受控闪光; 和(d)基于受控的闪光来确定眼睛位置的度量。
-
公开(公告)号:US08970452B2
公开(公告)日:2015-03-03
申请号:US13287390
申请日:2011-11-02
CPC分类号: G06F3/012 , G02B27/0093 , G02B27/0101 , G02B27/017 , G02B27/0172 , G02B27/0176 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/013 , G06F3/0346 , G06F3/04817 , G06F3/0482 , G06T19/006
摘要: A wearable computing device or a head-mounted display (HMD) may be configured to track the gaze axis of an eye of the wearer. In particular, the device may be configured to observe movement of a wearer's pupil and, based on the movement, determine inputs to a user interface. For example, using eye gaze detection, the HMD may change a tracking rate of a displayed virtual image based on where the user is looking. Gazing at the center of the HMD field of view may, for instance, allow for fine movements of the virtual display. Gazing near an edge of the HMD field of view may provide coarser movements.
摘要翻译: 可戴式计算装置或头戴式显示器(HMD)可以被配置为跟踪佩戴者眼睛的视线轴线。 特别地,该装置可以被配置为观察佩戴者的瞳孔的移动,并且基于移动来确定对用户界面的输入。 例如,使用眼睛注视检测,HMD可以基于用户正在看的位置来改变所显示的虚拟图像的跟踪率。 例如,注视HMD视野的中心可以允许虚拟显示器的精细移动。 在HMD视野边缘附近凝视可能会提供较粗糙的动作。
-
公开(公告)号:US08643951B1
公开(公告)日:2014-02-04
申请号:US13421709
申请日:2012-03-15
申请人: Aaron Joseph Wheeler , Alejandro Kauffmann , Liang-Yu (Tom) Chi , Hayes Solos Raffle , Luis Ricardo Prada Gomez
发明人: Aaron Joseph Wheeler , Alejandro Kauffmann , Liang-Yu (Tom) Chi , Hayes Solos Raffle , Luis Ricardo Prada Gomez
IPC分类号: G02B27/14
CPC分类号: G02B27/017 , G02B2027/014 , G02B2027/0187 , G06F3/012 , G06F3/017 , G06F3/0481
摘要: Methods and systems involving a navigable area in a head-mounted display (HMD) are disclosed herein. An exemplary system may be configured to: (a) cause a head-mounted display (HMD) to provide: (i) a viewing window that is fully visible in a field of view of the HMD, (ii) a navigable area that is not fully visible in a field of view of the HMD such that the viewing window displays a first portion of the navigable area, and (iii) a media object that is associated with a viewing-window state; (b) receive first head-movement data that is indicative of head movement from a first position of the HMD to a second position of the HMD; and (c) based on (i) the first head-movement data and (ii) the viewing-window state, cause the viewing window to display a second portion of the navigable area which includes the media object.
摘要翻译: 本文公开了涉及头戴式显示器(HMD)中的导航区域的方法和系统。 示例性系统可以被配置为:(a)使头戴式显示器(HMD)提供:(i)在HMD的视野中完全可见的观察窗口,(ii)可导航区域, 在HMD的视野中不完全可见,使得观看窗口显示可导航区域的第一部分,以及(iii)与观看窗口状态相关联的媒体对象; (b)接收指示头部从HMD的第一位置移动到HMD的第二位置的第一头部移动数据; 和(c)基于(i)第一头部移动数据和(ii)观看窗口状态,使得观看窗口显示包括媒体对象的可导航区域的第二部分。
-
公开(公告)号:US08611015B2
公开(公告)日:2013-12-17
申请号:US13302916
申请日:2011-11-22
CPC分类号: G02B27/0172 , A61B3/113 , G01S17/66 , G02B27/0093 , G02B27/017 , G02B2027/0187 , G06F3/012 , G06F3/013 , G06F3/04847 , G06F3/0485 , G06K9/00604
摘要: A head-mounted display (HMD) may include an eye-tracking system, an HMD-tracking system and a display configured to display virtual images. The virtual images may present an augmented reality to a wearer of the HMD and the virtual images may adjust dynamically based on HMD-tracking data. However, position and orientation sensor errors may introduce drift into the displayed virtual images. By incorporating eye-tracking data, the drift of virtual images may be reduced. In one embodiment, the eye-tracking data could be used to determine a gaze axis and a target object in the displayed virtual images. The HMD may then move the target object towards a central axis. The HMD may also record data based on the gaze axis, central axis and target object to determine a user interface preference. The user interface preference could be used to adjust similar interactions with the HMD.
摘要翻译: 头戴显示器(HMD)可以包括眼睛跟踪系统,HMD跟踪系统和被配置为显示虚拟图像的显示器。 虚拟图像可以向HMD的佩戴者呈现增强的现实,并且虚拟图像可以基于HMD跟踪数据动态地调整。 然而,位置和方向传感器错误可能会在显示的虚拟图像中引入漂移。 通过结合眼睛跟踪数据,可以减少虚拟图像的漂移。 在一个实施例中,眼睛跟踪数据可以用于确定所显示的虚拟图像中的注视轴和目标对象。 然后,HMD可以将目标物体朝向中心轴线移动。 HMD还可以基于注视轴,中心轴和目标对象记录数据,以确定用户界面偏好。 用户界面首选项可用于调整与HMD的类似交互。
-
-
-
-
-
-
-
-
-