公开(公告)号：US07487461B2

公开(公告)日：2009-02-03

申请号：US11121637

申请日：2005-05-04

申请人： Shumin Zhai ,  Per-Ola Kristensson

发明人： Shumin Zhai ,  Per-Ola Kristensson

IPC分类号： G06F3/048 ,  G06F3/033 ,  G06F3/041 ,  G06F3/02 ,  A63F9/24 ,  G06K9/00

CPC分类号： G06F3/04883

摘要： A command pattern recognition system based on a virtual keyboard layout combines pattern recognition with a virtual, graphical, or on-screen keyboard to provide a command control method with relative ease of use. The system allows the user conveniently issue commands on pen-based computing or communication devices. The system supports a very large set of commands, including practically all commands needed for any application. By utilizing shortcut definitions it can work with any existing software without any modification. In addition, the system utilizes various techniques to achieve reliable recognition of a very large gesture vocabulary. Further, the system provides feedback and display methods to help the user effectively use and learn command gestures for commands.

摘要翻译： 基于虚拟键盘布局的命令模式识别系统将模式识别与虚拟，图形或屏幕上的键盘相结合，以提供相对容易使用的命令控制方法。 该系统允许用户方便地在基于笔的计算或通信设备上发出命令。 系统支持非常大的命令集，包括几乎所有应用程序所需的所有命令。 通过使用快捷方式定义，它可以与任何现有的软件一起使用，无需任何修改。 此外，该系统利用各种技术来实现非常大的姿态词汇的可靠识别。 此外，系统提供反馈和显示方法，以帮助用户有效地使用和学习命令的命令手势。

公开(公告)号：US20050114115A1

公开(公告)日：2005-05-26

申请号：US10723469

申请日：2003-11-26

申请人： John Karidis ,  Per Kristensson ,  Shumin Zhai

发明人： John Karidis ,  Per Kristensson ,  Shumin Zhai

IPC分类号： G06F3/048 ,  G06F17/21 ,  G06F17/27

CPC分类号： G06F17/273 ,  G06F3/04886

摘要： A system and method relaxing typing accuracy in stylus or other keyboards comprises recording a coordinate of a keystroke landing point, wherein the keystroke emanates from tapping a key on a keyboard, counting the number of tapped landing points, creating a set of words from a lexicon having the same amount of the tapped landing points, for each letter in each word in the set, computing the distance from the pattern formed by the landing coordinate to the pattern formed by the letters in words in a database, and selecting a word from the set having the shortest total distance, wherein the distance is a mean distance of all the tapped landing points for each word, or wherein the distance is an elastic matching distance between the tapped landing points and the coordinate.

摘要翻译： 一种放松手写笔或其他键盘的打字精度的系统和方法包括记录按键着陆点的坐标，其中按键从点击键盘上的键发出，计算敲击着陆点的数量，从词典创建一组单词 对于集合中的每个单词中的每个字母具有相同量的点击着陆点，计算从由着陆坐标形成的图案到由数据库中的单词中的字母形成的图案的距离，并且从 设置具有最短总距离，其中该距离是每个单词的所有点击着陆点的平均距离，或者其中该距离是分接的着陆点与坐标之间的弹性匹配距离。

公开(公告)号：US20050047629A1

公开(公告)日：2005-03-03

申请号：US10648120

申请日：2003-08-25

申请人： Stephen Farrell ,  Shumin Zhai

发明人： Stephen Farrell ,  Shumin Zhai

IPC分类号： G06F3/01 ,  G06F3/048 ,  G06K9/00

CPC分类号： G06F3/013 ,  G06F3/0481 ,  G06F2203/04806

摘要： A computer-driven system amplifies a target region based on integrating eye gaze and manual operator input, thus reducing pointing time and operator fatigue. A gaze tracking apparatus monitors operator eye orientation while the operator views a video screen. Concurrently, the computer monitors an input indicator for mechanical activation or activity by the operator. According to the operator's eye orientation, the computer calculates the operator's gaze position. Also computed is a gaze area, comprising a sub-region of the video screen that includes the gaze position. The system determines a region of the screen to expand within the current gaze area when mechanical activation of the operator input device is detected. The graphical components contained are expanded, while components immediately outside of this radius may be contracted and/or translated, in order to preserve visibility of all the graphical components at all times.

摘要翻译： 计算机驱动系统基于整合眼睛凝视和手动操作员输入放大目标区域，从而减少指示时间和操作者疲劳。 注视跟踪装置在操作员观看视频屏幕时监视操作者的眼睛方向。 同时，计算机监视输入指示器以进行机械激活或操作者的活动。 根据操作员的眼睛方向，计算机计算操作员的注视位置。 还计算出注视区域，其包括包括注视位置的视频屏幕的子区域。 当检测到操作者输入装置的机械启动时，系统确定屏幕的区域在目前的注视区域内扩展。 所包含的图形组件被扩展，而立即在该半径之外的组件可能被收缩和/或翻译，以便始终保持所有图形组件的可见性。

公开(公告)号：US06393136B1

公开(公告)日：2002-05-21

申请号：US09225476

申请日：1999-01-04

申请人： Arnon Amir ,  Myron Dale Flickner ,  David Bruce Koons ,  Carlos Hitoshi Morimoto ,  Shumin Zhai

发明人： Arnon Amir ,  Myron Dale Flickner ,  David Bruce Koons ,  Carlos Hitoshi Morimoto ,  Shumin Zhai

IPC分类号： G06K900

CPC分类号： G06F3/011 ,  G06T7/70

摘要： A method and apparatus determine when a subject is looking at a specific target area by estimating a divergence angle between (1) the direction in which the subject is looking and (2) the direction from the subject directly to the target area. This technique accesses whether the subject is looking at a particular area. The invention may further condition this determination according to the subject's distance from the target area, because there is less tolerance for divergent angles when the subject is farther away. In one embodiment, the divergence angle is estimated using the position of a glint of light in the subject's pupil. The glint is created by a light source located in the target area. If the glint is sufficiently central to the pupil, with the camera and light source being near the target area, the subject is looking at the target area. At long distances, when the glint is not sufficiently discernable from the pupil, another technique may be employed to estimate divergence angle. Namely, the plane of the subject's face is computed, and analyzed with respect to a vector between the subject's face and the target area. If the plane is substantially normal to the vector, the subject is looking at the target area.

摘要翻译： 一种方法和装置通过估计（1）被摄体正在观察的方向和（2）从被摄体直接到目标区域的方向之间的发散角度来确定被摄体何时观察特定目标区域。 该技术访问主体是否正在查看特定区域。 本发明还可以根据被摄体距离目标区域的距离来进一步调节该确定，因为当被摄体越远时，对于发散角具有较小的公差。 在一个实施例中，使用受试者瞳孔内的闪光的位置来估计发散角。 闪光由位于目标区域的光源创建。 如果闪光对于瞳孔是足够中心的，相机和光源靠近目标区域，则被摄物体正在观察目标区域。 在长距离处，当闪烁不能从瞳孔中辨别出来时，可以采用另一种技术来估计发散角。 即，计算被检者的脸的平面，并且相对于被检者的面部和目标区域之间的矢量进行分析。 如果平面与矢量基本正交，则对象正在观察目标区域。

公开(公告)号：US06317128B1

公开(公告)日：2001-11-13

申请号：US08978524

申请日：1997-11-25

申请人： Beverly L. Harrison ,  William A. S. Buxton ,  Shumin Zhai

发明人： Beverly L. Harrison ,  William A. S. Buxton ,  Shumin Zhai

IPC分类号： G06T300

CPC分类号： G06F3/0481 ,  G06F2203/04804 ,  G06T15/503 ,  G09G5/026 ,  G09G5/14

摘要： A system and method for providing a graphical user interface (GUI) with anti-interference outlines for enhanced user attention and fluency of work. The GUI utilizes transparency to merge images (or layers) of objects onto a graphical display. For example, variably-transparent (transparent/semi-transparent) or “see through” objects, such as menus, tool palettes, windows, dialogue boxes, or screens are superimposed over similar objects or different background content, such as text, wire-frame or line art images, and solid images. Anti-interference outlines are utilized to heighten the visibility and hence legibility of objects by mitigating visual interference, which is typically the result of overlaying similar colors or luminance values such that one layer “blends” into another. The GUI calculates a luminance level of a particular object and then surrounds the object with a luminance-contrasting border or anti-interference outline, thus enhancing visual distinctiveness of the particular object while maintaining all the advantages of transparency.

摘要翻译： 一种用于提供具有抗干扰轮廓的图形用户界面（GUI）的系统和方法，用于增强用户注意力和工作流畅性。 GUI利用透明度将对象的图像（或层）合并到图形显示器上。 例如，可变透明（透明/半透明）或“透视”对象（如菜单，工具调色板，窗口，对话框或屏幕）叠加在类似对象或不同背景内容（例如文本， 框架或线条艺术图像，以及实体图像。 通过减轻视觉干扰，通常可以通过覆盖类似的颜色或亮度值使得一层“混合”到另一层中，从而提高抗干扰轮廓来提高对象的可视性和易读性。 GUI计算特定对象的亮度水平，然后利用亮度对比边界或抗干扰轮廓围绕对象，从而增强特定对象的视觉特征，同时保持透明度的所有优点。

公开(公告)号：US06204828B1

公开(公告)日：2001-03-20

申请号：US09052321

申请日：1998-03-31

申请人： Arnon Amir ,  Myron Dale Flickner ,  Steven Carlyle Ihde ,  Shumin Zhai

发明人： Arnon Amir ,  Myron Dale Flickner ,  Steven Carlyle Ihde ,  Shumin Zhai

IPC分类号： G09G500

CPC分类号： G06F3/013 ,  G06F3/038 ,  G06F2203/0381

摘要： A computer-driven system aids operator positioning of a cursor by integrating eye gaze and manual operator input, thus reducing pointing time and operator fatigue. A gaze tracking apparatus monitors operator eye orientation while the operator views a video screen. Concurrently, the computer monitors an input device, such as a mouse, for mechanical activation by the operator. According to the operator's eye orientation, the computer calculates the operator's gaze position. Also computed is a gaze area, comprising a sub-region of the video screen that includes the gaze position. This region, for example, may be a circle of sufficient radius to include the point of actual gaze with a certain likelihood. When the computer detects mechanical activation of the operator input device, it determines an initial cursor display position within the current gaze area. This position may be a predetermined location with respect to the gaze area, such as a point on the bottom of the gaze area periphery. A different approach uses the initial mechanical activation of the input device to determine the direction of motion, and sets the initial display position on the opposite side of the gaze area from this motion so that continued movement of the input device brings the cursor to the gaze position in a seamless transition between gaze and manual input. After displaying the cursor on the video screen at the initial display position, the cursor is thereafter positioned manually according to the operator's use of the input device, without regard to gaze.

摘要翻译： 计算机驱动系统通过集成眼睛注视和手动操作员输入来帮助操作者定位光标，从而减少指示时间和操作者的疲劳。 注视跟踪装置在操作员观看视频屏幕时监视操作者的眼睛方向。 同时，计算机监视诸如鼠标的输入设备，以供操作者机械启动。 根据操作员的眼睛方向，计算机计算操作员的注视位置。 还计算出注视区域，其包括包括注视位置的视频屏幕的子区域。 例如，该区域可以是足够半径的圆以具有某种可能性的实际注视点。 当计算机检测到操作者输入装置的机械启动时，它确定当前凝视区域内的初始光标显示位置。 该位置可以是相对于注视区域的预定位置，例如注视区域外围底部的点。 不同的方法使用输入装置的初始机械激活来确定运动方向，并将初始显示位置设置在距离该运动的目视区域的相对侧，使得输入装置的继续移动将光标移动到目视 在凝视和手动输入之间的无缝转换中的位置。 在初始显示位置在视频屏幕上显示光标后，随后根据操作者对输入设备的使用手动定位光标，而不考虑注视。