公开(公告)号：US20110214053A1

公开(公告)日：2011-09-01

申请号：US12714314

申请日：2010-02-26

Applicant: James Scott ,  Shahram Izadi ,  Nicolas Villar ,  Ravin Balakrishnan

Inventor： James Scott ,  Shahram Izadi ,  Nicolas Villar ,  Ravin Balakrishnan

IPC: G06F13/20 ,  G06F17/28 ,  G06F3/048

CPC classification number: G06F3/04895 ,  G06F3/021 ,  G06F17/273 ,  G06F17/276

Abstract: Assisting input from a keyboard is described. In an embodiment, a processor receives a plurality of key-presses from the keyboard comprising alphanumeric data for input to application software executed at the processor. The processor analyzes the plurality of key-presses to detect at least one predefined typing pattern, and, in response, controls a display device to display a representation of at least a portion of the keyboard in association with a user interface of the application software. In another embodiment, a computer device has a keyboard and at least one sensor arranged to monitor at least a subset of keys on the keyboard, and detect an object within a predefined distance of a selected key prior to activation of the selected key. The processor then controls the display device to display a representation of a portion of the keyboard comprising the selected key.

Abstract translation: 描述从键盘协助输入。 在一个实施例中，处理器从包括字母数字数据的键盘接收多个按键，以输入到在处理器处执行的应用软件。 处理器分析多个按键以检测至少一个预定义的打字模式，并且作为响应，控制显示设备与应用软件的用户界面相关联地显示键盘的至少一部分的表示。 在另一个实施例中，计算机设备具有键盘和布置成监视键盘上的至少一个键的子集的至少一个传感器，并且在激活所选择的键之前检测所选择的键的预定距离内的对象。 然后处理器控制显示设备以显示包括所选择的键的键盘的一部分的表示。

公开(公告)号：US07986318B2

公开(公告)日：2011-07-26

申请号：US11345452

申请日：2006-02-02

Applicant: Gordon Paul Kurtenbach ,  George William Fitzmaurice ,  Ravin Balakrishnan

Inventor： Gordon Paul Kurtenbach ,  George William Fitzmaurice ,  Ravin Balakrishnan

IPC: G06T15/00

CPC classification number: G06T17/00 ,  G02B27/2271 ,  G06F3/011 ,  G06F3/0346 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06T15/00

Abstract: The present invention is a system that manages a volumetric display using volume windows. The volume windows have the typical functions, such as minimize, resize, etc., which operate in a volume. When initiated by an application a volume window is assigned to the application in a volume window data structure. Application data produced by the application is assigned to the windows responsive to which applications are assigned to which windows in the volume window data structure. Input events are assigned to the windows responsive to whether they are spatial or non-spatial. Spatial events are assigned to the window surrounding the event or cursor where a policy resolves situations where more than one window surrounds the cursor. Non-spatial events are assigned to the active or working window.

Abstract translation: 本发明是使用体积窗口管理体积显示的系统。 卷窗口具有在卷中操作的典型功能，例如最小化，调整大小等。 当应用程序启动时，卷窗口将以卷窗口数据结构分配给应用程序。 应用程序产生的应用程序数据被分配给窗口，响应于哪些应用程序被分配到卷窗口数据结构中的哪个窗口。 响应于它们是空间还是非空间，将输入事件分配给窗口。 空间事件分配给事件或光标周围的窗口，其中策略可以解决多个窗口围绕光标的情况。 非空间事件分配给活动窗口或工作窗口。

公开(公告)号：US07724251B2

公开(公告)日：2010-05-25

申请号：US11207828

申请日：2005-08-22

Applicant: Ravin Balakrishnan ,  Gordon Paul Kurtenbach ,  George William Fitzmaurice

Inventor： Ravin Balakrishnan ,  Gordon Paul Kurtenbach ,  George William Fitzmaurice

IPC: G06T15/00

CPC classification number: G06T15/00 ,  G02B27/2271 ,  G06F3/011 ,  G06F3/0346 ,  G06F3/0362 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04845 ,  G09G3/003 ,  G09G2340/0492

Abstract: The present invention is a system that allows a user to physically rotate a three-dimensional volumetric display enclosure with a corresponding rotation of the display contents. The rotation of the enclosure is sampled with an encoder and the display is virtually rotated by a computer maintaining the scene by an amount corresponding to the physical rotation before being rendered. This allows the user to remain in one position while viewing different parts of the displayed scene corresponding to different viewpoints. The display contents can be rotated in direct correspondence with the display enclosure or with a gain (positive or negative) that accelerates the rotation of the contents with respect to the physical rotation of the enclosure. Any display widgets in the scene, such as a virtual keyboard, can be maintained stationary with respect to the user while scene contents rotate by applying a negative rotational gain to the widgets. The rotation can also be controlled by a time value such that the rotation continues until a specified time is reached or expires.

Abstract translation: 本发明是允许用户物理地旋转具有显示内容的相应旋转的三维体积显示外壳的系统。 外壳的旋转用编码器进行采样，并且显示器由维护场景的计算机虚拟地旋转与呈现之前的物理旋转相对应的量。 这允许用户在观看对应于不同视点的所显示场景的不同部分的同时保持在一个位置。 显示内容可以与显示器外壳直接对应地旋转，或者具有加速内容物相对于外壳的物理旋转的旋转的增益（正或负）旋转。 场景中的任何显示小部件（例如虚拟键盘）可以相对于用户保持静止，而场景内容通过向小部件施加负旋转增益而旋转。 旋转也可以通过时间值来控制，使得旋转继续直到达到指定的时间或到期。

公开(公告)号：US07583252B2

公开(公告)日：2009-09-01

申请号：US10830073

申请日：2004-04-23

Applicant: Gordon Paul Kurtenbach ,  George William Fitzmaurice ,  Ravin Balakrishnan

Inventor： Gordon Paul Kurtenbach ,  George William Fitzmaurice ,  Ravin Balakrishnan

IPC: G09G5/00

CPC classification number: G06F3/011 ,  G02B27/2271 ,  G06F1/1601 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04817 ,  H04N13/388

Abstract: The present invention is a system that allows a number of 3D volumetric display or output configurations, such as dome, cubical and cylindrical volumetric displays, to interact with a number of different input configurations, such as a three-dimensional position sensing system having a volume sensing field, a planar position sensing system having a digitizing tablet, and a non-planar position sensing system having a sensing grid formed on a dome. The user interacts via the input configurations, such as by moving a digitizing stylus on the sensing grid formed on the dome enclosure surface. This interaction affects the content of the volumetric display by mapping positions and corresponding vectors of the stylus to a moving cursor within the 3D display space of the volumetric display that is offset from a tip of the stylus along the vector.

Abstract translation: 本发明是允许多个3D体积显示或输出配置（诸如圆顶，立方和圆柱体积显示器）与许多不同输入配置相互作用的系统，例如具有体积的三维位置感测系统 感测场，具有数字化平板电脑的平面位置感测系统以及具有形成在圆顶上的感测格栅的非平面位置感测系统。 用户通过输入配置进行交互，例如通过在形成在圆顶壳体表面上的感测格栅上移动数字测针。 该交互通过将触针的位置和相应向量映射到体积显示器的3D显示空间内的移动光标，从而沿着向量偏离触笔的尖端来影响体积显示的内容。

公开(公告)号：US07486274B2

公开(公告)日：2009-02-03

申请号：US11207129

申请日：2005-08-18

Applicant: Clifton L. Forlines ,  Ravin Balakrishnan

Inventor： Clifton L. Forlines ,  Ravin Balakrishnan

IPC: G06F3/033

CPC classification number: G06F3/0386 ,  G06F3/0325 ,  G06F3/04842 ,  G06F2203/04806

Abstract: The invention provides a method to stabilize a pointer displayed within an output image. The method enables the user to magnify selected areas within the output image. This allows the user to ‘zoom’ in on areas of interest in the output image, and to make accurate selections with the stabilized pointer. Design features of the method enable pixel and sub-pixel accurate pointing, which is not possible with most conventional direct pointing devices. The invention can be worked for 2D and 3D pointers.

Abstract translation: 本发明提供一种稳定在输出图像内显示的指针的方法。 该方法使用户能够放大输出图像内的所选区域。 这允许用户对输出图像中的感兴趣区域进行“缩放”，并且使用稳定的指针进行准确的选择。 该方法的设计特征使像素和子像素精确指向，这对于大多数传统的直接指向设备是不可能的。 本发明可以用于2D和3D指针。

公开(公告)号：US20080284729A1

公开(公告)日：2008-11-20

申请号：US12219768

申请日：2008-07-28

Applicant: Gordon Paul Kurtenbach ,  George William Fitzmaurice ,  Ravin Balakrishnan

Inventor： Gordon Paul Kurtenbach ,  George William Fitzmaurice ,  Ravin Balakrishnan

IPC: G09G5/00

CPC classification number: G06F3/011 ,  G02B27/2271 ,  G06F1/1601 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04817 ,  H04N13/388

Abstract: The present invention is a system that allows a number of 3D volumetric display or output configurations, such as dome, cubical and cylindrical volumetric displays, to interact with a number of different input configurations, such as a three-dimensional position sensing system having a volume sensing field, a planar position sensing system having a digitizing tablet, and a non-planar position sensing system having a sensing grid formed on a dome. The user interacts via the input configurations, such as by moving a digitizing stylus on the sensing grid formed on the dome enclosure surface. This interaction affects the content of the volumetric display by mapping positions and corresponding vectors of the stylus to a moving cursor within the 3D display space of the volumetric display that is offset from a tip of the stylus along the vector.

Abstract translation: 本发明是允许多个3D体积显示或输出配置（诸如圆顶，立方和圆柱体积显示器）与许多不同输入配置相互作用的系统，例如具有体积的三维位置感测系统 感测场，具有数字化平板电脑的平面位置感测系统以及具有形成在圆顶上的感测格栅的非平面位置感测系统。 用户通过输入配置进行交互，例如通过在形成在圆顶壳体表面上的感测格栅上移动数字测针。 该交互通过将触针的位置和相应向量映射到体积显示器的3D显示空间内的移动光标，从而沿着向量偏离触笔的尖端来影响体积显示的内容。

公开(公告)号：US07289121B1

公开(公告)日：2007-10-30

申请号：US09539872

申请日：2000-03-31

Applicant: Ravin Balakrishnan ,  George William Fitzmaurice ,  Gordon Paul Kurtenbach ,  Karan Singh

Inventor： Ravin Balakrishnan ,  George William Fitzmaurice ,  Gordon Paul Kurtenbach ,  Karan Singh

IPC: G06T11/20

CPC classification number: G06T11/203

Abstract: A system that has a flexible tape input device with bend and twist sensors spaced along the tape and a curve generation system producing a virtual B-spline tape curve using the bend and twist information. A shape of the tape can be physically constrained to assist a user in obtaining and holding a desired shape. A world position sensor senses the real world position and orientation for the tape in world space and the virtual curve is placed in a scene responsive to the position and orientation. The curve at a desired location can be input into a virtual scene. The virtual curve can be used to create, control and edit 3D curves, surfaces and objects in real time. The tape can also act as a shape scanning device as well as a command input device.

Abstract translation: 一种具有柔性带输入装置的系统，其具有沿着带间隔开的弯曲和扭转传感器以及曲线生成系统，其使用弯曲和扭转信息产生虚拟B样条带曲线。 胶带的形状可以被物理地约束以帮助用户获得和保持期望的形状。 世界位置传感器感测世界空间中磁带的真实世界位置和方向，并且虚拟曲线被放置在响应于位置和方位的场景中。 可以将期望位置处的曲线输入到虚拟场景中。 虚拟曲线可用于实时创建，控制和编辑3D曲线，曲面和对象。 磁带还可以用作形状扫描装置以及命令输入装置。

公开(公告)号：US07205991B2

公开(公告)日：2007-04-17

申请号：US10183968

申请日：2002-06-28

Applicant: George William Fitzmaurice ,  Ravin Balakrishnan ,  Gordon Paul Kurtenbach

Inventor： George William Fitzmaurice ,  Ravin Balakrishnan ,  Gordon Paul Kurtenbach

IPC: G06T15/00

CPC classification number: G06F3/011 ,  G02B27/2271 ,  G06F1/1601 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04817

Abstract: The present invention is a widget display system for a volumetric or true three-dimensional (3D) display that provides a volumetric or omni-viewable widget that can be viewed and interacted with from any location around the volumetric display. The widget can be viewed from any location by duplicating the widget such that all locations around the display are within the viewing range of the widget. A widget can be provided with multiple viewing surfaces or faces making the widget omni-directional. A widget can be continuously rotated to face all of the possible locations of users over a period of time. User locations can be determined and the widget can be oriented to face the users when selected.

Abstract translation: 本发明是用于体积或真实三维（3D）显示器的小部件显示系统，其提供可以从体积显示器周围的任何位置观看和交互的体积或全能的部件。 可以通过复制小部件从任何位置观看小部件，使得显示器周围的所有位置都在小部件的观看范围内。 可以向窗口小部件提供多个视图表面或使面向全局的窗口。 可以连续旋转窗口小部件以在一段时间内面对用户的所有可能位置。 可以确定用户位置，并且可以将窗口小部件定向为在选择时面向用户。

公开(公告)号：US07102642B2

公开(公告)日：2006-09-05

申请号：US10637601

申请日：2003-08-11

Applicant: Ravin Balakrishnan ,  Willaim Arthur Stewart Buxton ,  George William Fitzmaurice ,  Gordon Paul Kurtenbach

Inventor： Ravin Balakrishnan ,  Willaim Arthur Stewart Buxton ,  George William Fitzmaurice ,  Gordon Paul Kurtenbach

IPC: G06T11/20

CPC classification number: G06F3/038 ,  G06F3/04883 ,  G06T11/203 ,  G06T19/20 ,  G06T2219/2021

Abstract: A system that provides a bimanual user interface in which an input device is provided for each of the users hands, a left hand (LH) device and a right hand (RH) device. The input devices are used in conjunction with a large format, upright, human scale display at which the user can stand and upon which the input devices are moved. The positions of the input devices on the display are marked by displayed cursors. The system detects the position of the input devices relative to the display and draws a vector corresponding to unfastened tape between positions of cursors of the corresponding input devices and pointing from the LH device to the RH device. By changing the state of the LH input device the unfastened tape can be fastened or pinned along the vector as the user moves the LH device toward the RH device. By changing the state of the RH device, the tape can be unfastened by moving the LH device away from the RH device. Straight lines are drawn by holding the RH fixed while the LH pins the tape. Curves are drawn by moving the RH device while the LH device pins the tape. The switch between straight and curved lines occurs without an explicit mode switch simply by keeping the RH device fixed or moving it. The radius of the curvature of curved lines corresponds to the separation between the LH and RH devices. The RH device can also be used to cut the tape and remove it from the display.

Abstract translation: 一种提供双手（LH）装置和右手（RH）装置）的双手用户界面的系统，其中为每个用户手，左手（LH）装置和右手（RH）装置提供输入装置。 输入设备与大尺寸，直立的人体尺寸显示器结合使用，用户可以在该尺寸显示器上移动输入设备。 显示器上的输入设备的位置由显示的光标标记。 该系统相对于显示器检测输入装置的位置，并且在相应输入装置的光标位置和从LH装置指向RH装置的位置之间绘制与未松开带对应的矢量。 通过改变LH输入设备的状态，当用户将LH设备朝向RH设备移动时，松开的胶带可以沿矢量被固定或固定。 通过改变RH装置的状态，可以通过将LH装置移离RH装置来松开带子。 当LH固定磁带时，通过保持RH固定来绘制直线。 在LH设备插入磁带的同时移动RH设备来绘制曲线。 直线和曲线之间的切换通过简单地通过保持RH装置固定或移动而没有明确的模式切换而发生。 曲线曲率的半径对应于LH和RH装置之间的间隔。 RH设备也可用于切割磁带并将其从显示屏上移除。

公开(公告)号：US06981229B1

公开(公告)日：2005-12-27

申请号：US09560869

申请日：2000-04-28

Applicant: Ravin Balakrishnan ,  Gordon Kurtenbach

Inventor： Ravin Balakrishnan ,  Gordon Kurtenbach

IPC: G06F3/038 ,  G06T15/70 ,  G09G5/00

CPC classification number: G06F3/038 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04845 ,  G06T13/00

Abstract: The present invention is directed to a two-handed input control system that dynamically changes an input-to-object mapping for mapping movement of a graphical object on a display of a virtual scene as the viewpoint of the virtual scene changes. As input to the system for changing the position of the graphical object occurs, the mapping is revised to reflect changes in the viewpoint so that the object moves as inherently expected. That is, changes to the viewpoint change the mapping so that a correspondence between the viewpoint and the input space is always maintained. During movement of the object a screen cursor is visually suppressed so that the movement of the graphical object and the screen cursor do not split the attention of the user. The screen cursor is always maintained within the visual display region of the virtual scene even when the object moves out of the visual display region by moving the cursor to a center of the screen when it reaches an edge of the screen.

Abstract translation: 本发明涉及一种双手输入控制系统，其在虚拟场景的视点改变时动态地改变用于映射虚拟场景的显示器上的图形对象的移动的输入对象映射。 当用于改变图形对象的位置的系统的输入发生时，修改映射以反映视点的变化，使得对象按照本质上的预期移动。 也就是说，对视点的改变改变了映射，使得始终保持视点和输入空间之间的对应关系。 在对象的运动期间，屏幕光标被视觉上被抑制，使得图形对象和屏幕光标的移动不会分开用户的注意。 即使当物体到达屏幕的边缘时，通过将光标移动到屏幕的中心，当对象移出视觉显示区域时，屏幕光标始终保持在虚拟场景的视觉显示区域内。