公开(公告)号：US20140340388A1

公开(公告)日：2014-11-20

申请号：US13653848

申请日：2012-10-17

Applicant: Steve Tsang ,  Karan Singh ,  Abhishek Ranjan ,  Ravin Balakrishnan

Inventor： Steve Tsang ,  Karan Singh ,  Abhishek Ranjan ,  Ravin Balakrishnan

IPC: G06T15/00

CPC classification number: G06T11/203 ,  G06F3/04845 ,  G06T19/20 ,  G06T2219/2021

Abstract: A method, computer system and computer program is provided for using a suggestive modeling interface. The method consists of a method of a computer-implemented rendering of sketches, the method comprising the steps of: (1) a user activating a sketching application: (2) in response, the sketching application displaying on a screen a suggestive modeling interface; (3) the sketching application importing a sketch to the suggestive modeling interface; and (4) the sketching application retrieving from a database one or more suggestions based on the sketch. The method is operable to allow a user interactively using the sketching application to create a drawing that is guided by the imported sketch by selectively using one or more image guided drawing tools provided by the sketching application. The present invention is well-suited for three-dimensional modeling applications.

Abstract translation: 提供了一种使用建议建模界面的方法，计算机系统和计算机程序。 该方法包括计算机实现的草图绘制方法，该方法包括以下步骤：（1）用户激活素描应用程序：（2）作为响应，素描应用程序在屏幕上显示暗示建模界面; （3）草图应用程序将草图导入建议性建模界面; 和（4）草图应用程序从数据库检索基于草图的一个或多个建议。 该方法可操作以允许用户交互地使用草绘应用来通过选择性地使用由草图应用提供的一个或多个图像引导绘图工具来创建由导入的草图引导的图形。 本发明非常适用于三维建模应用。

公开(公告)号：US20100020026A1

公开(公告)日：2010-01-28

申请号：US12344377

申请日：2008-12-26

Applicant: Hrvoje Benko ,  Andrew D. Wilson ,  Billy Chen ,  Ravin Balakrishnan ,  Patrick M. Baudisch

Inventor： Hrvoje Benko ,  Andrew D. Wilson ,  Billy Chen ,  Ravin Balakrishnan ,  Patrick M. Baudisch

IPC: G06F3/041 ,  G06F3/033

CPC classification number: G06F3/0486 ,  G06F3/041 ,  G06F3/042 ,  G06F3/0488 ,  G06F3/04883 ,  G06F2203/04808

Abstract: Touch interaction with a curved display (e.g., a sphere, a hemisphere, a cylinder, etc.) is enabled through various user interface (UI) features. In an example embodiment, a curved display is monitored to detect a touch input. If a touch input is detected based on the act of monitoring, then one or more locations of the touch input are determined. Responsive to the determined one or more locations of the touch input, at least one user UI feature is implemented. Example UI features include an orb-like invocation gesture feature, a rotation-based dragging feature, a send-to-dark-side interaction feature, and an object representation and manipulation by proxy representation feature.

Abstract translation: 通过各种用户界面（UI）功能来实现与弯曲显示器（例如，球体，半球，圆柱体等）的触摸交互。 在示例实施例中，监视弯曲显示器以检测触摸输入。 如果基于监视动作检测到触摸输入，则确定触摸输入的一个或多个位置。 响应于所确定的触摸输入的一个或多个位置，实现了至少一个用户UI特征。 示例UI功能包括一个像球形的调用手势功能，一个基于旋转的拖动功能，一个发送到黑暗的交互功能，以及一个对象表示和代理表示功能的操纵。

公开(公告)号：US20090327171A1

公开(公告)日：2009-12-31

申请号：US12146471

申请日：2008-06-26

Applicant: Desney Tan ,  Dan Morris ,  Scott Saponas ,  Ravin Balakrishnan

Inventor： Desney Tan ,  Dan Morris ,  Scott Saponas ,  Ravin Balakrishnan

IPC: G06F15/18

CPC classification number: G06N99/005 ,  G06F3/015 ,  G06F3/017

Abstract: A machine learning model is trained by instructing a user to perform proscribed gestures, sampling signals from EMG sensors arranged arbitrarily on the user's forearm with respect to locations of muscles in the forearm, extracting feature samples from the sampled signals, labeling the feature samples according to the corresponding gestures instructed to be performed, and training the machine learning model with the labeled feature samples. Subsequently, gestures may be recognized using the trained machine learning model by sampling signals from the EMG sensors, extracting from the signals unlabeled feature samples of a same type as those extracted during the training, passing the unlabeled feature samples to the machine learning model, and outputting from the machine learning model indicia of a gesture classified by the machine learning model.

Abstract translation: 通过指示用户执行禁止的手势，从前臂中的肌肉位置任意布置的EMG传感器的采样信号，从采样信号中提取特征样本，按照根据 指示执行相应的手势，并用标记的特征样本训练机器学习模型。 随后，可以使用经过训练的机器学习模型，通过对来自EMG传感器的信号进行采样，从信号提取与训练期间提取的相似类型的未标记的特征样本，将未标记的特征样本传递到机器学习模型， 从机器学习模型标记输出由机器学习模型分类的手势。

公开(公告)号：US07589732B2

公开(公告)日：2009-09-15

申请号：US10287816

申请日：2002-11-05

Applicant: Nicolas Burtnyk ,  Azam Khan ,  George William Fitzmaurice ,  Ravin Balakrishnan ,  Gordon Paul Kurtenbach

Inventor： Nicolas Burtnyk ,  Azam Khan ,  George William Fitzmaurice ,  Ravin Balakrishnan ,  Gordon Paul Kurtenbach

IPC: G06T15/00

CPC classification number: G06T19/00 ,  G06F3/04815 ,  G06T13/00 ,  G06T15/20

Abstract: The system displays an image portraying a virtual space as viewed by a virtual camera at a first location on a spatially navigable camera surface within the virtual space. A user begins a drag operation. Based on the dragging, the virtual camera is spatially translated from the first location on the spatially navigable region to a second location on the spatially navigable region. The orientation of the virtual camera at the second location may be automatically set to either point towards the pre-defined look-at point or to point in a direction normal to the spatially navigable region at the second location. The system then displays an image portraying the virtual space in accordance with the location and orientation of the virtual camera at the second location in the spatially navigable camera surface. While the drag operation continues, the system determines that further translating the virtual camera would place the virtual camera beyond the spatially navigable region. In response, the system begins displaying a transition, which may be an interpolated animation of the virtual camera, an animation semi-transparently blended with a slate, a pre-authored animation of the virtual camera, or other visual effect. While further continuing to drag, and based on the same, the system either advances display of the transition, reverses display of the transition, or otherwise temporally controls the display of the transition.

Abstract translation: 该系统显示在虚拟空间内的空间可导航的相机表面上的第一位置处的虚拟照相机所观察到的描绘虚拟空间的图像。 用户开始拖动操作。 基于拖动，虚拟相机在空间上可导航区域上的第一位置被空间转换到空间可导航区域上的第二位置。 可以将第二位置处的虚拟相机的方向自动设置为指向预定义的观看点或指向与第二位置处的空间可导航区域垂直的方向。 然后，系统根据虚拟相机在空间可导航相机表面的第二位置处的位置和方位来显示描绘虚拟空间的图像。 当拖动操作继续时，系统确定进一步翻译虚拟相机将使虚拟相机超出空间可通航区域。 作为响应，系统开始显示转换，其可以是虚拟相机的内插动画，与平板半透明混合的动画，虚拟相机的预创作动画或其他视觉效果。 在进一步继续拖动的同时，该系统可以提前显示转换，反转转换的显示，或以其他方式临时控制转换的显示。

公开(公告)号：US20080040689A1

公开(公告)日：2008-02-14

申请号：US11907514

申请日：2007-10-12

Applicant: Ravin Balakrishnan ,  Gordon Kurtenbach ,  George Fitzmaurice

Inventor： Ravin Balakrishnan ,  Gordon Kurtenbach ,  George Fitzmaurice

IPC: G09G5/00

CPC classification number: G09G5/08 ,  G02B27/2271 ,  G06F1/1601 ,  G06F3/011 ,  G06F3/033 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04817 ,  H04N13/388

Abstract: The present invention is a system that creates a volumetric display and a user controllable volumetric pointer within the volumetric display. The user can point by aiming a beam which is vector, planar or tangent based, positioning a device in three-dimensions in association with the display, touching a digitizing surface of the display enclosure or otherwise inputting position coordinates. The cursor can take a number of different forms including a ray, a point, a volume and a plane. The ray can include a ring, a bead, a segmented wand, a cone and a cylinder. The user designates an input position and the system maps the input position to a 3D cursor position within the volumetric display. The system also determines whether any object has been designated by the cursor by determining whether the object is within a region of influence of the cursor. The system also performs any function activated in association with the designation.

Abstract translation: 本发明是在体积显示内创建体积显示和用户可控的体积指示器的系统。 用户可以通过瞄准基于矢量，平面或切线的光束来指向与显示器相关联的三维定位设备，触摸显示器外壳的数字化表面或以其他方式输入位置坐标。 光标可以采取许多不同的形式，包括射线，点，体积和平面。 射线可以包括环，珠，分段魔杖，锥体和圆柱体。 用户指定输入位置，并且系统将输入位置映射到体积显示内的3D光标位置。 系统还通过确定对象是否在光标的影响区域内来确定是否已经由光标指定了任何对象。 该系统还执行与指定相关联的激活的任何功能。

公开(公告)号：US07324085B2

公开(公告)日：2008-01-29

申请号：US10183944

申请日：2002-06-28

Applicant: Ravin Balakrishnan ,  Gordon Paul Kurtenbach ,  George William Fitzmaurice

Inventor： Ravin Balakrishnan ,  Gordon Paul Kurtenbach ,  George William Fitzmaurice

IPC: G06F3/033 ,  G09G5/08

CPC classification number: G09G5/08 ,  G02B27/2271 ,  G06F1/1601 ,  G06F3/011 ,  G06F3/033 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04817 ,  H04N13/388

Abstract: The present invention is a system that creates a volumetric display and a user controllable volumetric pointer within the volumetric display. The user can point by aiming a beam which is vector, planar or tangent based, positioning a device in three-dimensions in association with the display, touching a digitizing surface of the display enclosure or otherwise inputting position coordinates. The cursor can take a number of different forms including a ray, a point, a volume and a plane. The ray can include a ring, a bead, a segmented wand, a cone and a cylinder. The user designates an input position and the system maps the input position to a 3D cursor position within the volumetric display. The system also determines whether any object has been designated by the cursor by determining whether the object is within a region of influence of the cursor. The system also performs any function activated in association with the designation.

公开(公告)号：US20050275628A1

公开(公告)日：2005-12-15

申请号：US11207828

申请日：2005-08-22

Applicant: Ravin Balakrishnan ,  Gordon Kurtenbach ,  George Fitzmaurice

Inventor： Ravin Balakrishnan ,  Gordon Kurtenbach ,  George Fitzmaurice

IPC: G02B27/22 ,  G06F3/00 ,  G06F3/01 ,  G06F3/033 ,  G06F3/041 ,  G06F3/048 ,  G09G5/00

CPC classification number: G06T15/00 ,  G02B27/2271 ,  G06F3/011 ,  G06F3/0346 ,  G06F3/0362 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04845 ,  G09G3/003 ,  G09G2340/0492

Abstract: The present invention is a system that allows a user to physically rotate a three-dimensional volumetric display enclosure with a corresponding rotation of the display contents. The rotation of the enclosure is sampled with an encoder and the display is virtually rotated by a computer maintaining the scene by an amount corresponding to the physical rotation before being rendered. This allows the user to remain in one position while viewing different parts of the displayed scene corresponding to different viewpoints. The display contents can be rotated in direct correspondence with the display enclosure or with a gain (positive or negative) that accelerates the rotation of the contents with respect to the physical rotation of the enclosure. Any display widgets in the scene, such as a virtual keyboard, can be maintained stationary with respect to the user while scene contents rotate by applying a negative rotational gain to the widgets. The rotation can also be controlled by a time value such that the rotation continues until a specified time is reached or expires.

Abstract translation: 本发明是允许用户物理地旋转具有显示内容的相应旋转的三维体积显示外壳的系统。 外壳的旋转用编码器进行采样，并且显示器由维护场景的计算机虚拟地旋转与呈现之前的物理旋转相对应的量。 这允许用户在观看对应于不同视点的所显示场景的不同部分的同时保持在一个位置。 显示内容可以与显示器外壳直接对应地旋转，或者具有加速内容物相对于外壳的物理旋转的旋转的增益（正或负）旋转。 场景中的任何显示小部件（例如虚拟键盘）可以相对于用户保持静止，而场景内容通过向小部件施加负旋转增益而旋转。 旋转也可以通过时间值来控制，使得旋转继续直到达到指定的时间或到期。

公开(公告)号：US09665278B2

公开(公告)日：2017-05-30

申请号：US12714314

申请日：2010-02-26

Applicant: James Scott ,  Shahram Izadi ,  Nicolas Villar ,  Ravin Balakrishnan

Inventor： James Scott ,  Shahram Izadi ,  Nicolas Villar ,  Ravin Balakrishnan

IPC: G06F3/0489 ,  G06F3/02 ,  G06F17/27

CPC classification number: G06F3/04895 ,  G06F3/021 ,  G06F17/273 ,  G06F17/276

Abstract: Assisting input from a keyboard is described. In an embodiment, a processor receives a plurality of key-presses from the keyboard comprising alphanumeric data for input to application software executed at the processor. The processor analyzes the plurality of key-presses to detect at least one predefined typing pattern, and, in response, controls a display device to display a representation of at least a portion of the keyboard in association with a user interface of the application software. In another embodiment, a computer device has a keyboard and at least one sensor arranged to monitor at least a subset of keys on the keyboard, and detect an object within a predefined distance of a selected key prior to activation of the selected key. The processor then controls the display device to display a representation of a portion of the keyboard comprising the selected key.

公开(公告)号：US08402382B2

公开(公告)日：2013-03-19

申请号：US12293198

申请日：2007-04-18

Applicant: Anand Agarawala ,  Ravin Balakrishnan

Inventor： Anand Agarawala ,  Ravin Balakrishnan

IPC: G06F3/048 ,  G06F3/033

CPC classification number: G06F3/04815 ,  G06F3/0483

Abstract: A method, system and computer program for organizing and visualizing display objects within a virtual environment is provided. In one aspect, attributes of display objects define the interaction between display objects according to pre-determined rules, including rules simulating real world mechanics, thereby enabling enriched user interaction. The present invention further provides for the use of piles as an organizational entity for desktop objects. The present invention further provides for fluid interaction techniques for committing actions on display objects in a virtual interface. A number of other interaction and visualization techniques are disclosed.

Abstract translation: 提供了一种用于在虚拟环境内组织和可视化显示对象的方法，系统和计算机程序。 在一个方面，显示对象的属性根据预先确定的规则定义显示对象之间的交互，包括模拟真实世界力学的规则，从而实现丰富的用户交互。 本发明还提供了使用桩作为桌面对象的组织实体。 本发明还提供了用于在虚拟接口中对显示对象进行动作的流体交互技术。 公开了许多其他交互和可视化技术。

公开(公告)号：US07839400B2

公开(公告)日：2010-11-23

申请号：US10183966

申请日：2002-06-28

Applicant: Gordon Paul Kurtenbach ,  George William Fitzmaurice ,  Ravin Balakrishnan

Inventor： Gordon Paul Kurtenbach ,  George William Fitzmaurice ,  Ravin Balakrishnan

IPC: G06T17/00

CPC classification number: G06T17/00 ,  G02B27/2271 ,  G06F3/011 ,  G06F3/0346 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06T15/00

Abstract: The present invention is a system that manages a volumetric display using volume windows. The volume windows have the typical functions, such as minimize, resize, etc., which operate in a volume. When initiated by an application a volume window is assigned to the application in a volume window data structure. Application data produced by the application is assigned to the windows responsive to which applications are assigned to which windows in the volume window data structure. Input events are assigned to the windows responsive to whether they are spatial or non-spatial. Spatial events are assigned to the window surrounding the event or cursor where a policy resolves situations where more than one window surrounds the cursor. Non-spatial events are assigned to the active or working window.

Abstract translation: 本发明是使用体积窗口管理体积显示的系统。 卷窗口具有在卷中操作的典型功能，例如最小化，调整大小等。 当应用程序启动时，卷窗口将以卷窗口数据结构分配给应用程序。 应用程序产生的应用程序数据被分配给窗口，响应于哪些应用程序被分配到卷窗口数据结构中的哪个窗口。 响应于它们是空间还是非空间，将输入事件分配给窗口。 空间事件分配给事件或光标周围的窗口，其中策略可以解决多个窗口围绕光标的情况。 非空间事件分配给活动窗口或工作窗口。