公开(公告)号：US09218116B2

公开(公告)日：2015-12-22

申请号：US12344377

申请日：2008-12-26

Applicant: Hrvoje Benko ,  Andrew D. Wilson ,  Billy Chen ,  Ravin Balakrishnan ,  Patrick M. Baudisch

Inventor： Hrvoje Benko ,  Andrew D. Wilson ,  Billy Chen ,  Ravin Balakrishnan ,  Patrick M. Baudisch

IPC: G06F3/048 ,  G06F3/0486 ,  G06F3/041 ,  G06F3/042 ,  G06F3/0488

CPC classification number: G06F3/0486 ,  G06F3/041 ,  G06F3/042 ,  G06F3/0488 ,  G06F3/04883 ,  G06F2203/04808

Abstract: Touch interaction with a curved display (e.g., a sphere, a hemisphere, a cylinder, etc.) is enabled through various user interface (UI) features. In an example embodiment, a curved display is monitored to detect a touch input. If a touch input is detected based on the act of monitoring, then one or more locations of the touch input are determined. Responsive to the determined one or more locations of the touch input, at least one user UI feature is implemented. Example UI features include an orb-like invocation gesture feature, a rotation-based dragging feature, a send-to-dark-side interaction feature, and an object representation and manipulation by proxy representation feature.

Abstract translation: 通过各种用户界面（UI）功能来实现与弯曲显示器（例如，球体，半球，圆柱体等）的触摸交互。 在示例实施例中，监视弯曲显示器以检测触摸输入。 如果基于监视动作检测到触摸输入，则确定触摸输入的一个或多个位置。 响应于所确定的触摸输入的一个或多个位置，实现了至少一个用户UI特征。 示例UI功能包括一个像球形的调用手势功能，一个基于旋转的拖动功能，一个发送到黑暗的交互功能，以及一个对象表示和代理表示功能的操纵。

公开(公告)号：US09195301B2

公开(公告)日：2015-11-24

申请号：US12219768

申请日：2008-07-28

Applicant: Gordon Paul Kurtenbach ,  George Fitzmaurice ,  Ravin Balakrishnan

Inventor： Gordon Paul Kurtenbach ,  George Fitzmaurice ,  Ravin Balakrishnan

IPC: G09G5/00 ,  G06F3/01 ,  G02B27/22 ,  G06F1/16 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/041 ,  G06F3/0481 ,  H04N13/04

CPC classification number: G06F3/011 ,  G02B27/2271 ,  G06F1/1601 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04817 ,  H04N13/388

Abstract: The present invention is a system that allows a number of 3D volumetric display or output configurations, such as dome, cubical and cylindrical volumetric displays, to interact with a number of different input configurations, such as a three-dimensional position sensing system having a volume sensing field, a planar position sensing system having a digitizing tablet, and a non-planar position sensing system having a sensing grid formed on a dome. The user interacts via the input configurations, such as by moving a digitizing stylus on the sensing grid formed on the dome enclosure surface. This interaction affects the content of the volumetric display by mapping positions and corresponding vectors of the stylus to a moving cursor within the 3D display space of the volumetric display that is offset from a tip of the stylus along the vector.

公开(公告)号：US08447704B2

公开(公告)日：2013-05-21

申请号：US12146471

申请日：2008-06-26

Applicant: Desney Tan ,  Dan Morris ,  Scott Saponas ,  Ravin Balakrishnan

Inventor： Desney Tan ,  Dan Morris ,  Scott Saponas ,  Ravin Balakrishnan

IPC: G06F15/18

CPC classification number: G06N99/005 ,  G06F3/015 ,  G06F3/017

Abstract: A machine learning model is trained by instructing a user to perform proscribed gestures, sampling signals from EMG sensors arranged arbitrarily on the user's forearm with respect to locations of muscles in the forearm, extracting feature samples from the sampled signals, labeling the feature samples according to the corresponding gestures instructed to be performed, and training the machine learning model with the labeled feature samples. Subsequently, gestures may be recognized using the trained machine learning model by sampling signals from the EMG sensors, extracting from the signals unlabeled feature samples of a same type as those extracted during the training, passing the unlabeled feature samples to the machine learning model, and outputting from the machine learning model indicia of a gesture classified by the machine learning model.

Abstract translation: 通过指示用户执行禁止的手势，从前臂中的肌肉位置任意布置的EMG传感器的采样信号，从采样信号中提取特征样本，按照根据 指示执行相应的手势，并用标记的特征样本训练机器学习模型。 随后，可以使用经过训练的机器学习模型，通过对来自EMG传感器的信号进行采样，从信号提取与训练期间提取的相似类型的未标记的特征样本，将未标记的特征样本传递到机器学习模型， 从机器学习模型标记输出由机器学习模型分类的手势。

公开(公告)号：US20120253815A1

公开(公告)日：2012-10-04

申请号：US13493112

申请日：2012-06-11

Applicant: Kentaro Toyama ,  Gerald Chu ,  Ravin Balakrishnan

Inventor： Kentaro Toyama ,  Gerald Chu ,  Ravin Balakrishnan

IPC: G10L13/00

CPC classification number: G11B27/031 ,  G06F17/30056 ,  G09B5/065

Abstract: A range of unified software authoring tools for creating a talking paper application for integration in an end user platform are described herein. The authoring tools are easy to use and are interoperable to provide an easy and cost-effective method of creating a talking paper application. The authoring tools provide a framework for creating audio content and image content and interactively linking the audio content and the image content. The authoring tools also provide for verifying the interactively linked audio and image content, reviewing the audio content, the image content and the interactive linking on a display device. Finally, the authoring tools provide for saving the audio content, the video content and the interactive linking for publication to a manufacturer for integration in an end user platform or talking paper platform.

Abstract translation: 这里描述了用于创建用于集成在最终用户平台中的通话纸应用的一系列统一的软件创作工具。 创作工具易于使用，可互操作，提供了一种创建讲话纸应用程序的简单而具有成本效益的方法。 创作工具提供了创建音频内容和图像内容并交互地链接音频内容和图像内容的框架。 创作工具还提供用于验证交互式链接的音频和图像内容，在显示设备上检查音频内容，图像内容和交互式链接。 最后，创作工具提供将音频内容，视频内容和交互式链接保存到制造商以便集成到最终用户平台或谈话纸平台中。

公开(公告)号：US07701441B2

公开(公告)日：2010-04-20

申请号：US11907514

申请日：2007-10-12

Applicant: Ravin Balakrishnan ,  Gordon Paul Kurtenbach ,  George William Fitzmaurice

Inventor： Ravin Balakrishnan ,  Gordon Paul Kurtenbach ,  George William Fitzmaurice

IPC: G09G5/08 ,  G06F3/033

CPC classification number: G09G5/08 ,  G02B27/2271 ,  G06F1/1601 ,  G06F3/011 ,  G06F3/033 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04817 ,  H04N13/388

Abstract: The present invention is a system that creates a volumetric display and a user controllable volumetric pointer within the volumetric display. The user can point by aiming a beam which is vector, planar or tangent based, positioning a device in three-dimensions in association with the display, touching a digitizing surface of the display enclosure or otherwise inputting position coordinates. The cursor can take a number of different forms including a ray, a point, a volume and a plane. The ray can include a ring, a bead, a segmented wand, a cone and a cylinder. The user designates an input position and the system maps the input position to a 3D cursor position within the volumetric display. The system also determines whether any object has been designated by the cursor by determining whether the object is within a region of influence of the cursor. The system also performs any function activated in association with the designation.

Abstract translation: 本发明是在体积显示内创建体积显示和用户可控的体积指示器的系统。 用户可以通过瞄准基于矢量，平面或切线的光束来指向与显示器相关联的三维定位设备，触摸显示器外壳的数字化表面或以其他方式输入位置坐标。 光标可以采取许多不同的形式，包括射线，点，体积和平面。 射线可以包括环，珠，分段魔杖，锥体和圆柱体。 用户指定输入位置，并且系统将输入位置映射到体积显示内的3D光标位置。 系统还通过确定对象是否在光标的影响区域内来确定是否已经由光标指定了任何对象。 该系统还执行与指定相关联的激活的任何功能。

公开(公告)号：US20100023895A1

公开(公告)日：2010-01-28

申请号：US12344411

申请日：2008-12-26

Applicant: Hrvoje Benko ,  Andrew D. Wilson ,  Billy Chen ,  Ravin Balakrishnan ,  Patrick M. Baudisch

Inventor： Hrvoje Benko ,  Andrew D. Wilson ,  Billy Chen ,  Ravin Balakrishnan ,  Patrick M. Baudisch

IPC: G06F3/048

CPC classification number: G06F3/0486 ,  G06F3/041 ,  G06F3/042 ,  G06F3/0488 ,  G06F3/04883 ,  G06F2203/04808

Abstract: Touch interaction with a curved display (e.g., a sphere, a hemisphere, a cylinder, etc.) is facilitated by preserving a predetermined orientation for objects. In an example embodiment, a curved display is monitored to detect a touch input on an object. If a touch input on an object is detected based on the monitoring, then one or more locations of the touch input are determined. The object may be manipulated responsive to the determined one or more locations of the touch input. While manipulation of the object is permitted, a predetermined orientation is preserved.

Abstract translation: 通过保持对象的预定取向来促进与弯曲显示器（例如球体，半球，圆柱体等）的触摸交互。 在示例实施例中，监视弯曲显示器以检测对象上的触摸输入。 如果基于监视检测到物体上的触摸输入，则确定触摸输入的一个或多个位置。 可以响应于所确定的触摸输入的一个或多个位置来操纵对象。 在允许对对象的操纵的同时，保持预定的方向。

公开(公告)号：US20090307623A1

公开(公告)日：2009-12-10

申请号：US12293198

申请日：2007-04-18

Applicant: Anand Agarawala ,  Ravin Balakrishnan

Inventor： Anand Agarawala ,  Ravin Balakrishnan

IPC: G06F3/048 ,  G06F3/041 ,  G06F3/033

CPC classification number: G06F3/04815 ,  G06F3/0483

Abstract: A method, system and computer program for organizing and visualizing display objects within a virtual environment is provided. In one aspect, attributes of display objects define the interaction between display objects according to pre-determined rules, including rules simulating real world mechanics, thereby enabling enriched user interaction. The present invention further provides for the use of piles as an organizational entity for desktop objects. The present invention further provides for fluid interaction techniques for committing actions on display objects in a virtual interface. A number of other interaction and visualization techniques are disclosed.

Abstract translation: 提供了一种用于在虚拟环境内组织和可视化显示对象的方法，系统和计算机程序。 在一个方面，显示对象的属性根据预先确定的规则定义显示对象之间的交互，包括模拟真实世界力学的规则，从而实现丰富的用户交互。 本发明还提供了使用桩作为桌面对象的组织实体。 本发明还提供了用于在虚拟接口中对显示对象进行动作的流体交互技术。 公开了许多其他交互和可视化技术。

公开(公告)号：US20070291007A1

公开(公告)日：2007-12-20

申请号：US11452810

申请日：2006-06-14

Applicant: Clifton Forlines ,  Ravin Balakrishnan

Inventor： Clifton Forlines ,  Ravin Balakrishnan

IPC: G06F3/041

CPC classification number: G06F3/0488 ,  G06F2203/04808

Abstract: A method maps positions of a direct input device to locations of a pointer displayed on a surface. The method performs absolute mapping between physical positions of a direct input device and virtual locations of a pointer on a display device when operating in an absolute mapping mode, and relative mapping between the physical positions of the input device and the locations the pointer when operating in a relative mapping mode. Switching between the absolute mapping and the relative mappings is in response to control signals detected from the direct input device.

Abstract translation: 一种方法将直接输入设备的位置映射到表面上显示的指针的位置。 该方法在以绝对映射模式操作时，在直接输入设备的物理位置和指示器的虚拟位置之间执行绝对映射，以及输入设备的物理位置与指示器在操作时的位置之间的相对映射 相对映射模式。 绝对映射和相对映射之间的切换是响应于从直接输入设备检测到的控制信号。

公开(公告)号：US20060250393A1

公开(公告)日：2006-11-09

申请号：US11405469

申请日：2006-04-18

Applicant: Steve Tsang ,  Karan Singh ,  Abhishek Ranjan ,  Ravin Balakrishnan

Inventor： Steve Tsang ,  Karan Singh ,  Abhishek Ranjan ,  Ravin Balakrishnan

IPC: G06T17/00

CPC classification number: G06T11/203 ,  G06F3/04845 ,  G06T19/20 ,  G06T2219/2021

Abstract: A method, computer system and computer program is provided for using a suggestive modeling interface. The method consists of a method of a computer-implemented rendering of sketches, the method comprising the steps of: (1) a user activating a sketching application; (2) in response, the sketching application displaying on a screen a suggestive modeling interface; (3) the sketching application importing a sketch to the suggestive modeling interface; and (4) the sketching application retrieving from a database one or more suggestions based on the sketch. The method is operable to allow a user interactively using the sketching application to create a drawing that is guided by the imported sketch by selectively using one or more image guided drawing tools provided by the sketching application. The present invention is well-suited for three-dimensional modeling applications.

Abstract translation: 提供了一种使用建议建模界面的方法，计算机系统和计算机程序。 该方法由计算机实现的草图绘制方法组成，该方法包括以下步骤：（1）激活草图应用的用户; （2）作为响应，草绘应用在屏幕上显示暗示建模界面; （3）草图应用程序将草图导入建议性建模界面; 和（4）草图应用程序从数据库检索基于草图的一个或多个建议。 该方法可操作以允许用户交互地使用草绘应用来通过选择性地使用由草图应用提供的一个或多个图像引导绘图工具来创建由导入的草图引导的图形。 本发明非常适用于三维建模应用。