公开(公告)号：US20100088582A1

公开(公告)日：2010-04-08

申请号：US12247891

申请日：2008-10-08

Applicant: Kentaro Toyama ,  Gerald Chu ,  Ravin Balakrishnan

Inventor： Kentaro Toyama ,  Gerald Chu ,  Ravin Balakrishnan

IPC: G06F3/14

CPC classification number: G11B27/031 ,  G06F17/30056 ,  G09B5/065

Abstract: A range of unified software authoring tools for creating a talking paper application for integration in an end user platform are described herein. The authoring tools are easy to use and are interoperable to provide an easy and cost-effective method of creating a talking paper application. The authoring tools provide a framework for creating audio content and image content and interactively linking the audio content and the image content. The authoring tools also provide for verifying the interactively linked audio and image content, reviewing the audio content, the image content and the interactive linking on a display device. Finally, the authoring tools provide for saving the audio content, the video content and the interactive linking for publication to a manufacturer for integration in an end user platform or talking paper platform.

Abstract translation: 这里描述了用于创建用于集成在最终用户平台中的通话纸应用的一系列统一的软件创作工具。 创作工具易于使用，可互操作，提供了一种创建讲话纸应用程序的简单而具有成本效益的方法。 创作工具提供了创建音频内容和图像内容并交互地链接音频内容和图像内容的框架。 创作工具还提供用于验证交互式链接的音频和图像内容，在显示设备上检查音频内容，图像内容和交互式链接。 最后，创作工具提供将音频内容，视频内容和交互式链接保存到制造商以便集成到最终用户平台或谈话纸平台中。

公开(公告)号：US07640518B2

公开(公告)日：2009-12-29

申请号：US11452810

申请日：2006-06-14

Applicant: Clifton Forlines ,  Ravin Balakrishnan

Inventor： Clifton Forlines ,  Ravin Balakrishnan

IPC: G06F3/033 ,  G06F3/041

CPC classification number: G06F3/0488 ,  G06F2203/04808

Abstract: A method maps positions of a direct input device to locations of a pointer displayed on a surface. The method performs absolute mapping between physical positions of a direct input device and virtual locations of a pointer on a display device when operating in an absolute mapping mode, and relative mapping between the physical positions of the input device and the locations the pointer when operating in a relative mapping mode. Switching between the absolute mapping and the relative mappings is in response to control signals detected from the direct input device.

Abstract translation: 一种方法将直接输入设备的位置映射到表面上显示的指针的位置。 该方法在以绝对映射模式操作时，在直接输入设备的物理位置和指示器的虚拟位置之间执行绝对映射，以及输入设备的物理位置与指示器在操作时的位置之间的相对映射 相对映射模式。 绝对映射和相对映射之间的切换是响应于从直接输入设备检测到的控制信号。

公开(公告)号：US07640515B2

公开(公告)日：2009-12-29

申请号：US10841632

申请日：2004-05-10

Applicant: Ravin Balakrishnan ,  Gordon Kurtenbach

Inventor： Ravin Balakrishnan ,  Gordon Kurtenbach

IPC: G06F3/048 ,  G06F3/033

CPC classification number: G06F3/038 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04845 ,  G06T13/00

Abstract: The present invention is directed to a two-handed input control system that dynamically changes an input-to-object mapping for mapping movement of a graphical object on a display of a virtual scene as the viewpoint of the virtual scene changes. As input to the system for changing the position of the graphical object occurs, the mapping is revised to reflect changes in the viewpoint so that the object moves as inherently expected. That is, changes to the viewpoint change the mapping so that a correspondence between the viewpoint and the input space is always maintained. During movement of the object a screen cursor is visually suppressed so that the movement of the graphical object and the screen cursor do not split the attention of the user. The screen cursor is always maintained within the visual display region of the virtual scene even when the object moves out of the visual display region by moving the cursor to a center of the screen when it reaches an edge of the screen.

Abstract translation: 本发明涉及一种双手输入控制系统，其在虚拟场景的视点改变时动态地改变用于映射虚拟场景的显示器上的图形对象的移动的输入对象映射。 当用于改变图形对象的位置的系统的输入发生时，修改映射以反映视点的变化，使得对象按照本质上的预期移动。 也就是说，对视点的改变改变了映射，使得始终保持视点和输入空间之间的对应关系。 在对象的运动期间，屏幕光标被视觉上被抑制，使得图形对象和屏幕光标的移动不会分开用户的注意。 即使当物体到达屏幕的边缘时，通过将光标移动到屏幕的中心，当对象移出视觉显示区域时，屏幕光标始终保持在虚拟场景的视觉显示区域内。

公开(公告)号：US20090189857A1

公开(公告)日：2009-07-30

申请号：US12122736

申请日：2008-05-19

Applicant: Hrvoje Benko ,  Andrew Wilson ,  Ravin Balakrishnan

Inventor： Hrvoje Benko ,  Andrew Wilson ,  Ravin Balakrishnan

IPC: G06F3/042 ,  G06K9/00

CPC classification number: G06F3/0421

Abstract: Described herein is an apparatus that includes a curved display surface that has an interior and an exterior. The curved display surface is configured to display images thereon. The apparatus also includes an emitter that emits light through the interior of the curved display surface. A detector component analyzes light reflected from the curved display surface to detect a position on the curved display surface where a first member is in physical contact with the exterior of the curved display surface.

Abstract translation: 这里描述的是一种包括具有内部和外部的弯曲显示表面的装置。 弯曲的显示表面被配置为在其上显示图像。 该装置还包括通过弯曲显示表面的内部发射光的发射器。 检测器组件分析从弯曲显示表面反射的光，以检测弯曲显示表面上的位置，其中第一构件与弯曲显示表面的外部物理接触。

公开(公告)号：US07554541B2

公开(公告)日：2009-06-30

申请号：US10183945

申请日：2002-06-28

Applicant: George William Fitzmaurice ,  Ravin Balakrishnan ,  Gordon Paul Kurtenbach

Inventor： George William Fitzmaurice ,  Ravin Balakrishnan ,  Gordon Paul Kurtenbach

IPC: G06T17/00

CPC classification number: G06T17/00 ,  G02B27/2271 ,  G06F3/011 ,  G06F3/0346 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815

Abstract: The present invention is a system that places 2D user interface widgets in optimal positions in a 3D volumetric display where they can be easily used based on the knowledge user have about traditional 2D display systems. The widgets are placed on a shell or outer edge surface of a volumetric display, in a ring around the outside bottom of the display, in a vertical or horizontal plane within the display and/or responsive to the users focus of attention. Virtual 2D widgets are mapped to volumetric voxels of the 3D display system. This mapping includes any mapping between a 2D representation or virtual display map of the widget to the corresponding voxels. For example, a 2D texture map of the widget image may be mapped into voxels. Control actions in the 3D volume initiated by conventional control devices, such as a mouse or a touch sensitive dome enclosure surface, are mapped to controls of the widgets and appropriate control functions are performed.

Abstract translation: 本发明是一种将2D用户界面小部件置于3D体积显示器中的最佳位置的系统，其中可以基于知识用户对传统2D显示系统的易用性进行使用。 小部件被放置在体积显示器的外壳或外边缘表面上，在显示器的外部底部的环中，在显示器内的垂直或水平平面中和/或响应于用户的关注焦点。 虚拟2D小部件被映射到3D显示系统的体积体素。 该映射包括将小部件的2D表示或虚拟显示映射与对应的体素之间的任何映射。 例如，小部件图像的2D纹理贴图可以映射到体素。 由诸如鼠标或触摸敏感的圆顶壳体表面的常规控制装置启动的3D体积中的控制动作被映射到小部件的控件并且执行适当的控制功能。

公开(公告)号：US07528823B2

公开(公告)日：2009-05-05

申请号：US11907513

申请日：2007-10-12

Applicant: Ravin Balakrishnan ,  Gordon Paul Kurtenbach ,  George William Fitzmaurice

Inventor： Ravin Balakrishnan ,  Gordon Paul Kurtenbach ,  George William Fitzmaurice

IPC: G06F3/033 ,  G09G5/08

CPC classification number: G09G5/08 ,  G02B27/2271 ,  G06F1/1601 ,  G06F3/011 ,  G06F3/033 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04817 ,  H04N13/388

Abstract: The present invention is a system that creates a volumetric display and a user controllable volumetric pointer within the volumetric display. The user can point by aiming a beam which is vector, planar or tangent based, positioning a device in three-dimensions in association with the display, touching a digitizing surface of the display enclosure or otherwise inputting position coordinates. The cursor can take a number of different forms including a ray, a point, a volume and a plane. The ray can include a ring, a bead, a segmented wand, a cone and a cylinder. The user designates an input position and the system maps the input position to a 3D cursor position within the volumetric display. The system also determines whether any object has been designated by the cursor by determining whether the object is within a region of influence of the cursor. The system also performs any function activated in association with the designation.

Abstract translation: 本发明是在体积显示内创建体积显示和用户可控的体积指示器的系统。 用户可以通过瞄准基于矢量，平面或切线的光束来指向与显示器相关联的三维定位设备，触摸显示器外壳的数字化表面或以其他方式输入位置坐标。 光标可以采取许多不同的形式，包括射线，点，体积和平面。 射线可以包括环，珠，分段魔杖，锥体和圆柱体。 用户指定输入位置，并且系统将输入位置映射到体积显示内的3D光标位置。 系统还通过确定对象是否在光标的影响区域内来确定是否已经由光标指定了任何对象。 该系统还执行与指定相关联的激活的任何功能。

公开(公告)号：US20080036738A1

公开(公告)日：2008-02-14

申请号：US11907513

申请日：2007-10-12

Applicant: Ravin Balakrishnan ,  Gordon Kurtenbach ,  George Fitzmaurice

Inventor： Ravin Balakrishnan ,  Gordon Kurtenbach ,  George Fitzmaurice

IPC: G06F3/033

CPC classification number: G09G5/08 ,  G02B27/2271 ,  G06F1/1601 ,  G06F3/011 ,  G06F3/033 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04817 ,  H04N13/388

Abstract: The present invention is a system that creates a volumetric display and a user controllable volumetric pointer within the volumetric display. The user can point by aiming a beam which is vector, planar or tangent based, positioning a device in three-dimensions in association with the display, touching a digitizing surface of the display enclosure or otherwise inputting position coordinates. The cursor can take a number of different forms including a ray, a point, a volume and a plane. The ray can include a ring, a bead, a segmented wand, a cone and a cylinder. The user designates an input position and the system maps the input position to a 3D cursor position within the volumetric display. The system also determines whether any object has been designated by the cursor by determining whether the object is within a region of influence of the cursor. The system also performs any function activated in association with the designation.

公开(公告)号：US07138997B2

公开(公告)日：2006-11-21

申请号：US10188765

申请日：2002-06-28

Applicant: Ravin Balakrishnan ,  Gordon Paul Kurtenbach ,  George William Fitzmaurice

Inventor： Ravin Balakrishnan ,  Gordon Paul Kurtenbach ,  George William Fitzmaurice

IPC: G06T15/00

CPC classification number: G06T15/00 ,  G02B27/2271 ,  G06F3/011 ,  G06F3/0346 ,  G06F3/0362 ,  G06F3/041 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04845 ,  G09G3/003 ,  G09G2340/0492

Abstract: The present invention is a system that allows a user to physically rotate a three-dimensional volumetric display enclosure with a corresponding rotation of the display contents. The rotation of the enclosure is sampled with an encoder and the display is virtually rotated by a computer maintaining the scene by an amount corresponding to the physical rotation before being rendered. This allows the user to remain in one position while viewing different parts of the displayed scene corresponding to different viewpoints. The display contents can be rotated in direct correspondence with the display enclosure or with a gain (positive or negative) that accelerates the rotation of the contents with respect to the physical rotation of the enclosure. Any display widgets in the scene, such as a virtual keyboard, can be maintained stationary with respect to the user while scene contents rotate by applying a negative rotational gain to the widgets. The rotation can also be controlled by a time value such that the rotation continues until a specified time is reached or expires.

Abstract translation: 本发明是允许用户物理地旋转具有显示内容的相应旋转的三维体积显示外壳的系统。 外壳的旋转用编码器进行采样，并且显示器由维护场景的计算机虚拟地旋转与呈现之前的物理旋转相对应的量。 这允许用户在观看对应于不同视点的所显示场景的不同部分的同时保持在一个位置。 显示内容可以与显示器外壳直接对应地旋转，或者具有加速内容物相对于外壳的物理旋转的旋转的增益（正或负）旋转。 场景中的任何显示小部件（例如虚拟键盘）可以相对于用户保持静止，而场景内容通过向小部件施加负旋转增益而旋转。 旋转也可以通过时间值来控制，使得旋转继续直到达到指定的时间或到期。

公开(公告)号：US20060077212A1

公开(公告)日：2006-04-13

申请号：US11236488

申请日：2005-09-28

Applicant: George Fitzmaurice ,  Ravin Balakrishnan ,  Gordon Kurtenbach

Inventor： George Fitzmaurice ,  Ravin Balakrishnan ,  Gordon Kurtenbach

IPC: G09G5/00

CPC classification number: G06F3/011 ,  G02B27/2271 ,  G06F1/1601 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04817

Abstract: The present invention is a widget display system for a volumetric or true three-dimensional (3D) display that provides a volumetric or omni-viewable widget that can be viewed and interacted with from any location around the volumetric display. The widget can be viewed from any location by duplicating the widget such that all locations around the display are within the viewing range of the widget. A widget can be provided with multiple viewing surfaces or faces making the widget omni-directional. A widget can be continuously rotated to face all of the possible locations of users over a period of time. User locations can be determined and the widget can be oriented to face the users when selected.

公开(公告)号：US08300062B2

公开(公告)日：2012-10-30

申请号：US11405469

申请日：2006-04-18

Applicant: Steve Tsang ,  Karan Singh ,  Abhishek Ranjan ,  Ravin Balakrishnan

Inventor： Steve Tsang ,  Karan Singh ,  Abhishek Ranjan ,  Ravin Balakrishnan

IPC: G09G5/00

CPC classification number: G06T11/203 ,  G06F3/04845 ,  G06T19/20 ,  G06T2219/2021

Abstract: A method, computer system and computer program is provided for using a suggestive modeling interface. The method consists of a method of a computer-implemented rendering of sketches, the method comprising the steps of: (1) a user activating a sketching application; (2) in response, the sketching application displaying on a screen a suggestive modeling interface; (3) the sketching application importing a sketch to the suggestive modeling interface; and (4) the sketching application retrieving from a database one or more suggestions based on the sketch. The method is operable to allow a user interactively using the sketching application to create a drawing that is guided by the imported sketch by selectively using one or more image guided drawing tools provided by the sketching application. The present invention is well-suited for three-dimensional modeling applications.

Abstract translation: 提供了一种使用建议建模界面的方法，计算机系统和计算机程序。 该方法由计算机实现的草图绘制方法组成，该方法包括以下步骤：（1）激活草绘应用的用户; （2）作为响应，草绘应用在屏幕上显示暗示建模界面; （3）草图应用程序将草图导入建议性建模界面; 和（4）草图应用程序从数据库检索基于草图的一个或多个建议。 该方法可操作以允许用户交互地使用草绘应用来通过选择性地使用由草图应用提供的一个或多个图像引导绘图工具来创建由导入的草图引导的图形。 本发明非常适用于三维建模应用。