公开(公告)号：US08552976B2

公开(公告)日：2013-10-08

申请号：US13346472

申请日：2012-01-09

Applicant: Andrew D. Wilson ,  Michael J. Sinclair

Inventor： Andrew D. Wilson ,  Michael J. Sinclair

IPC: G09G5/00

CPC classification number: G06F3/017 ,  G06F3/0304 ,  G06F3/04815 ,  G06F3/04845

Abstract: Virtual controllers for visual displays are described. In one implementation, a camera captures an image of hands against a background. The image is segmented into hand areas and background areas. Various hand and finger gestures isolate parts of the background into independent areas, which are then assigned control parameters for manipulating the visual display. Multiple control parameters can be associated with attributes of multiple independent areas formed by two hands, for advanced control including simultaneous functions of clicking, selecting, executing, horizontal movement, vertical movement, scrolling, dragging, rotational movement, zooming, maximizing, minimizing, executing file functions, and executing menu choices.

Abstract translation: 描述了用于视觉显示的虚拟控制器。 在一个实现中，相机在背景上拍摄手的图像。 图像被分割为手区域和背景区域。 各种手指和手指手势将背景的一部分隔离成独立的区域，然后分配控制参数以操纵视觉显示。 多个控制参数可以与由双手形成的多个独立区域的属性相关联，用于高级控制，包括点击，选择，执行，水平移动，垂直移动，滚动，拖动，旋转移动，缩放，最大化，最小化，执行的同时功能 文件功能和执行菜单选项。

公开(公告)号：US20120320158A1

公开(公告)日：2012-12-20

申请号：US13160094

申请日：2011-06-14

Applicant: Sasa Junuzovic ,  William Thomas Blank ,  Bruce Arnold Cleary, III ,  Anoop Gupta ,  Andrew D. Wilson

Inventor： Sasa Junuzovic ,  William Thomas Blank ,  Bruce Arnold Cleary, III ,  Anoop Gupta ,  Andrew D. Wilson

IPC: H04N7/15 ,  H04N13/02

CPC classification number: H04N7/142 ,  G01B11/24 ,  G06F3/017 ,  G06F3/0425 ,  G06F3/1454 ,  G06Q10/101 ,  H04N7/15

Abstract: The interactive and shared surface technique described herein employs hardware that can project on any surface, capture color video of that surface, and get depth information of and above the surface while preventing visual feedback (also known as video feedback, video echo, or visual echo). The technique provides N-way sharing of a surface using video compositing. It also provides for automatic calibration of hardware components, including calibration of any projector, RGB camera, depth camera and any microphones employed by the technique. The technique provides object manipulation with physical, visual, audio, and hover gestures and interaction between digital objects displayed on the surface and physical objects placed on or above the surface. It can capture and scan the surface in a manner that captures or scans exactly what the user sees, which includes both local and remote objects, drawings, annotations, hands, and so forth.

Abstract translation: 本文描述的交互式和共享表面技术采用可投影在任何表面上的硬件，捕捉该表面的彩色视频，并获得表面上方的深度信息，同时防止视觉反馈（也称为视频反馈，视频回声或视觉回声 ）。 该技术使用视频合成来提供表面的N路共享。 它还提供硬件组件的自动校准，包括校准任何投影机，RGB摄像机，深度摄像机和该技术使用的任何麦克风。 该技术提供物体操纵，物理，视觉，音频和悬停的手势以及表面上显示的数字对象与放置在表面上或表面上的物理对象之间的交互。 它可以以捕获或扫描用户所看到的内容（包括本地和远程对象，绘图，注释，手等）的方式捕获和扫描表面。

公开(公告)号：US20120169673A1

公开(公告)日：2012-07-05

申请号：US13421600

申请日：2012-03-15

Applicant: Andrew D. Wilson

Inventor： Andrew D. Wilson

IPC: G06F3/042 ,  H04N5/33

CPC classification number: G06F3/0421 ,  G06K9/00375 ,  H04N5/2256 ,  H04N5/33

Abstract: Effects of undesired infrared light are reduced in an imaging system using an infrared light source. The desired infrared light source is activated and a first set of imaging data is captured during a first image capture interval. The desired infrared light source is then deactivated, and a second set of image data is captured during a second image capture interval. A composite set of image data is then generated by subtracting from first values in the first set of image data corresponding second values in the second set of image data. The composite set of image data thus includes a set of imaging where data all infrared signals are collected, including both signals resulting from the IR source and other IR signals, from which is subtracted imaging in which no signals result from the IR course, leaving image data including signals resulting only from the IR source.

Abstract translation: 在使用红外光源的成像系统中，不期望的红外光的影响降低。 期望的红外光源被激活，并且在第一图像捕获间隔期间捕获第一组成像数据。 然后停用期望的红外光源，并且在第二图像捕获间隔期间捕获第二组图像数据。 然后通过从第二组图像数据中的第一组图像数据中的第一值中减去第二组图像数据中的第二值来生成复合图像数据集合。 因此，复合图像数据集合包括一组成像，其中收集所有红外信号的数据，包括由IR源和其它IR信号产生的两个信号，从该IR成像中减去没有信号来自IR过程的图像，留下图像 数据包括仅从IR源产生的信号。

公开(公告)号：US08165422B2

公开(公告)日：2012-04-24

申请号：US12492178

申请日：2009-06-26

Applicant: Andrew D. Wilson

Inventor： Andrew D. Wilson

IPC: G06K9/40 ,  G06F3/045

CPC classification number: G06F3/0421 ,  G06K9/00375 ,  H04N5/2256 ,  H04N5/33

Abstract: Effects of undesired infrared light are reduced in an imaging system using an infrared light source. The desired infrared light source is activated and a first set of imaging data is captured during a first image capture interval. The desired infrared light source is then deactivated, and a second set of image data is captured during a second image capture interval. A composite set of image data is then generated by subtracting from first values in the first set of image data corresponding second values in the second set of image data. The composite set of image data thus includes a set of imaging where data all infrared signals are collected, including both signals resulting from the IR source and other IR signals, from which is subtracted imaging in which no signals result from the IR course, leaving image data including signals resulting only from the IR source.

Abstract translation: 在使用红外光源的成像系统中，不期望的红外光的影响降低。 期望的红外光源被激活，并且在第一图像捕获间隔期间捕获第一组成像数据。 然后停用期望的红外光源，并且在第二图像捕获间隔期间捕获第二组图像数据。 然后通过从第二组图像数据中的第一组图像数据中的第一值中减去第二组图像数据中的第二值来生成复合图像数据集合。 因此，复合图像数据集合包括一组成像，其中收集所有红外信号的数据，包括由IR源和其它IR信号产生的两个信号，从该IR成像中减去没有信号来自IR过程的图像，留下图像 数据包括仅从IR源产生的信号。

公开(公告)号：US08077153B2

公开(公告)日：2011-12-13

申请号：US11379297

申请日：2006-04-19

Applicant: Hrvoje Benko ,  Andrew D. Wilson ,  Patrick M. Baudisch

Inventor： Hrvoje Benko ,  Andrew D. Wilson ,  Patrick M. Baudisch

IPC: G06F3/041

CPC classification number: G06F3/04812 ,  G06F3/0488 ,  G06F2203/04808

Abstract: A unique system and method is provided that facilitates pixel-accurate targeting with respect to multi-touch sensitive displays when selecting or viewing content with a cursor. In particular, the system and method can track dual inputs from a primary finger and a secondary finger, for example. The primary finger can control movement of the cursor while the secondary finger can adjust a control-display ratio of the screen. As a result, cursor steering and selection of an assistance mode can be performed at about the same time or concurrently. In addition, the system and method can stabilize a cursor position at a top middle point of a user's finger in order to mitigate clicking errors when making a selection.

Abstract translation: 提供了一种独特的系统和方法，其在使用光标选择或观看内容时便于针对多触点敏感显示器的像素精确定位。 特别地，系统和方法可以例如跟踪主手指和次手指的双输入。 主手指可以控制光标的移动，而辅助手指可以调节屏幕的控制显示比率。 结果，光标转向和辅助模式的选择可以在大约相同的时间或同时进行。 此外，系统和方法可以稳定用户手指的顶部中点处的光标位置，以便在进行选择时减轻点击错误。

公开(公告)号：US20110273368A1

公开(公告)日：2011-11-10

申请号：US13109765

申请日：2011-05-17

Applicant: Kenneth P. Hinckley ,  Andrew D. Wilson

Inventor： Kenneth P. Hinckley ,  Andrew D. Wilson

IPC: G09G5/00

CPC classification number: H04L67/08 ,  G06F3/038 ,  G06F2203/0384 ,  H04M1/7253

Abstract: A unique system and method that facilitates extending input/output capabilities for resource deficient mobile devices and interactions between multiple heterogeneous devices is provided. The system and method involve an interactive surface to which the desired mobile devices can be connected. The interactive surface can provide an enhanced display space and customization controls for mobile devices that lack adequate displays and input capabilities. In addition, the interactive surface can be employed to permit communication and interaction between multiple mobile devices that otherwise are unable to interact with each other. When connected to the interactive surface, the mobile devices can share information, view information from their respective devices, and store information to the interactive surface. Furthermore, the interactive surface can resume activity states of mobile devices that were previously communicating upon re-connection to the surface.

Abstract translation: 提供了一种独特的系统和方法，有助于扩展资源不足的移动设备的输入/输出能力以及多个异构设备之间的交互。 该系统和方法涉及可以连接期望的移动设备的交互式表面。 交互式表面可以为缺少足够的显示和输入功能的移动设备提供增强的显示空间和定制控件。 此外，可以采用交互式表面以允许否则不能彼此交互的多个移动设备之间的通信和交互。 当连接到交互式表面时，移动设备可以共享信息，从相应设备查看信息，并将信息存储到交互式表面。 此外，交互式表面可以恢复以前在重新连接到表面时通信的移动设备的活动状态。

公开(公告)号：US20110252316A1

公开(公告)日：2011-10-13

申请号：US12758060

申请日：2010-04-12

Applicant: Michel Pahud ,  Takako Aikawa ,  Andrew D. Wilson ,  Hrvoje Benko ,  Sauleh Eetemadi ,  Anand M. Chakravarty

Inventor： Michel Pahud ,  Takako Aikawa ,  Andrew D. Wilson ,  Hrvoje Benko ,  Sauleh Eetemadi ,  Anand M. Chakravarty

IPC: G06F17/28 ,  G06F3/01 ,  G06F17/24 ,  G06F3/048

CPC classification number: G06F17/289

Abstract: A system described herein includes an acquirer component that acquires an electronic document that comprises text in a first language, wherein the acquirer component acquires the electronic document based at least in part upon a physical object comprising the text contacting or becoming proximate to the interactive display of the surface computing device. The system also includes a language selector component that receives an indication of a second language from a user of the surface computing device and selects the second language. A translator component translates the text in the electronic document from the first language to the second language, and a formatter component formats the electronic document for display to the user on the interactive display of the surface computing device, wherein the electronic document comprises the text in the second language.

Abstract translation: 本文描述的系统包括获取包含第一语言的文本的电子文档的获取器组件，其中所述获取器组件至少部分地基于包括接触或变得接近于交互式显示的文本的物理对象获取电子文档 表面计算设备。 该系统还包括语言选择器组件，其从表面计算设备的用户接收第二语言的指示并选择第二语言。 翻译器组件将电子文档中的文本从第一语言翻译成第二语言，并且格式化器组件在表面计算设备的交互式显示器上将用于显示的电子文档格式化为用户，其中电子文档包括文本 第二语言

公开(公告)号：US07907117B2

公开(公告)日：2011-03-15

申请号：US11463183

申请日：2006-08-08

Applicant: Andrew D Wilson ,  Michael J. Sinclair

Inventor： Andrew D Wilson ,  Michael J. Sinclair

IPC: G09G5/00

CPC classification number: G06F3/017 ,  G06F3/0304 ,  G06F3/04815 ,  G06F3/04845

Abstract: Virtual controllers for visual displays are described. In one implementation, a camera captures an image of hands against a background. The image is segmented into hand areas and background areas. Various hand and finger gestures isolate parts of the background into independent areas, which are then assigned control parameters for manipulating the visual display. Multiple control parameters can be associated with attributes of multiple independent areas formed by two hands, for advanced control including simultaneous functions of clicking, selecting, executing, horizontal movement, vertical movement, scrolling, dragging, rotational movement, zooming, maximizing, minimizing, executing file functions, and executing menu choices.

公开(公告)号：US20100205190A1

公开(公告)日：2010-08-12

申请号：US12367734

申请日：2009-02-09

Applicant: Meredith J. Morris ,  Stephen Edward Hodges ,  Ian C. LeGrow ,  William J. Westerinen ,  Andrew D. Wilson

Inventor： Meredith J. Morris ,  Stephen Edward Hodges ,  Ian C. LeGrow ,  William J. Westerinen ,  Andrew D. Wilson

IPC: G06F17/30 ,  G06F3/041

CPC classification number: G06F3/041 ,  G06F3/0488 ,  G06F3/04886 ,  G06F16/903

Abstract: The claimed subject matter relates to architectures that can provide rich features associated with information-based collaborative searches by leveraging a multi-touch surface computing-based display. In particular, a first architecture can include a multi-touch surface configured to support interactivity with multiple collocated users simultaneously. Based upon such interaction, the first architecture can transmit to a search engine a multiuser surface identifier and a set of search terms input by collocated users that share a collaborative task. In response, the architecture can receive a set of search results from a second architecture, and present those results to the multi-touch surface in a variety of ways. The second architecture can relate to a search engine that can process the search terms to generate corresponding search results and also process information associated with the multiuser surface identifier.

Abstract translation: 所要求保护的主题涉及可以通过利用基于多触摸表面计算的显示器来提供与基于信息的协作搜索相关联的丰富特征的架构。 特别地，第一架构可以包括被配置为同时支持与多个并置用户的交互性的多点触控面。 基于这种交互，第一架构可以向搜索引擎发送共享协作任务的多用户表面标识符和由并置用户输入的一组搜索项。 作为响应，架构可以从第二架构接收一组搜索结果，并且以各种方式将这些结果呈现给多点触摸表面。 第二架构可以涉及可以处理搜索项以产生相应的搜索结果并且还处理与多用户表面标识符相关联的信息的搜索引擎。

公开(公告)号：US20100146464A1

公开(公告)日：2010-06-10

申请号：US12705014

申请日：2010-02-12

Applicant: Andrew D. Wilson ,  Nuria M. Oliver

Inventor： Andrew D. Wilson ,  Nuria M. Oliver

IPC: G06F3/01

CPC classification number: G06F3/017 ,  G06K9/00355

Abstract: Architecture for implementing a perceptual user interface. The architecture comprises alternative modalities for controlling computer application programs and manipulating on-screen objects through hand gestures or a combination of hand gestures and verbal commands. The perceptual user interface system includes a tracking component that detects object characteristics of at least one of a plurality of objects within a scene, and tracks the respective object. Detection of object characteristics is based at least in part upon image comparison of a plurality of images relative to a course mapping of the images. A seeding component iteratively seeds the tracking component with object hypotheses based upon the presence of the object characteristics and the image comparison. A filtering component selectively removes the tracked object from the object hypotheses and/or at least one object hypothesis from the set of object hypotheses based upon predetermined removal criteria.

Abstract translation: 用于实现感性用户界面的体系结构。 该架构包括用于控制计算机应用程序和通过手势操纵屏幕对象或手势和语言命令的组合的替代模式。 感知用户界面系统包括跟踪部件，其检测场景内的多个对象中的至少一个的对象特征，并跟踪相应的对象。 对象特征的检测至少部分地基于多个图像相对于图像的路线映射的图像比较。 基于对象特征和图像比较的存在，种子组件将跟踪组件迭代地种子化对象假设。 过滤组件基于预定的去除标准，从目标假设集合中选择性地从对象假设和/或至少一个对象假设中移除跟踪对象。