公开(公告)号：US07692627B2

公开(公告)日：2010-04-06

申请号：US10914923

申请日：2004-08-10

Applicant: Andrew D Wilson

Inventor： Andrew D Wilson

IPC: G06G5/00

CPC classification number: G06F1/169 ,  G06F1/1616 ,  G06F1/1686 ,  G06F3/0416 ,  G06F3/0425 ,  G06F3/044 ,  G06F3/04883

Abstract: Disclosed is a unique system and method that facilitates cursor control based in part on computer vision activated by a capacitive touch sensor. When turned on, user hand gestures or movements can be tracked by a monitoring component and those movements can be converted in real-time to control or drive cursor movements and/or position on a user interface. The system comprises a monitoring component or camera that can be activated by touch or pressure applied to a capacitive touch sensor. A circuit within the sensor determines when the user is touching a button (e.g., on keyboard or mouse) that activates the monitoring component and cursor control mechanism. Thus, intentional hand movements by the user can readily be determined.

Abstract translation: 公开了一种独特的系统和方法，其有助于基于由电容式触摸传感器激活的计算机视觉的光标控制。 当打开时，用户的手势或动作可以由监视组件跟踪，并且可以实时地转换这些动作来控制或驱动光标移动和/或在用户界面上的位置。 该系统包括可通过触摸或施加到电容式触摸传感器的压力来激活的监视部件或照相机。 传感器内的电路确定用户何时触摸激活监视组件和光标控制机制的按钮（例如，键盘或鼠标）。 因此，可以容易地确定用户的有意的手的移动。

公开(公告)号：US07605804B2

公开(公告)日：2009-10-20

申请号：US11119504

申请日：2005-04-29

Applicant: Andrew D. Wilson

Inventor： Andrew D. Wilson

IPC: G06F3/041 ,  G06F3/048

CPC classification number: G06F3/0488

Abstract: A system to position an element on a visual display is provided. The disclosed system comprises a touch detection module that detects a touch upon a touch-sensitive surface of a visual display. Also included is a position module that receives input from the touch detection module to derive a position of a touch. Further, an offset module derives an offset for an element of a user interface. Methods of using this system are also provided.

Abstract translation: 提供了将元件定位在视觉显示器上的系统。 所公开的系统包括检测视觉显示器的触敏表面上的触摸的触摸检测模块。 还包括位置模块，其接收来自触摸检测模块的输入以导出触摸的位置。 此外，偏移模块导出用户界面的元素的偏移量。 还提供了使用该系统的方法。

公开(公告)号：US07599561B2

公开(公告)日：2009-10-06

申请号：US11363750

申请日：2006-02-28

Applicant: Andrew D. Wilson ,  Steven Bathiche

Inventor： Andrew D. Wilson ,  Steven Bathiche

IPC: G06K9/48 ,  G06K9/32

CPC classification number: G03B29/00 ,  G03B21/008 ,  G06F3/0425

Abstract: The subject application relates to a system(s) and/or methodology that facilitate vision-based projection of any image (still or moving) onto any surface. In particular, a front-projected computer vision-based interactive surface system is provided which uses a new commercially available projection technology to obtain a compact, self-contained form factor. The subject configuration addresses installation, calibration, and portability issues that are primary concerns in most vision-based table systems.

Abstract translation: 本申请涉及促进将任何图像（静止或移动）到任何表面上的基于视觉的投影的系统和/或方法。 特别地，提供了一种基于前投影计算机视觉的交互式表面系统，其使用新的市售投影技术来获得紧凑的，独立的形状因子。 主题配置解决了大多数基于视觉的表系统中的主要问题的安装，校准和可移植性问题。

公开(公告)号：US09939888B2

公开(公告)日：2018-04-10

申请号：US13233018

申请日：2011-09-15

Applicant: Andrew D. Wilson ,  Hrvoje Benko

Inventor： Andrew D. Wilson ,  Hrvoje Benko

IPC: G06F3/033 ,  G06F3/01 ,  G06K9/00 ,  G06F1/16 ,  G06F3/03 ,  G06F3/038 ,  G06F3/0346

CPC classification number: G06F3/011 ,  G06F1/1694 ,  G06F3/014 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0346 ,  G06F3/038 ,  G06K9/00335

Abstract: A system is described herein which receives internal-assessed (IA) movement information from a mobile device. The system also receives external-assessed (EA) movement information from at least one monitoring system which captures a scene containing the mobile device. The system then compares the IA movement information with the EA movement information with respect to each candidate object in the scene. If the IA movement information matches the EA movement information for a particular candidate object, the system concludes that the candidate object is associated with the mobile device. For example, the object may correspond to a hand that holds the mobile device. The system can use the correlation results produced in the above-indicated manner to perform various environment-specific actions.

公开(公告)号：US09740364B2

公开(公告)日：2017-08-22

申请号：US12772864

申请日：2010-05-03

Applicant: Andrew D. Wilson

Inventor： Andrew D. Wilson

IPC: G06F3/033 ,  G06F3/0481 ,  G06F3/0485 ,  G06F3/0488

CPC classification number: G06F3/04812 ,  G06F3/0481 ,  G06F3/04855 ,  G06F3/0488 ,  G06F2203/04808

Abstract: Different techniques of processing user interactions with a computing system are described. In one implementation, an interactive display is configured to depict a graphical user interface which includes a plurality of different types of user interface elements (e.g., button-type element, scroll bar-type element). A user may use one or more user input object (e.g., finger, hand, stylus) to simultaneously interact with the interactive display. A plurality of different user input processing methods are used to process user inputs received by the graphical user interface differently and in accordance with the types of the user interface elements which are displayed. The processing of the user inputs is implemented to determine whether the user inputs control the respective user interface elements. The processing may determine whether the user inputs activate and/or manipulate the displayed user interface elements in but one example.

公开(公告)号：US09329469B2

公开(公告)日：2016-05-03

申请号：US13074041

申请日：2011-03-29

Applicant: Hrvoje Benko ,  Ricardo Jorge Jota Costa ,  Andrew D. Wilson

Inventor： Hrvoje Benko ,  Ricardo Jorge Jota Costa ,  Andrew D. Wilson

IPC: G06T19/00 ,  G03B35/00 ,  G06F3/01 ,  G06F3/033 ,  G02B27/01 ,  H04N13/00 ,  H04N13/02

CPC classification number: G03B35/00 ,  G02B27/017 ,  G06F3/01 ,  G06F3/033 ,  G06T19/006 ,  H04N13/156 ,  H04N13/275

Abstract: An interaction system is described which uses a depth camera to capture a depth image of a physical object placed on, or in vicinity to, an interactive surface. The interaction system also uses a video camera to capture a video image of the physical object. The interaction system can then generate a 3D virtual object based on the depth image and video image. The interaction system then uses a 3D projector to project the 3D virtual object back onto the interactive surface, e.g., in a mirrored relationship to the physical object. A user may then capture and manipulate the 3D virtual object in any manner. Further, the user may construct a composite model based on smaller component 3D virtual objects. The interaction system uses a projective texturing technique to present a realistic-looking 3D virtual object on a surface having any geometry.

Abstract translation: 描述了一种交互系统，其使用深度相机来捕获放置在交互式表面上或附近的物理对象的深度图像。 交互系统还使用摄像机来捕获物理对象的视频图像。 然后，交互系统可以基于深度图像和视频图像生成3D虚拟对象。 交互系统然后使用3D投影仪将3D虚拟对象投影回到交互式表面上，例如与物理对象的镜像关系。 然后，用户可以以任何方式捕获和操纵3D虚拟对象。 此外，用户可以基于较小的组件3D虚拟对象来构建复合模型。 交互系统使用投影纹理技术在具有任何几何形状的表面上呈现逼真的3D虚拟对象。

公开(公告)号：US08954330B2

公开(公告)日：2015-02-10

申请号：US13305429

申请日：2011-11-28

Applicant: Michael F. Koenig ,  Oscar Enrique Murillo ,  Ira Lynn Snyder, Jr. ,  Andrew D. Wilson ,  Kenneth P. Hinckley ,  Ali M. Vassigh

Inventor： Michael F. Koenig ,  Oscar Enrique Murillo ,  Ira Lynn Snyder, Jr. ,  Andrew D. Wilson ,  Kenneth P. Hinckley ,  Ali M. Vassigh

IPC: G10L21/10 ,  G06F17/27 ,  G10L21/00

CPC classification number: G10L21/10 ,  G06F17/27 ,  G06F17/271 ,  G06Q10/10 ,  G10L21/00

Abstract: The subject disclosure is directed towards detecting symbolic activity within a given environment using a context-dependent grammar. In response to receiving sets of input data corresponding to one or more input modalities, a context-aware interactive system processes a model associated with interpreting the symbolic activity using context data for the given environment. Based on the model, related sets of input data are determined. The context-aware interactive system uses the input data to interpret user intent with respect to the input and thereby, identify one or more commands for a target output mechanism.

Abstract translation: 本发明涉及使用上下文相关语法在给定环境内检测符号活动。 响应于对应于一个或多个输入模态的接收输入数据集，上下文感知交互系统使用用于给定环境的上下文数据来处理与解释符号活动相关联的模型。 基于该模型，确定相关的输入数据集。 上下文感知交互系统使用输入数据来解释用户对输入的意图，从而识别用于目标输出机制的一个或多个命令。

公开(公告)号：US08933912B2

公开(公告)日：2015-01-13

申请号：US13437461

申请日：2012-04-02

Applicant: Anthony J. Ambrus ,  Abdulwajid N. Mohamed ,  Andrew D. Wilson ,  Brian J. Mount ,  Jordan D. Andersen

Inventor： Anthony J. Ambrus ,  Abdulwajid N. Mohamed ,  Andrew D. Wilson ,  Brian J. Mount ,  Jordan D. Andersen

IPC: G06F3/042

CPC classification number: G06F3/005 ,  G01S17/89 ,  G02B27/0093 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/012 ,  G06F3/017 ,  G06F3/042 ,  G06F3/0425 ,  G06F3/0426 ,  G06F3/04883

Abstract: A system and method are disclosed for providing a touch interface for electronic devices. The touch interface can be any surface. As one example, a table top can be used as a touch sensitive interface. In one embodiment, the system determines a touch region of the surface, and correlates that touch region to a display of an electronic device for which input is provided. The system may have a 3D camera that identifies the relative position of a user's hands to the touch region to allow for user input. Note that the user's hands do not occlude the display. The system may render a representation of the user's hand on the display in order for the user to interact with elements on the display screen.

Abstract translation: 公开了一种用于为电子设备提供触摸界面的系统和方法。 触摸界面可以是任何表面。 作为一个示例，桌面可以用作触敏界面。 在一个实施例中，系统确定表面的触摸区域，并将该触摸区域与提供输入的电子设备的显示器相关联。 系统可以具有3D摄像机，其识别用户的手与触摸区域的相对位置以允许用户输入。 请注意，用户的手不要遮挡显示屏。 系统可以在显示器上呈现用户的手的表示，以便用户与显示屏上的元素交互。

公开(公告)号：US08745541B2

公开(公告)日：2014-06-03

申请号：US10724950

申请日：2003-12-01

Applicant: Andrew D. Wilson ,  Nuria M. Oliver

Inventor： Andrew D. Wilson ,  Nuria M. Oliver

IPC: G06F3/01 ,  G06F3/033 ,  G06F3/048 ,  G06F3/042 ,  G06K9/00

CPC classification number: G06F3/017 ,  A63F13/211 ,  A63F13/213 ,  A63F13/42 ,  A63F13/428 ,  A63F2300/1093 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/0346 ,  G06F3/038 ,  G06K9/00335 ,  G06K9/00355 ,  G06T7/20 ,  G06T7/285 ,  G06T7/593 ,  H04N13/128 ,  H04N13/239 ,  H04N13/366 ,  H04N2013/0081

Abstract: A 3-D imaging system for recognition and interpretation of gestures to control a computer. The system includes a 3-D imaging system that performs gesture recognition and interpretation based on a previous mapping of a plurality of hand poses and orientations to user commands for a given user. When the user is identified to the system, the imaging system images gestures presented by the user, performs a lookup for the user command associated with the captured image(s), and executes the user command(s) to effect control of the computer, programs, and connected devices.

Abstract translation: 用于识别和解释手势以控制计算机的3-D成像系统。 该系统包括一个3-D成像系统，其基于对于给定用户的多个手姿势和朝向用户命令的先前映射来执行手势识别和解释。 当用户被识别到系统时，成像系统将用户呈现的姿势图像进行与所捕获的图像相关联的用户命令的查找，并且执行用户命令以实现计算机的控制， 程序和连接的设备。

公开(公告)号：US08670632B2

公开(公告)日：2014-03-11

申请号：US13421600

申请日：2012-03-15

Applicant: Andrew D. Wilson

Inventor： Andrew D. Wilson

IPC: G06K9/40 ,  G06F3/045

CPC classification number: G06F3/0421 ,  G06K9/00375 ,  H04N5/2256 ,  H04N5/33

Abstract: Effects of undesired infrared light are reduced in an imaging system using an infrared light source. The desired infrared light source is activated and a first set of imaging data is captured during a first image capture interval. The desired infrared light source is then deactivated, and a second set of image data is captured during a second image capture interval. A composite set of image data is then generated by subtracting from first values in the first set of image data corresponding second values in the second set of image data. The composite set of image data thus includes a set of imaging where data all infrared signals are collected, including both signals resulting from the IR source and other IR signals, from which is subtracted imaging in which no signals result from the IR course, leaving image data including signals resulting only from the IR source.

Abstract translation: 在使用红外光源的成像系统中，不期望的红外光的影响降低。 期望的红外光源被激活，并且在第一图像捕获间隔期间捕获第一组成像数据。 然后停用期望的红外光源，并且在第二图像捕获间隔期间捕获第二组图像数据。 然后通过从第二组图像数据中的第一组图像数据中的第一值中减去第二组图像数据中的第二值来生成复合图像数据集合。 因此，复合图像数据集合包括一组成像，其中收集所有红外信号的数据，包括由IR源和其它IR信号产生的两个信号，从该IR成像中减去没有信号来自IR过程的图像，留下图像 数据包括仅从IR源产生的信号。