公开(公告)号：US20100027843A1

公开(公告)日：2010-02-04

申请号：US12490327

申请日：2009-06-24

Applicant: Andrew D. Wilson

Inventor： Andrew D. Wilson

IPC: G06K9/00

CPC classification number: G06F3/0425 ,  G06F3/04883

Abstract: Disclosed is a unique system and method that facilitates gesture-based interaction with a user interface. The system involves an object sensing configured to include a sensing plane vertically or horizontally located between at least two imaging components on one side and a user on the other. The imaging components can acquire input images taken of a view of and through the sensing plane. The images can include objects which are on the sensing plane and/or in the background scene as well as the user as he interacts with the sensing plane. By processing the input images, one output image can be returned which shows the user objects that are in contact with the plane. Thus, objects located at a particular depth can be readily determined. Any other objects located beyond can be “removed” and not seen in the output image.

Abstract translation: 公开了一种促进与用户界面的基于手势的交互的独特的系统和方法。 该系统涉及被配置为包括垂直或水平位于一侧的至少两个成像组件与另一侧上的用户之间的感测平面的物体感测。 成像组件可以获取通过感测平面拍摄的输入图像。 图像可以包括在感测平面和/或背景场景以及用户与感测平面交互的物体。 通过处理输入图像，可以返回一个输出图像，显示与飞机接触的用户对象。 因此，可以容易地确定位于特定深度的物体。 位于超出的任何其他对象可以被“删除”，并且在输出图像中看不到。

公开(公告)号：US07626572B2

公开(公告)日：2009-12-01

申请号：US11454677

申请日：2006-06-15

Applicant: Patrick Baudisch ,  Andrew D. Wilson ,  Michael J. Sinclair

Inventor： Patrick Baudisch ,  Andrew D. Wilson ,  Michael J. Sinclair

IPC: G09G5/08

CPC classification number: G06F3/0346 ,  G06F3/0317

Abstract: A new mobile electronic device, referred to as a soap, may be used to control electronic devices, external or internal to the soap, in an intuitive, convenient, and comfortable manner. For example, a soap may serve as an alternative to input devices such as a mouse. A soap device may include a core, and a hull that at least partially encloses the core. The core includes a tracking component capable of tracking movement relative to the hull. The soap input device also includes a transmission component configured to transmit a signal from the tracking component to a computing device, where it may control the position of a pointer and the use of a selector on a monitor. The hull may be soft and flexible, the core may be freely rotatable about at least one axis. The core has a shape such that tangentially applied pressure rotates the core relative to the hull. A user may therefore control an electronic device, simply by rolling and manipulating the soap.

Abstract translation: 称为肥皂的新的移动电子设备可以用于以直观，方便和舒适的方式控制肥皂外部或内部的电子设备。 例如，肥皂可以用作输入诸如鼠标的装置的替代物。 肥皂装置可以包括芯部和至少部分地包围芯部的壳体。 核心包括能够跟踪相对于船体运动的跟踪部件。 肥皂输入装置还包括被配置为将信号从跟踪部件发送到计算装置的传输部件，其中它可以控制指示器的位置和在监视器上使用选择器。 所述船体可以是软的和柔性的，所述芯可以绕至少一个轴线自由旋转。 该芯具有使切向施加的压力相对于船体旋转芯的形状。 因此，用户可以简单地通过滚动和操纵肥皂来控制电子设备。

公开(公告)号：US20090208057A1

公开(公告)日：2009-08-20

申请号：US12428492

申请日：2009-04-23

Applicant: Andrew D. Wilson ,  Michael J. Sinclair

Inventor： Andrew D. Wilson ,  Michael J. Sinclair

IPC: G06K9/00

CPC classification number: G06F3/017 ,  G06F3/0304 ,  G06F3/04815 ,  G06F3/04845

Abstract: Virtual controllers for visual displays are described. In one implementation, a camera captures an image of hands against a background. The image is segmented into hand areas and background areas. Various hand and finger gestures isolate parts of the background into independent areas, which are then assigned control parameters for manipulating the visual display. Multiple control parameters can be associated with attributes of multiple independent areas formed by two hands, for advanced control including simultaneous functions of clicking, selecting, executing, horizontal movement, vertical movement, scrolling, dragging, rotational movement, zooming, maximizing, minimizing, executing file functions, and executing menu choices.

Abstract translation: 描述了用于视觉显示的虚拟控制器。 在一个实现中，相机在背景上拍摄手的图像。 图像被分割为手区域和背景区域。 各种手指和手指手势将背景的一部分隔离成独立的区域，然后分配控制参数以操纵视觉显示。 多个控制参数可以与由双手形成的多个独立区域的属性相关联，用于高级控制，包括点击，选择，执行，水平移动，垂直移动，滚动，拖动，旋转移动，缩放，最大化，最小化，执行的同时功能 文件功能和执行菜单选项。

公开(公告)号：US20090002344A1

公开(公告)日：2009-01-01

申请号：US12210041

申请日：2008-09-12

Applicant: Andrew D. Wilson ,  Dawson L. Yee

Inventor： Andrew D. Wilson ,  Dawson L. Yee

IPC: G06F3/041

CPC classification number: G06F3/0418 ,  G06F3/0425

Abstract: In an interactive display system, a projected image on a display surface and a vision system used to detect objects touching the display surface are aligned, and optical distortion of the vision system is compensated. Also, calibration procedures correct for a non-uniformity of infrared (IR) illumination of the display surface by IR light sources and establish a touch threshold for one or more uses so that the interactive display system correctly responds to each user touching the display surface. A movable IR camera filter enables automation of the alignment of the projected image and the image of the display surface and help in detecting problems in either the projector or vision system.

Abstract translation: 在交互式显示系统中，显示面上的投影图像和用于检测触摸显示面的物体的视觉系统被对准，视觉系统的光学失真被补偿。 此外，校准程序通过IR光源校正显示表面的红外（IR）照明的不均匀性并且建立用于一个或多个用途的触摸阈值，使得交互式显示系统正确地响应于触摸显示表面的每个用户。 可移动的红外相机滤镜可实现投影图像和显示表面图像的对准自动化，并有助于检测投影机或视觉系统中的问题。

公开(公告)号：US07432917B2

公开(公告)日：2008-10-07

申请号：US10870779

申请日：2004-06-16

Applicant: Andrew D. Wilson ,  Dawson L. Yee

Inventor： Andrew D. Wilson ,  Dawson L. Yee

IPC: G06F3/042

CPC classification number: G06F3/0418 ,  G06F3/0425

Abstract: In an interactive display system, a projected image on a display surface and a vision system used to detect objects touching the display surface are aligned, and optical distortion of the vision system is compensated. Also, calibration procedures correct for a non-uniformity of infrared (IR) illumination of the display surface by IR light sources and establish a touch threshold for one or more uses so that the interactive display system correctly responds to each user touching the display surface. A movable IR camera filter enables automation of the alignment of the projected image and the image of the display surface and help in detecting problems in either the projector or vision system.

Abstract translation: 在交互式显示系统中，显示面上的投影图像和用于检测触摸显示面的物体的视觉系统被对准，视觉系统的光学失真被补偿。 此外，校准程序通过IR光源校正显示表面的红外（IR）照明的不均匀性并且建立用于一个或多个用途的触摸阈值，使得交互式显示系统正确地响应于触摸显示表面的每个用户。 可移动的红外相机滤镜可实现投影图像和显示表面图像的对准自动化，并有助于检测投影机或视觉系统中的问题。

公开(公告)号：US20080214233A1

公开(公告)日：2008-09-04

申请号：US11839279

申请日：2007-08-15

Applicant: Andrew D. Wilson ,  Raman K. Sarin ,  Kenneth P. Hinckley

Inventor： Andrew D. Wilson ,  Raman K. Sarin ,  Kenneth P. Hinckley

IPC: H04M1/00

CPC classification number: H04W4/008 ,  H04M1/7253 ,  H04M2250/02 ,  H04W4/80

Abstract: A mobile device connection system is provided. The system includes an input medium to detect a device position or location. An analysis component determines a device type and establishes a connection with the device. The input medium can include vision systems to detect device presence and location where connections are established via wireless technologies.

Abstract translation: 提供移动设备连接系统。 该系统包括用于检测设备位置或位置的输入介质。 分析组件确定设备类型并建立与设备的连接。 输入介质可以包括用于检测设备存在的视觉系统和通过无线技术建立连接的位置。

公开(公告)号：US07394459B2

公开(公告)日：2008-07-01

申请号：US10834675

申请日：2004-04-29

Applicant: Steven Bathiche ,  David Joshua Kurlander ,  Andrew D. Wilson ,  Christina Summer Chen ,  Joel P. Dehlin

Inventor： Steven Bathiche ,  David Joshua Kurlander ,  Andrew D. Wilson ,  Christina Summer Chen ,  Joel P. Dehlin

IPC: G06F3/042 ,  G06F3/01

CPC classification number: A63F13/65 ,  A63F3/00643 ,  A63F9/183 ,  A63F13/00 ,  A63F13/213 ,  A63F2300/1075 ,  A63F2300/1087 ,  A63F2300/69 ,  G06F3/011 ,  G06F3/016 ,  G06F3/0425 ,  G06F3/04815

Abstract: An interactive table has a display surface on which a physical object is disposed. A camera within the interactive table responds to infrared (IR) light reflected from the physical object enabling a location of the physical object on the display surface to be determined, so that the physical object appear part of a virtual environment displayed thereon. The physical object can be passive or active. An active object performs an active function, e.g., it can be self-propelled to move about on the display surface, or emit light or sound, or vibrate. The active object can be controlled by a user or the processor. The interactive table can project an image through a physical object on the display surface so the image appears part of the object. A virtual entity is preferably displayed at a position (and a size) to avoid visually interference with any physical object on the display surface.

Abstract translation: 交互式表具有设置有物体的显示面。 交互式表中的相机响应于从物理对象反射的红外（IR）光，从而能够确定显示表面上的物理对象的位置，使得物理对象显示在其上显示的虚拟环境的一部分。 物理对象可以是被动的或主动的。 活动对象执行主动功能，例如，其可以自推进在显示表面上移动，或发出光或声音或振动。 活动对象可由用户或处理器控制。 交互式表格可以通过显示表面上的物理对象投影图像，从而将图像显示在对象的一部分中。 虚拟实体优选地在位置（和尺寸）处显示，以避免与显示表面上的任何物理对象的视觉干扰。

公开(公告)号：US07204428B2

公开(公告)日：2007-04-17

申请号：US10814577

申请日：2004-03-31

Applicant: Andrew D. Wilson

Inventor： Andrew D. Wilson

IPC: G06K19/06

CPC classification number: G06K19/06009 ,  G06K7/1095 ,  G06K9/3216 ,  G06K19/06131 ,  G06K19/06168

Abstract: A coded pattern applied to an object is identified when the object is placed on a display surface of an interactive display. The coded pattern is detected in an image of the display surface produced in response to reflected infrared (IR) light received from the coded pattern by an IR video camera disposed on an opposite side of the display surface from the object. The coded pattern can be either a circular, linear, matrix, variable bit length matrix, multi-level matrix, black/white (binary), or gray scale pattern. The coded pattern serves as an identifier of the object and includes a cue component and a code portion disposed in a predefined location relative to the cue component. A border region encompasses the cue component and the code portion and masks undesired noise that might interfere with decoding the code portion.

Abstract translation: 当对象被放置在交互式显示器的显示表面上时，识别应用于对象的编码图案。 编码图案在响应于从被配置在显示表面的与物体相对的一侧的IR摄像机从编码图案接收的反射红外线（IR）光产生的显示表面的图像中被检测。 编码图案可以是圆形，线性，矩阵，可变比特长矩阵，多级矩阵，黑/白（二进制）或灰度级图案。 编码图案用作对象的标识符，并且包括相对于提示组件设置在预定位置的提示组件和代码部分。 边界区域包含提示部件和代码部分，并且掩蔽可能干扰解码代码部分的不期望的噪声。

公开(公告)号：US09939888B2

公开(公告)日：2018-04-10

申请号：US13233018

申请日：2011-09-15

Applicant: Andrew D. Wilson ,  Hrvoje Benko

Inventor： Andrew D. Wilson ,  Hrvoje Benko

IPC: G06F3/033 ,  G06F3/01 ,  G06K9/00 ,  G06F1/16 ,  G06F3/03 ,  G06F3/038 ,  G06F3/0346

CPC classification number: G06F3/011 ,  G06F1/1694 ,  G06F3/014 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0346 ,  G06F3/038 ,  G06K9/00335

Abstract: A system is described herein which receives internal-assessed (IA) movement information from a mobile device. The system also receives external-assessed (EA) movement information from at least one monitoring system which captures a scene containing the mobile device. The system then compares the IA movement information with the EA movement information with respect to each candidate object in the scene. If the IA movement information matches the EA movement information for a particular candidate object, the system concludes that the candidate object is associated with the mobile device. For example, the object may correspond to a hand that holds the mobile device. The system can use the correlation results produced in the above-indicated manner to perform various environment-specific actions.

公开(公告)号：US09740364B2

公开(公告)日：2017-08-22

申请号：US12772864

申请日：2010-05-03

Applicant: Andrew D. Wilson

Inventor： Andrew D. Wilson

IPC: G06F3/033 ,  G06F3/0481 ,  G06F3/0485 ,  G06F3/0488

CPC classification number: G06F3/04812 ,  G06F3/0481 ,  G06F3/04855 ,  G06F3/0488 ,  G06F2203/04808

Abstract: Different techniques of processing user interactions with a computing system are described. In one implementation, an interactive display is configured to depict a graphical user interface which includes a plurality of different types of user interface elements (e.g., button-type element, scroll bar-type element). A user may use one or more user input object (e.g., finger, hand, stylus) to simultaneously interact with the interactive display. A plurality of different user input processing methods are used to process user inputs received by the graphical user interface differently and in accordance with the types of the user interface elements which are displayed. The processing of the user inputs is implemented to determine whether the user inputs control the respective user interface elements. The processing may determine whether the user inputs activate and/or manipulate the displayed user interface elements in but one example.