公开(公告)号：US10044790B2

公开(公告)日：2018-08-07

申请号：US13109765

申请日：2011-05-17

Applicant: Kenneth P. Hinckley ,  Andrew D. Wilson

Inventor： Kenneth P. Hinckley ,  Andrew D. Wilson

IPC: G09G5/00 ,  H04L29/08 ,  G06F3/038 ,  H04M1/725

Abstract: A unique system and method that facilitates extending input/output capabilities for resource deficient mobile devices and interactions between multiple heterogeneous devices is provided. The system and method involve an interactive surface to which the desired mobile devices can be connected. The interactive surface can provide an enhanced display space and customization controls for mobile devices that lack adequate displays and input capabilities. In addition, the interactive surface can be employed to permit communication and interaction between multiple mobile devices that otherwise are unable to interact with each other. When connected to the interactive surface, the mobile devices can share information, view information from their respective devices, and store information to the interactive surface. Furthermore, the interactive surface can resume activity states of mobile devices that were previously communicating upon re-connection to the surface.

公开(公告)号：US09560314B2

公开(公告)日：2017-01-31

申请号：US13160094

申请日：2011-06-14

Applicant: Sasa Junuzovic ,  William Thomas Blank ,  Bruce Arnold Cleary, III ,  Anoop Gupta ,  Andrew D. Wilson

Inventor： Sasa Junuzovic ,  William Thomas Blank ,  Bruce Arnold Cleary, III ,  Anoop Gupta ,  Andrew D. Wilson

IPC: H04N13/02 ,  H04N7/14 ,  G06F3/01 ,  G06F3/042 ,  G06Q10/10 ,  G01B11/24

CPC classification number: H04N7/142 ,  G01B11/24 ,  G06F3/017 ,  G06F3/0425 ,  G06F3/1454 ,  G06Q10/101 ,  H04N7/15

Abstract: The interactive and shared surface technique described herein employs hardware that can project on any surface, capture color video of that surface, and get depth information of and above the surface while preventing visual feedback (also known as video feedback, video echo, or visual echo). The technique provides N-way sharing of a surface using video compositing. It also provides for automatic calibration of hardware components, including calibration of any projector, RGB camera, depth camera and any microphones employed by the technique. The technique provides object manipulation with physical, visual, audio, and hover gestures and interaction between digital objects displayed on the surface and physical objects placed on or above the surface. It can capture and scan the surface in a manner that captures or scans exactly what the user sees, which includes both local and remote objects, drawings, annotations, hands, and so forth.

Abstract translation: 本文描述的交互式和共享表面技术采用可投影任何表面的硬件，捕获该表面的彩色视频，并获得表面上方的深度信息，同时防止视觉反馈（也称为视频反馈，视频回声或视觉回声 ）。 该技术使用视频合成来提供表面的N路共享。 它还提供硬件组件的自动校准，包括校准任何投影机，RGB摄像机，深度摄像机和该技术使用的任何麦克风。 该技术提供物体操纵，物理，视觉，音频和悬停的手势以及表面上显示的数字对象与放置在表面上或表面上的物理对象之间的交互。 它可以以捕获或扫描用户所看到的内容（包括本地和远程对象，绘图，注释，手等）的方式捕获和扫描表面。

公开(公告)号：US08847739B2

公开(公告)日：2014-09-30

申请号：US12185174

申请日：2008-08-04

Applicant: Andrew D. Wilson ,  Alex Olwal

Inventor： Andrew D. Wilson ,  Alex Olwal

IPC: H04Q5/22 ,  G08B13/14 ,  G06F3/041 ,  G09G5/00 ,  G09G5/08 ,  G06F3/033 ,  G06F3/048 ,  G06K9/32 ,  G06K9/62 ,  G06F3/046

CPC classification number: G06F3/046 ,  G06K9/32 ,  G06K9/6288 ,  H04Q2213/13095

Abstract: The claimed subject matter provides a system and/or a method that facilitates detecting and identifying objects within surface computing. An interface component can receive at least one surface input, the surface input relates to at least one of an object, a gesture, or a user. A surface detection component can detect a location of the surface input utilizing a computer vision-based sensing technique. A Radio Frequency Identification (RFID) tag can transmit a portion of RFID data, wherein the RFID tag is associated with the surface input. A Radio Frequency Identification (RFID) fusion component can utilize the portion of RFID data to identify at least one of a source of the surface input or a portion of data to associate to the surface input.

Abstract translation: 所要求保护的主题提供了一种便于在表面计算中检测和识别物体的系统和/或方法。 接口组件可以接收至少一个表面输入，表面输入涉及对象，手势或用户中的至少一个。 表面检测组件可以使用基于计算机视觉的感测技术来检测表面输入的位置。 射频识别（RFID）标签可以传送RFID数据的一部分，其中RFID标签与表面输入相关联。 射频识别（RFID）融合组件可以利用RFID数据的该部分来识别表面输入的源或与表面输入相关联的数据的一部分中的至少一个。

公开(公告)号：US20110310232A1

公开(公告)日：2011-12-22

申请号：US12819238

申请日：2010-06-21

Applicant: Andrew D. Wilson ,  Steven Bathiche

Inventor： Andrew D. Wilson ,  Steven Bathiche

IPC: G09G5/02 ,  H04N13/04

CPC classification number: G09G3/342 ,  G09G3/003 ,  H04N13/305 ,  H04N13/31 ,  H04N13/32 ,  H04N13/366 ,  H04N13/398

Abstract: Described is using a combination of which a multi-view display is provided by a combining spatial multiplexing (e.g., using a parallax barrier or lenslet), and temporal multiplexing (e.g., using a directed backlight). A scheduling algorithm generates different views by determining which light sources are illuminated at a particular time. Via the temporal multiplexing, different views may be in the same spatial viewing angle (spatial zone). Two of the views may correspond to two eyes of a person, with different video data sent to each eye to provide an autostereoscopic display for that person. Eye (head) tracking may be used to move the view or views with a person as that person moves.

Abstract translation: 描述的是通过组合空间复用（例如，使用视差屏障或小透镜）和时间复用（例如使用定向背光）提供多视点显示的组合。 调度算法通过确定在特定时间照明哪些光源来生成不同的视图。 通过时间复用，不同的视图可以在相同的空间视角（空间区域）中。 两个视图可以对应于一个人的两只眼睛，其中每个眼睛发送不同的视频数据，以为该人提供自动立体显示。 眼睛（头部）跟踪可以用于与人移动视图或视图。

公开(公告)号：US20110261083A1

公开(公告)日：2011-10-27

申请号：US12767814

申请日：2010-04-27

Applicant: Andrew D. Wilson

Inventor： Andrew D. Wilson

IPC: G09G5/00

CPC classification number: G06F3/016 ,  G06F2203/04104

Abstract: The claimed subject matter provides a system and/or a method for simulating grasping of a virtual object. Virtual 3D objects receive simulated user input forces via a 2D input surface adjacent to them. An exemplary method comprises receiving a user input corresponding to a grasping gesture that includes at least two simulated contacts with the virtual object. The grasping gesture is modeled as a simulation of frictional forces on the virtual object. A simulated physical effect on the virtual object by the frictional forces is determined. At least one microprocessor is used to display a visual image of the virtual object moving according to the simulated physical effect.

Abstract translation: 所要求保护的主题提供用于模拟虚拟对象的抓取的系统和/或方法。 虚拟3D对象通过与它们相邻的2D输入表面接收模拟的用户输入力。 一种示例性方法包括接收对应于包括与所述虚拟对象的至少两个模拟联系人的握持手势的用户输入。 把握手势被模拟为虚拟物体上的摩擦力的模拟。 确定通过摩擦力对虚拟物体的模拟物理效应。 使用至少一个微处理器来显示根据模拟物理效应移动的虚拟物体的视觉图像。

公开(公告)号：US20110254832A1

公开(公告)日：2011-10-20

申请号：US13110637

申请日：2011-05-18

Applicant: Andrew D. Wilson ,  Steven N. Bathiche

Inventor： Andrew D. Wilson ,  Steven N. Bathiche

IPC: G06F3/042 ,  G06T1/00

CPC classification number: G10H1/0025 ,  G10H1/36 ,  G10H1/383 ,  G10H2210/066 ,  G10H2210/111 ,  G10H2250/015 ,  G11B31/02

Abstract: The subject application relates to a system(s) and/or methodology that facilitate vision-based projection of any image (still or moving) onto any surface. In particular, a front-projected computer vision-based interactive surface system is provided which uses a new commercially available projection technology to obtain a compact, self-contained form factor. The subject configuration addresses installation, calibration, and portability issues that are primary concerns in most vision-based table systems. The subject application also relates to determining whether an object is touching or hovering over an interactive surface based on an analysis of a shadow image.

Abstract translation: 本申请涉及促进将任何图像（静止或移动）到任何表面上的基于视觉的投影的系统和/或方法。 特别地，提供了一种基于前投影计算机视觉的交互式表面系统，其使用新的市售投影技术来获得紧凑的，独立的形状因子。 主题配置解决了大多数基于视觉的表系统中的主要问题的安装，校准和可移植性问题。 主题应用还涉及基于阴影图像的分析来确定对象是否在交互式表面上触摸或悬停。

公开(公告)号：US20110227947A1

公开(公告)日：2011-09-22

申请号：US12725231

申请日：2010-03-16

Applicant: Hrvoje Benko ,  Shahram Izadi ,  Andrew D. Wilson ,  Daniel Rosenfeld ,  Ken Hinckley ,  Xiang Cao ,  Nicolas Villar ,  Stephen Hodges

Inventor： Hrvoje Benko ,  Shahram Izadi ,  Andrew D. Wilson ,  Daniel Rosenfeld ,  Ken Hinckley ,  Xiang Cao ,  Nicolas Villar ,  Stephen Hodges

IPC: G09G5/08 ,  G09G5/00 ,  G06F3/041 ,  G06F3/033

CPC classification number: G06F3/04883 ,  G06F3/03543 ,  G06F2203/04808

Abstract: Multi-touch user interface interaction is described. In an embodiment, an object in a user interface (UI) is manipulated by a cursor and a representation of a plurality of digits of a user. At least one parameter, which comprises the cursor location in the UI, is used to determine that multi-touch input is to be provided to the object. Responsive to this, the relative movement of the digits is analyzed and the object manipulated accordingly. In another embodiment, an object in a UI is manipulated by a representation of a plurality of digits of a user. Movement of each digit by the user moves the corresponding representation in the UI, and the movement velocity of the representation is a non-linear function of the digit's velocity. After determining that multi-touch input is to be provided to the object, the relative movement of the representations is analyzed and the object manipulated accordingly.

Abstract translation: 描述了多点触控用户界面交互。 在一个实施例中，用户界面（UI）中的对象由光标和用户的多个数字的表示来操纵。 包括UI中的光标位置的至少一个参数用于确定要向对象提供多点触摸输入。 响应于此，分析数字的相对运动，并相应地操纵对象。 在另一个实施例中，UI中的对象由用户的多个数字的表示来操纵。 用户的每个数字的移动将移动UI中的​​相应表示，并且表示的移动速度是数字速度的非线性函数。 在确定要向对象提供多点触摸输入之后，分析表示的相对运动并相应地进行操作。

公开(公告)号：US20110025601A1

公开(公告)日：2011-02-03

申请号：US12904820

申请日：2010-10-14

Applicant: Andrew D. Wilson ,  Michael J. Sinclair

Inventor： Andrew D. Wilson ,  Michael J. Sinclair

IPC: G09G5/00

CPC classification number: G06F3/017 ,  G06F3/0304 ,  G06F3/04815 ,  G06F3/04845

Abstract: Virtual controllers for visual displays are described. In one implementation, a camera captures an image of hands against a background. The image is segmented into hand areas and background areas. Various hand and finger gestures isolate parts of the background into independent areas, which are then assigned control parameters for manipulating the visual display. Multiple control parameters can be associated with attributes of multiple independent areas formed by two hands, for advanced control including simultaneous functions of clicking, selecting, executing, horizontal movement, vertical movement, scrolling, dragging, rotational movement, zooming, maximizing, minimizing, executing file functions, and executing menu choices.

Abstract translation: 描述了用于视觉显示的虚拟控制器。 在一个实现中，相机在背景上拍摄手的图像。 图像被分割为手区域和背景区域。 各种手指和手指手势将背景的一部分隔离成独立的区域，然后分配控制参数以操纵视觉显示。 多个控制参数可以与由双手形成的多个独立区域的属性相关联，用于高级控制，包括点击，选择，执行，水平移动，垂直移动，滚动，拖动，旋转移动，缩放，最大化，最小化，执行的同时功能 文件功能和执行菜单选项。

公开(公告)号：US20100313150A1

公开(公告)日：2010-12-09

申请号：US12477426

申请日：2009-06-03

Applicant: Meredith J. Morris ,  Steven N. Bathiche ,  Stephen Edward Hodges ,  Ian C. LeGrow ,  Victor Kevin Russ ,  Ian M. Sands ,  William J. Westerinen ,  John Christopher Whytock ,  Andrew D. Wilson ,  David Alexander Butler ,  Shahram Izadi

Inventor： Meredith J. Morris ,  Steven N. Bathiche ,  Stephen Edward Hodges ,  Ian C. LeGrow ,  Victor Kevin Russ ,  Ian M. Sands ,  William J. Westerinen ,  John Christopher Whytock ,  Andrew D. Wilson ,  David Alexander Butler ,  Shahram Izadi

IPC: G06F3/00

CPC classification number: G06F9/452

Abstract: The claimed subject matter relates to a display that is physically separable and to an associated architecture that can facilitate data mobility or collaboration in connection with the separable display. In particular, the separable display can be configured as an apparent unitary or singular UI for an associated multi-node computer, yet for which portion of the separable display can be physically decoupled. The multi-node computer can include a set of computing nodes, each of which can potentially operate autonomously, yet also in unison with other nodes to form a collective multiprocessor computing platform. Moreover, each of the computing nodes can be embedded in and distributed throughout the separable display. Accordingly, when a portion of the separable display is decoupled from a remainder of the separable display, both the portion and the remainder can include some subset of the computing nodes, and can therefore maintain the UI.

Abstract translation: 所要求保护的主题涉及物理上可分离的显示器以及可以促进与可分离显示器相关联的数据移动或协作的关联体系结构。 特别地，可分离显示器可以被配置为相关联的多节点计算机的明显的单一或单个UI，但是可分离显示器的哪个部分可以被物理去耦。 多节点计算机可以包括一组计算节点，每个节点可以潜在地自主地运行，而且还与其他节点一致以形成集体多处理器计算平台。 此外，每个计算节点可以嵌入并分布在可分离显示器中。 因此，当可分离显示器的一部分与可分离显示器的其余部分分离时，部分和剩余部分都可以包括计算节点的一些子集，并且因此可以维护UI。

公开(公告)号：US20100138798A1

公开(公告)日：2010-06-03

申请号：US12457656

申请日：2009-06-17

Applicant: Andrew D. Wilson ,  Nuria M. Oliver

Inventor： Andrew D. Wilson ,  Nuria M. Oliver

IPC: G06F3/033

CPC classification number: G06F3/017 ,  A63F13/211 ,  A63F13/213 ,  A63F13/42 ,  A63F13/428 ,  A63F2300/1093 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/0346 ,  G06F3/038 ,  G06K9/00335 ,  G06K9/00355 ,  G06T7/20 ,  G06T7/285 ,  G06T7/593 ,  H04N13/128 ,  H04N13/239 ,  H04N13/366 ,  H04N2013/0081

Abstract: A 3-D imaging system for recognition and interpretation of gestures to control a computer. The system includes a 3-D imaging system that performs gesture recognition and interpretation based on a previous mapping of a plurality of hand poses and orientations to user commands for a given user. When the user is identified to the system, the imaging system images gestures presented by the user, performs a lookup for the user command associated with the captured image(s), and executes the user command(s) to effect control of the computer, programs, and connected devices.

Abstract translation: 用于识别和解释手势以控制计算机的3-D成像系统。 该系统包括一个3-D成像系统，其基于对于给定用户的多个手姿势和朝向用户命令的先前映射来执行手势识别和解释。 当用户被识别到系统时，成像系统将用户呈现的姿势图像进行与所捕获的图像相关联的用户命令的查找，并且执行用户命令以实现计算机的控制， 程序和连接的设备。