公开(公告)号：US08982061B2

公开(公告)日：2015-03-17

申请号：US13099288

申请日：2011-05-02

申请人： Weidong Zhao ,  David A. Stevens ,  Aleksandar Uzelac ,  Takahiro Shigemitsu ,  Andrew David Wilson ,  Nigel Stuart Keam

发明人： Weidong Zhao ,  David A. Stevens ,  Aleksandar Uzelac ,  Takahiro Shigemitsu ,  Andrew David Wilson ,  Nigel Stuart Keam

IPC分类号： G06F3/041

CPC分类号： G06F3/041 ,  G06F3/0416 ,  G06F3/0488

摘要： In embodiments of angular contact geometry, touch input sensor data is recognized as a touch input on a touch-screen display, such as a touch-screen display integrated in a mobile phone or portable computing device. A sensor map is generated from the touch input sensor data, and the sensor map represents the touch input. The sensor map can be generated as a two-dimensional array of elements that correlate to sensed contact from a touch input. An ellipse can then be determined that approximately encompasses elements of the sensor map, and the ellipse represents a contact shape of the touch input.

摘要翻译： 在角接触几何的实施例中，触摸输入传感器数据被识别为触摸屏显示器上的触摸输入，诸如集成在移动电话或便携式计算设备中的触摸屏显示器。 从触摸输入传感器数据生成传感器图，传感器图表示触摸输入。 传感器图可以被生成为与来自触摸输入的感测到的接触相关联的元件的二维阵列。 然后可以确定大致包含传感器图的元素的椭圆，并且椭圆表示触摸输入的接触形状。

公开(公告)号：US08952894B2

公开(公告)日：2015-02-10

申请号：US12118955

申请日：2008-05-12

申请人： Andrew David Wilson

发明人： Andrew David Wilson

IPC分类号： G06F3/033 ,  G06F3/041 ,  G06F3/042 ,  G06F3/03

CPC分类号： G06F3/0428 ,  G06F3/0304 ,  G06F3/0425

摘要： The claimed subject matter provides a system and/or a method that facilitates detecting a plurality of inputs simultaneously. A laser component can be coupled to a line generating (LG) optic that can create a laser line from an infrared (IR) laser spot, wherein the laser component and line generating (LG) optic emit a plane of IR light. A camera device can capture a portion of imagery within an area covered by the plane of light. The camera device can be coupled to an IR-pass filter that can block visible light and pass IR light in order to detect a break in the emitted plane of IR light. An image processing component can ascertain a location of the break within the area covered by the emitted plane of IR light.

摘要翻译： 所要求保护的主题提供有助于同时检测多个输入的系统和/或方法。 激光器组件可以耦合到能够从红外（IR）激光点产生激光线的线路产生（LG）光学器件，其中激光器部件和线路产生（LG）光学器件发射IR平面。 相机设备可以捕获由光平面覆盖的区域内的一部分图像。 相机装置可以耦合到IR通滤波器，该滤波器可以阻挡可见光并传递IR光，以便检测发射的IR光平面中的断裂。 图像处理部件可以确定由所发射的IR光平面覆盖的区域内的断裂位置。

公开(公告)号：US08730309B2

公开(公告)日：2014-05-20

申请号：US12819230

申请日：2010-06-21

申请人： Andrew David Wilson ,  Hrvoje Benko

发明人： Andrew David Wilson ,  Hrvoje Benko

IPC分类号： H04N13/04

CPC分类号： H04N13/275 ,  G06F3/011 ,  G06F3/04815

摘要： Architecture that combines multiple depth cameras and multiple projectors to cover a specified space (e.g., a room). The cameras and projectors are calibrated, allowing the development of a multi-dimensional (e.g., 3D) model of the objects in the space, as well as the ability to project graphics in a controlled fashion on the same objects. The architecture incorporates the depth data from all depth cameras, as well as color information, into a unified multi-dimensional model in combination with calibrated projectors. In order to provide visual continuity when transferring objects between different locations in the space, the user's body can provide a canvas on which to project this interaction. As the user moves body parts in the space, without any other object, the body parts can serve as temporary “screens” for “in-transit” data.

摘要翻译： 结合多个深度摄像机和多台投影机以覆盖指定空间（例如，房间）的架构。 相机和投影仪被校准，允许开发空间中的对象的多维（例如，3D）模型，以及以相应对象的受控方式投影图形的能力。 该架构将所有深度摄像机的深度数据以及颜色信息与校准的投影机结合使用，成为统一的多维模型。 为了在空间中的不同位置之间传输对象时提供视觉连续性，用户的身体可以提供一个画布来投射这个交互。 当用户移动空间中的身体部位而没有任何其他物体时，身体部位可以作为“过境”数据的临时“屏幕”。

公开(公告)号：US20130057515A1

公开(公告)日：2013-03-07

申请号：US13227466

申请日：2011-09-07

申请人： Andrew David Wilson

发明人： Andrew David Wilson

IPC分类号： G06F3/042

CPC分类号： G06F3/0425 ,  G06F2203/04101

摘要： Architecture that employs depth sensing cameras to detect touch on a surface, such as a tabletop. The act of touching is processed using thresholds which are automatically computed from depth image data, and these thresholds are used to generate a touch image. More specifically, the thresholds (near and far, relative to the camera) are used to segment a typical finger that touches a surface. A snapshot image is captured of the scene and a surfaced histogram is computed from the snapshot over a small range of deviations at each pixel location. The near threshold (nearest to the camera) is computed based on the anthropometry of fingers and hands, and associated posture during touch. After computing the surface histogram, the far threshold values (furthest from the camera) can be stored as an image of thresholds, used in a single pass to classify all pixels in the input depth image.

摘要翻译： 使用深度感测摄像机来检测表面上的触摸（如桌面）的体系结构。 使用从深度图像数据自动计算的阈值来处理触摸动作，并且这些阈值用于生成触摸图像。 更具体地，阈值（相对于相机近和远）用于分割触摸表面的典型手指。 捕获场景的快照图像，并且在每个像素位置上的小范围偏差上从快照计算浮出的直方图。 基于手指和手的人体测量以及触摸期间的相关姿势计算近似阈值（最靠近照相机）。 在计算曲面直方图之后，可以将远的阈值（距摄像机最远的位置）存储为阈值图像，用于单次传递以对输入深度图像中的所有像素进行分类。

公开(公告)号：US08131750B2

公开(公告)日：2012-03-06

申请号：US11966914

申请日：2007-12-28

申请人： Steven N. Bathiche ,  Shai Guday ,  Zachary Lewis Russell ,  Boyd Cannon Multerer ,  Jon Marcus Randall Whitten ,  Andrew David Wilson ,  Matthew B. MacLaurin

发明人： Steven N. Bathiche ,  Shai Guday ,  Zachary Lewis Russell ,  Boyd Cannon Multerer ,  Jon Marcus Randall Whitten ,  Andrew David Wilson ,  Matthew B. MacLaurin

IPC分类号： G06F17/30 ,  G06F17/00 ,  G06F15/18 ,  A61B5/00 ,  H04N5/76

CPC分类号： G06F17/30525 ,  Y10S707/913

摘要： Systems (and corresponding methodologies) that annotate experience data in real-time are provided. The real-time annotated experience data can be employed in accordance with augmented reality systems which are capable of overlaying virtual data upon real-world data. The system employs ‘smart-tags’ that are capable of identifying data that relates to and/or is associated with the real-world scenarios and situations.

摘要翻译： 提供了实时记录体验数据的系统（和相应的方法）。 实时注释体验数据可以根据能够将虚拟数据覆盖到现实世界数据上的增强现实系统来采用。 该系统采用“智能标签”，能够识别与现实情况和情况相关的和/或与之相关的数据。

公开(公告)号：US08049719B2

公开(公告)日：2011-11-01

申请号：US12904820

申请日：2010-10-14

申请人： Andrew David Wilson ,  Michael J. Sinclair

发明人： Andrew David Wilson ,  Michael J. Sinclair

IPC分类号： G09G5/00

CPC分类号： G06F3/017 ,  G06F3/0304 ,  G06F3/04815 ,  G06F3/04845

摘要： Virtual controllers for visual displays are described. In one implementation, a camera captures an image of hands against a background. The image is segmented into hand areas and background areas. Various hand and finger gestures isolate parts of the background into independent areas, which are then assigned control parameters for manipulating the visual display. Multiple control parameters can be associated with attributes of multiple independent areas formed by two hands, for advanced control including simultaneous functions of clicking, selecting, executing, horizontal movement, vertical movement, scrolling, dragging, rotational movement, zooming, maximizing, minimizing, executing file functions, and executing menu choices.

摘要翻译： 描述了用于视觉显示的虚拟控制器。 在一个实现中，相机在背景上拍摄手的图像。 图像被分割为手区域和背景区域。 各种手和手指手势将背景的一部分隔离成独立的区域，然后分配控制参数以操纵视觉显示。 多个控制参数可以与由双手形成的多个独立区域的属性相关联，用于高级控制，包括点击，选择，执行，水平移动，垂直移动，滚动，拖动，旋转移动，缩放，最大化，最小化，执行的同时功能 文件功能和执行菜单选项。

公开(公告)号：US20110145706A1

公开(公告)日：2011-06-16

申请号：US13030577

申请日：2011-02-18

申请人： Andrew David Wilson ,  Daniel Chaim Robbins

发明人： Andrew David Wilson ,  Daniel Chaim Robbins

IPC分类号： G06F3/041

CPC分类号： G06F3/041 ,  G06F2203/04101 ,  G06F2203/04104

摘要： The present invention extends to methods, systems, and computer program products for creating virtual replicas of physical objects. A computer system detects that a portion of a physical object has come into the physical vicinity of a portion of a multi-touch input display surface. The computer system accesses object identifying data corresponding to the object. The computer system uses the object identifying data to access image data for the object from a repository of stored image data. The computer system uses the at least the accessed image data to generate a virtual replica of the object. The computer system presents the virtual replica of the object at a location on the multi-touch input display surface where the portion of the object was detected.

摘要翻译： 本发明扩展到用于创建物理对象的虚拟副本的方法，系统和计算机程序产品。 计算机系统检测物理对象的一部分已经进入多点触摸输入显示表面的一部分的物理附近。 计算机系统访问对象的对象标识数据。 计算机系统使用对象识别数据从存储的图像数据的存储库中访问对象的图像数据。 计算机系统至少使用所访问的图像数据来生成对象的虚拟副本。 计算机系统在多触摸输入显示表面上的物体的部分被检测到的位置处呈现对象的虚拟副本。

公开(公告)号：US07911453B2

公开(公告)日：2011-03-22

申请号：US11770899

申请日：2007-06-29

申请人： Andrew David Wilson ,  Daniel Chaim Robbins

发明人： Andrew David Wilson ,  Daniel Chaim Robbins

IPC分类号： G06F3/041

CPC分类号： G06F3/041 ,  G06F2203/04101 ,  G06F2203/04104

摘要： The present invention extends to methods, systems, and computer program products for creating virtual replicas of physical objects. A computer system detects that a portion of a physical object has come into the physical vicinity of a portion of a multi-touch input display surface. The computer system accesses object identifying data corresponding to the object. The computer system uses the object identifying data to access image data for the object from a repository of stored image data. The computer system uses the at least the accessed image data to generate a virtual replica of the object. The computer system presents the virtual replica of the object at a location on the multi-touch input display surface where the portion of the object was detected.

摘要翻译： 本发明扩展到用于创建物理对象的虚拟副本的方法，系统和计算机程序产品。 计算机系统检测物理对象的一部分已经进入多点触摸输入显示表面的一部分的物理附近。 计算机系统访问对象的对象标识数据。 计算机系统使用对象识别数据从存储的图像数据的存储库中访问对象的图像数据。 计算机系统至少使用所访问的图像数据来生成对象的虚拟副本。 计算机系统在多触摸输入显示表面上的物体的部分被检测到的位置处呈现对象的虚拟副本。

公开(公告)号：US20100146455A1

公开(公告)日：2010-06-10

申请号：US12705113

申请日：2010-02-12

申请人： Andrew David Wilson ,  Nuria M. Oliver

发明人： Andrew David Wilson ,  Nuria M. Oliver

IPC分类号： G06F3/048 ,  G06F3/033

CPC分类号： G06F3/017 ,  G06K9/00355

摘要： Architecture for implementing a perceptual user interface. The architecture comprises alternative modalities for controlling computer application programs and manipulating on-screen objects through hand gestures or a combination of hand gestures and verbal commands. The perceptual user interface system includes a tracking component that detects object characteristics of at least one of a plurality of objects within a scene, and tracks the respective object. Detection of object characteristics is based at least in part upon image comparison of a plurality of images relative to a course mapping of the images. A seeding component iteratively seeds the tracking component with object hypotheses based upon the presence of the object characteristics and the image comparison. A filtering component selectively removes the tracked object from the object hypotheses and/or at least one object hypothesis from the set of object hypotheses based upon predetermined removal criteria.

公开(公告)号：US20100031202A1

公开(公告)日：2010-02-04

申请号：US12185166

申请日：2008-08-04

申请人： Meredith J. Morris ,  Jacob O. Wobbrock ,  Andrew David Wilson

发明人： Meredith J. Morris ,  Jacob O. Wobbrock ,  Andrew David Wilson

IPC分类号： G06F3/03

CPC分类号： G06F3/04883 ,  G06F2203/04808

摘要： The claimed subject matter provides a system and/or a method that facilitates generating an intuitive set of gestures for employment with surface computing. A gesture set creator can prompt two or more users with a potential effect for a portion of displayed data. An interface component can receive at least one surface input from the user in response to the prompted potential effect. A surface detection component can track the surface input utilizing a computer vision-based sensing technique. The gesture set creator collects the surface input from the two or more users in order to identify a user-defined gesture based upon a correlation between the respective surface inputs, wherein the user-defined gesture is defined as an input that initiates the potential effect for the portion of displayed data.

摘要翻译： 所要求保护的主题提供了一种系统和/或方法，其有助于生成用于使用表面计算的直观手势。 手势集创建者可以提示两个或多个用户对显示的数据的一部分具有潜在的影响。 响应于所提示的潜在效应，接口组件可以接收来自用户的至少一个表面输入。 表面检测组件可以利用基于计算机视觉的感测技术跟踪表面输入。 手势集创建器收集来自两个或更多个用户的表面输入，以便基于相应表面输入之间的相关性来识别用户定义的手势，其中用户定义的手势被定义为启动潜在效果的输入 显示数据的部分。