Providing an interactive experience using a 3D depth camera and a 3D projector
    1.
    发明授权
    Providing an interactive experience using a 3D depth camera and a 3D projector 有权
    使用3D深度相机和3D投影机提供互动体验

    公开(公告)号:US09329469B2

    公开(公告)日:2016-05-03

    申请号:US13074041

    申请日:2011-03-29

    摘要: An interaction system is described which uses a depth camera to capture a depth image of a physical object placed on, or in vicinity to, an interactive surface. The interaction system also uses a video camera to capture a video image of the physical object. The interaction system can then generate a 3D virtual object based on the depth image and video image. The interaction system then uses a 3D projector to project the 3D virtual object back onto the interactive surface, e.g., in a mirrored relationship to the physical object. A user may then capture and manipulate the 3D virtual object in any manner. Further, the user may construct a composite model based on smaller component 3D virtual objects. The interaction system uses a projective texturing technique to present a realistic-looking 3D virtual object on a surface having any geometry.

    摘要翻译: 描述了一种交互系统,其使用深度相机来捕获放置在交互式表面上或附近的物理对象的深度图像。 交互系统还使用摄像机来捕获物理对象的视频图像。 然后,交互系统可以基于深度图像和视频图像生成3D虚拟对象。 交互系统然后使用3D投影仪将3D虚拟对象投影回到交互式表面上,例如与物理对象的镜像关系。 然后,用户可以以任何方式捕获和操纵3D虚拟对象。 此外,用户可以基于较小的组件3D虚拟对象来构建复合模型。 交互系统使用投影纹理技术在具有任何几何形状的表面上呈现逼真的3D虚拟对象。

    Providing an Interactive Experience Using a 3D Depth Camera and a 3D Projector
    2.
    发明申请
    Providing an Interactive Experience Using a 3D Depth Camera and a 3D Projector 有权
    使用3D深度相机和3D投影机提供互动体验

    公开(公告)号:US20120212509A1

    公开(公告)日:2012-08-23

    申请号:US13074041

    申请日:2011-03-29

    IPC分类号: G09G5/00

    摘要: An interaction system is described which uses a depth camera to capture a depth image of a physical object placed on, or in vicinity to, an interactive surface. The interaction system also uses a video camera to capture a video image of the physical object. The interaction system can then generate a 3D virtual object based on the depth image and video image. The interaction system then uses a 3D projector to project the 3D virtual object back onto the interactive surface, e.g., in a mirrored relationship to the physical object. A user may then capture and manipulate the 3D virtual object in any manner. Further, the user may construct a composite model based on smaller component 3D virtual objects. The interaction system uses a projective texturing technique to present a realistic-looking 3D virtual object on a surface having any geometry.

    摘要翻译: 描述了一种交互系统,其使用深度相机来捕获放置在交互式表面上或附近的物理对象的深度图像。 交互系统还使用摄像机来捕获物理对象的视频图像。 然后,交互系统可以基于深度图像和视频图像生成3D虚拟对象。 交互系统然后使用3D投影仪将3D虚拟对象投影回到交互式表面上,例如与物理对象的镜像关系。 然后,用户可以以任何方式捕获和操纵3D虚拟对象。 此外,用户可以基于较小的组件3D虚拟对象来构建复合模型。 交互系统使用投影纹理技术在具有任何几何形状的表面上呈现逼真的3D虚拟对象。

    Touch interaction with a curved display
    3.
    发明授权
    Touch interaction with a curved display 有权
    触摸与曲面显示的互动

    公开(公告)号:US09218116B2

    公开(公告)日:2015-12-22

    申请号:US12344377

    申请日:2008-12-26

    摘要: Touch interaction with a curved display (e.g., a sphere, a hemisphere, a cylinder, etc.) is enabled through various user interface (UI) features. In an example embodiment, a curved display is monitored to detect a touch input. If a touch input is detected based on the act of monitoring, then one or more locations of the touch input are determined. Responsive to the determined one or more locations of the touch input, at least one user UI feature is implemented. Example UI features include an orb-like invocation gesture feature, a rotation-based dragging feature, a send-to-dark-side interaction feature, and an object representation and manipulation by proxy representation feature.

    摘要翻译: 通过各种用户界面(UI)功能来实现与弯曲显示器(例如,球体,半球,圆柱体等)的触摸交互。 在示例实施例中,监视弯曲显示器以检测触摸输入。 如果基于监视动作检测到触摸输入,则确定触摸输入的一个或多个位置。 响应于所确定的触摸输入的一个或多个位置,实现了至少一个用户UI特征。 示例UI功能包括一个像球形的调用手势功能,一个基于旋转的拖动功能,一个发送到黑暗的交互功能,以及一个对象表示和代理表示功能的操纵。

    Precise selection techniques for multi-touch screens
    4.
    发明授权
    Precise selection techniques for multi-touch screens 有权
    多点触摸屏的精确选择技术

    公开(公告)号:US08619052B2

    公开(公告)日:2013-12-31

    申请号:US13295982

    申请日:2011-11-14

    IPC分类号: G06F3/041

    摘要: A unique system and method is provided that facilitates pixel-accurate targeting with respect to multi-touch sensitive displays when selecting or viewing content with a cursor. In particular, the system and method can track dual inputs from a primary finger and a secondary finger, for example. The primary finger can control movement of the cursor while the secondary finger can adjust a control-display ratio of the screen. As a result, cursor steering and selection of an assistance mode can be performed at about the same time or concurrently. In addition, the system and method can stabilize a cursor position at a top middle point of a user's finger in order to mitigate clicking errors when making a selection.

    摘要翻译: 提供了一种独特的系统和方法,其在使用光标选择或观看内容时便于针对多触点敏感显示器的像素精确定位。 特别地,系统和方法可以例如跟踪主手指和次手指的双输入。 主手指可以控制光标的移动,而辅助手指可以调节屏幕的控制显示比率。 结果,光标转向和辅助模式的选择可以在大约相同的时间或同时进行。 此外,系统和方法可以稳定用户手指的顶部中点处的光标位置,以便在进行选择时减轻点击错误。

    Touch Interaction with a Curved Display
    6.
    发明申请
    Touch Interaction with a Curved Display 有权
    触摸与曲线显示的互动

    公开(公告)号:US20100023895A1

    公开(公告)日:2010-01-28

    申请号:US12344411

    申请日:2008-12-26

    IPC分类号: G06F3/048

    摘要: Touch interaction with a curved display (e.g., a sphere, a hemisphere, a cylinder, etc.) is facilitated by preserving a predetermined orientation for objects. In an example embodiment, a curved display is monitored to detect a touch input on an object. If a touch input on an object is detected based on the monitoring, then one or more locations of the touch input are determined. The object may be manipulated responsive to the determined one or more locations of the touch input. While manipulation of the object is permitted, a predetermined orientation is preserved.

    摘要翻译: 通过保持对象的预定取向来促进与弯曲显示器(例如球体,半球,圆柱体等)的触摸交互。 在示例实施例中,监视弯曲显示器以检测对象上的触摸输入。 如果基于监视检测到物体上的触摸输入,则确定触摸输入的一个或多个位置。 可以响应于所确定的触摸输入的一个或多个位置来操纵对象。 在允许对对象的操纵的同时,保持预定的方向。

    Using physical objects in conjunction with an interactive surface
    7.
    发明授权
    Using physical objects in conjunction with an interactive surface 有权
    使用物理对象与交互式表面

    公开(公告)号:US08427424B2

    公开(公告)日:2013-04-23

    申请号:US12241281

    申请日:2008-09-30

    IPC分类号: G09G5/00 G06F3/02

    摘要: An interaction management module (IMM) is described for allowing users to engage an interactive surface in a collaborative environment using various input devices, such as keyboard-type devices and mouse-type devices. The IMM displays digital objects on the interactive surface that are associated with the devices in various ways. The digital objects can include input display interfaces, cursors, soft-key input mechanisms, and so on. Further, the IMM provides a mechanism for establishing a frame of reference for governing the placement of each cursor on the interactive surface. Further, the IMM provides a mechanism for allowing users to make a digital copy of a physical article placed on the interactive surface. The IMM also provides a mechanism which duplicates actions taken on the digital copy with respect to the physical article, and vice versa.

    摘要翻译: 描述了交互管理模块(IMM),用于允许用户使用各种输入设备(例如键盘型设备和鼠标型设备)在协作环境中参与交互式表面。 IMM以各种方式显示与设备相关联的交互式表面上的数字对象。 数字对象可以包括输入显示界面,光标,软键输入机制等。 此外,IMM提供用于建立用于管理每个光标在交互式表面上的放置的参考框架的机制。 此外,IMM提供了允许用户制作放置在交互式表面上的物理物品的数字副本的机制。 IMM还提供了一种机制,可以复制关于物理文章对数字副本采取的操作,反之亦然。

    Touch Interaction with a Curved Display
    8.
    发明申请
    Touch Interaction with a Curved Display 有权
    触摸与曲线显示的互动

    公开(公告)号:US20100020026A1

    公开(公告)日:2010-01-28

    申请号:US12344377

    申请日:2008-12-26

    IPC分类号: G06F3/041 G06F3/033

    摘要: Touch interaction with a curved display (e.g., a sphere, a hemisphere, a cylinder, etc.) is enabled through various user interface (UI) features. In an example embodiment, a curved display is monitored to detect a touch input. If a touch input is detected based on the act of monitoring, then one or more locations of the touch input are determined. Responsive to the determined one or more locations of the touch input, at least one user UI feature is implemented. Example UI features include an orb-like invocation gesture feature, a rotation-based dragging feature, a send-to-dark-side interaction feature, and an object representation and manipulation by proxy representation feature.

    摘要翻译: 通过各种用户界面(UI)功能来实现与弯曲显示器(例如,球体,半球,圆柱体等)的触摸交互。 在示例实施例中,监视弯曲显示器以检测触摸输入。 如果基于监视动作检测到触摸输入,则确定触摸输入的一个或多个位置。 响应于所确定的触摸输入的一个或多个位置,实现了至少一个用户UI特征。 示例UI功能包括一个像球形的调用手势功能,一个基于旋转的拖动功能,一个发送到黑暗的交互功能,以及一个对象表示和代理表示功能的操纵。

    Multi-Touch User Interface Interaction
    9.
    发明申请
    Multi-Touch User Interface Interaction 审中-公开
    多点触控用户界面交互

    公开(公告)号:US20110227947A1

    公开(公告)日:2011-09-22

    申请号:US12725231

    申请日:2010-03-16

    摘要: Multi-touch user interface interaction is described. In an embodiment, an object in a user interface (UI) is manipulated by a cursor and a representation of a plurality of digits of a user. At least one parameter, which comprises the cursor location in the UI, is used to determine that multi-touch input is to be provided to the object. Responsive to this, the relative movement of the digits is analyzed and the object manipulated accordingly. In another embodiment, an object in a UI is manipulated by a representation of a plurality of digits of a user. Movement of each digit by the user moves the corresponding representation in the UI, and the movement velocity of the representation is a non-linear function of the digit's velocity. After determining that multi-touch input is to be provided to the object, the relative movement of the representations is analyzed and the object manipulated accordingly.

    摘要翻译: 描述了多点触控用户界面交互。 在一个实施例中,用户界面(UI)中的对象由光标和用户的多个数字的表示来操纵。 包括UI中的光标位置的至少一个参数用于确定要向对象提供多点触摸输入。 响应于此,分析数字的相对运动,并相应地操纵对象。 在另一个实施例中,UI中的对象由用户的多个数字的表示来操纵。 用户的每个数字的移动将移动UI中的​​相应表示,并且表示的移动速度是数字速度的非线性函数。 在确定要向对象提供多点触摸输入之后,分析表示的相对运动并相应地进行操作。