公开(公告)号：US09823764B2

公开(公告)日：2017-11-21

申请号：US14559870

申请日：2014-12-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Mark Schwesinger ,  Tommer Leyvand ,  Szymon Stachniak

IPC: A63F13/213 ,  G06F3/041 ,  G06F3/01 ,  G02B27/01 ,  G06F3/00 ,  G06F3/0481 ,  G06F3/0488 ,  G06F3/16 ,  H04N13/02 ,  G06F3/03

CPC classification number: G06F3/0412 ,  G02B27/017 ,  G02B2027/0178 ,  G06F3/005 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/04815 ,  G06F3/0488 ,  G06F3/167 ,  G06F2203/012 ,  G06F2203/04101 ,  G06F2203/04106 ,  G06F2203/04808 ,  G06F2206/20 ,  H04N13/271

Abstract: A method to identify a targeted object based on eye tracking and gesture recognition. The method is enacted in a compute system controlled by a user and operatively coupled to a machine vision system. In this method, the compute system receives, from the machine vision system, video imaging a head and pointer of the user. Based on the video, the compute system computes a geometric line of sight of the user, which is partly occluded by the pointer. Then, with reference to position data for one or more objects, the compute system identifies the targeted object, situated along the geometric line of sight.

公开(公告)号：US09423939B2

公开(公告)日：2016-08-23

申请号：US13674793

申请日：2012-11-12

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Mark Schwesinger ,  Oscar Murillo ,  Emily Yang ,  Richard Bailey ,  Jay Kapur

IPC: G06F3/0484 ,  G06F3/01 ,  G06F3/03 ,  A63F13/20

CPC classification number: G06F3/012 ,  A63F13/06 ,  A63F13/21 ,  A63F2300/1087 ,  A63F2300/308 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0484 ,  G06F3/04845 ,  G06F3/0488 ,  G06F3/167 ,  G06F9/451 ,  G06F2203/04806 ,  G06T7/73

Abstract: Embodiments related to dynamically adjusting a user interface based upon depth information are disclosed. For example, one disclosed embodiment provides a method including receiving depth information of a physical space from a depth camera, locating a user within the physical space from the depth information, determining a distance between the user and a display device from the depth information, and adjusting one or more features of a user interface displayed on the display device based on the distance.

Abstract translation: 公开了基于深度信息动态调整用户界面的实施例。 例如，一个公开的实施例提供了一种方法，包括从深度相机接收物理空间的深度信息，从深度信息定位物理空间内的用户，从深度信息确定用户和显示设备之间的距离，以及 基于该距离来调整在显示装置上显示的用户界面的一个或多个特征。

公开(公告)号：US20160162082A1

公开(公告)日：2016-06-09

申请号：US14559870

申请日：2014-12-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Mark Schwesinger ,  Tommer Leyvand ,  Szymon Stachniak

IPC: G06F3/041 ,  G06F3/16 ,  H04N13/02 ,  G06F3/0488 ,  G06F3/0481 ,  G02B27/01 ,  G06F3/01 ,  G06F3/00

CPC classification number: G06F3/0412 ,  G02B27/017 ,  G02B2027/0178 ,  G06F3/005 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/04815 ,  G06F3/0488 ,  G06F3/167 ,  G06F2203/012 ,  G06F2203/04101 ,  G06F2203/04106 ,  G06F2203/04808 ,  G06F2206/20 ,  H04N13/271

Abstract: A method to identify a targeted object based on eye tracking and gesture recognition. The method is enacted in a compute system controlled by a user and operatively coupled to a machine vision system. In this method, the compute system receives, from the machine vision system, video imaging a head and pointer of the user. Based on the video, the compute system computes a geometric line of sight of the user, which is partly occluded by the pointer. Then, with reference to position data for one or more objects, the compute system identifies the targeted object, situated along the geometric line of sight.

Abstract translation: 基于眼睛跟踪和手势识别来识别目标对象的方法。 该方法在由用户控制并且可操作地耦合到机器视觉系统的计算系统中实现。 在该方法中，计算系统从机器视觉系统接收用户的头部和指针的视频成像。 基于视频，计算系统计算用户的几何视线，其被指针部分遮挡。 然后，参考一个或多个对象的位置数据，计算系统识别沿着几何视线位于的目标对象。

公开(公告)号：US10394314B2

公开(公告)日：2019-08-27

申请号：US15227871

申请日：2016-08-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Mark Schwesinger ,  Oscar Murillo ,  Emily Yang ,  Richard Bailey ,  Jay Kapur

IPC: G06F3/01 ,  G06F3/0484 ,  A63F13/21 ,  G06F3/03 ,  A63F13/20 ,  G06F3/0488 ,  G06F3/16 ,  G06T7/73 ,  G06F9/451

Abstract: Embodiments related to dynamically adjusting a user interface based upon depth information are disclosed. For example, one disclosed embodiment provides a method including receiving depth information of a physical space from a depth camera, locating a user within the physical space from the depth information, determining a distance between the user and a display device from the depth information, and adjusting one or more features of a user interface displayed on the display device based on the distance.

公开(公告)号：US20160342203A1

公开(公告)日：2016-11-24

申请号：US15227871

申请日：2016-08-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Mark Schwesinger ,  Oscar Murillo ,  Emily Yang ,  Richard Bailey ,  Jay Kapur

IPC: G06F3/01 ,  G06F9/44 ,  G06F3/03 ,  G06F3/16 ,  G06F3/0484 ,  G06F3/0488 ,  G06T7/00

CPC classification number: G06F3/012 ,  A63F13/06 ,  A63F13/21 ,  A63F2300/1087 ,  A63F2300/308 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0484 ,  G06F3/04845 ,  G06F3/0488 ,  G06F3/167 ,  G06F9/451 ,  G06F2203/04806 ,  G06T7/73

Abstract: Embodiments related to dynamically adjusting a user interface based upon depth information are disclosed. For example, one disclosed embodiment provides a method including receiving depth information of a physical space from a depth camera, locating a user within the physical space from the depth information, determining a distance between the user and a display device from the depth information, and adjusting one or more features of a user interface displayed on the display device based on the distance.

Abstract translation: 公开了基于深度信息动态调整用户界面的实施例。 例如，一个公开的实施例提供了一种方法，包括从深度相机接收物理空间的深度信息，从深度信息定位物理空间内的用户，从深度信息确定用户和显示设备之间的距离，以及 基于该距离来调整在显示装置上显示的用户界面的一个或多个特征。

公开(公告)号：US09342160B2

公开(公告)日：2016-05-17

申请号：US14721471

申请日：2015-05-26

Applicant: Microsoft Technology Licensing, LLC

Inventor： Richard Bailey ,  David Bastien ,  Mark Schwesinger ,  Emily Yang ,  Adam Smith ,  Oscar Murillo ,  Tim Franklin ,  Jordan Andersen ,  Christian Klein

IPC: G06F3/033 ,  G09G5/08 ,  G06F3/0346 ,  G06F3/01 ,  G06F3/03 ,  G06K9/00

CPC classification number: G06F3/0346 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0482 ,  G06K9/00335 ,  G06K9/00355

Abstract: Users move their hands in a three dimensional (“3D”) physical interaction zone (“PHIZ”) to control a cursor in a user interface (“UI”) shown on a computer-coupled 2D display such as a television or monitor. The PHIZ is shaped, sized, and positioned relative to the user to ergonomically match the user's natural range of motions so that cursor control is intuitive and comfortable over the entire region on the UI that supports cursor interaction. A motion capture system tracks the user's hand so that the user's 3D motions within the PHIZ can be mapped to the 2D UI. Accordingly, when the user moves his or her hands in the PHIZ, the cursor correspondingly moves on the display. Movement in the z direction (i.e., back and forth) in the PHIZ allows for additional interactions to be performed such as pressing, zooming, 3D manipulations, or other forms of input to the UI.

公开(公告)号：US09971491B2

公开(公告)日：2018-05-15

申请号：US14151744

申请日：2014-01-09

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Mark Schwesinger ,  Emily Yang ,  Jay Kapur ,  Sergio Paolantonio ,  Christian Klein ,  Oscar Murillo

IPC: G06F3/048 ,  G06F3/0485 ,  G06F3/01 ,  G06F3/03 ,  G06K9/00 ,  G06F3/0484

CPC classification number: G06F3/0485 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/04842 ,  G06F2203/0381 ,  G06F2203/04806 ,  G06K9/00355

Abstract: A method to decode natural user input from a human subject. The method includes detection of a gesture and concurrent grip state of the subject. If the grip state is closed during the gesture, then a user-interface (UI) canvas of the computer system is transformed based on the gesture. If the grip state is open during the gesture, then a UI object arranged on the UI canvas is activated based on the gesture.

公开(公告)号：US09383894B2

公开(公告)日：2016-07-05

申请号：US14150669

申请日：2014-01-08

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Mark Schwesinger ,  Emily Yang ,  Jay Kapur ,  Christian Klein ,  Oscar Murillo ,  Sergio Paolantonio

IPC: G06F3/048 ,  G06F3/0481 ,  G06F3/01

CPC classification number: G06F3/04812 ,  G06F3/017

Abstract: Embodiments are disclosed that relate to providing feedback for a level of completion of a user gesture via a cursor displayed on a user interface. One disclosed embodiment provides a method comprising displaying a cursor having a visual property and moving a screen-space position of the cursor responsive to the user gesture. The method further comprises changing the visual property of the cursor in proportion to a level of completion of the user gesture. In this way, the level of completion of the user gesture may be presented to the user in a location to which the attention of the user is directed during performance of the gesture.

Abstract translation: 公开了涉及通过显示在用户界面上的光标为用户手势的完成水平提供反馈的实施例。 一个公开的实施例提供了一种方法，包括显示具有视觉属性的光标并响应于用户手势移动光标的屏幕空间位置。 该方法还包括与用户手势的完成水平成比例地改变光标的视觉特性。 以这种方式，用户手势的完成水平可以在执行手势期间在用户注意的位置呈现给用户。

公开(公告)号：US11099637B2

公开(公告)日：2021-08-24

申请号：US16549082

申请日：2019-08-23

Applicant: Microsoft Technology Licensing, LLC

Inventor： Mark Schwesinger ,  Oscar Murillo ,  Emily Yang ,  Richard Bailey ,  Jay Kapur

IPC: G06F3/01 ,  G06F3/0484 ,  A63F13/21 ,  G06F3/03 ,  G06T7/73 ,  G06F9/451 ,  G06F3/0488 ,  G06F3/16

Abstract: Embodiments related to dynamically adjusting a user interface based upon depth information are disclosed. For example, one disclosed embodiment provides a method including receiving depth information of a physical space from a depth camera, locating a user within the physical space from the depth information, determining a distance between the user and a display device from the depth information, and adjusting one or more features of a user interface displayed on the display device based on the distance.

公开(公告)号：US09785228B2

公开(公告)日：2017-10-10

申请号：US13764056

申请日：2013-02-11

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Mark Schwesinger ,  Eduardo Escardo Raffo ,  Oscar Murillo ,  David Bastien ,  Matthew H. Ahn ,  Mauro Giusti ,  Kevin Endres ,  Christian Klein ,  Julia Schwarz ,  Charles Claudius Marais

IPC: G09G5/00 ,  G06F3/00 ,  G06F3/01

CPC classification number: G06F3/005 ,  G06F3/011 ,  G06F3/017

Abstract: An NUI system to provide user input to a computer system. The NUI system includes a logic machine and an instruction-storage machine. The instruction-storage machine holds instructions that, when executed by the logic machine, cause the logic machine to detect an engagement gesture from a human subject or to compute an engagement metric reflecting the degree of the subject's engagement. The instructions also cause the logic machine to direct gesture-based user input from the subject to the computer system as soon as the engagement gesture is detected or the engagement metric exceeds a threshold.