-
公开(公告)号：US11768544B2
公开(公告)日：2023-09-26
申请号：US17649659
申请日：2022-02-01
Applicant: Microsoft Technology Licensing, LLC
Inventor： Julia Schwarz , Bugra Tekin , Sophie Stellmach , Erian Vazquez , Casey Leon Meekhof , Fabian Gobel
Abstract: A method for evaluating gesture input comprises receiving input data for sequential data frames, including hand tracking data for hands of a user. A first neural network is trained to recognize features indicative of subsequent gesture interactions and configured to evaluate input data for a sequence of data frames and to output an indication of a likelihood of the user performing gesture interactions during a predetermined window of data frames. A second neural network is trained to recognize features indicative of whether the user is currently performing one or more gesture interactions and configured to adjust parameters for gesture interaction recognition during the predetermined window based on the indicated likelihood. The second neural network evaluates the predetermined window for performed gesture interactions based on the adjusted parameters, and outputs a signal as to whether the user is performing one or more gesture interactions during the predetermined window.
-
公开(公告)号：US11567633B2
公开(公告)日：2023-01-31
申请号：US17170696
申请日：2021-02-08
Applicant: Microsoft Technology Licensing, LLC
Inventor： Julia Schwarz , Andrew D. Wilson , Sophie Stellmach , Erian Vazquez , Kristian Jose Davila , Adam Edwin Behringer , Jonathan Palmer , Jason Michael Ray , Mathew Julian Lamb
IPC: G06F3/0482 , G06F3/01 , G06F3/04815 , G06F3/16 , G06F3/0346
Abstract: A computer-implemented method for determining focus of a user is provided. User input is received. An intention image of a scene including a plurality of interactive objects is generated. The intention image includes pixels encoded with intention values determined based on the user input. An intention value indicates a likelihood that the user intends to focus on the pixel. An intention score is determined for each interactive object based on the intention values of pixels that correspond to the interactive object. An interactive object of the plurality of interactive objects is determined to be a focused object that has the user's focus based on the intention scores of the plurality of interactive objects.
-
公开(公告)号：US12216832B2
公开(公告)日：2025-02-04
申请号：US18463906
申请日：2023-09-08
Applicant: Microsoft Technology Licensing, LLC
Inventor： Julia Schwarz , Bugra Tekin , Sophie Stellmach , Erian Vazquez , Casey Leon Meekhof , Fabian Gobel
Abstract: A method for evaluating gesture input comprises receiving input data for sequential data frames, including hand tracking data for hands of a user. A first neural network is trained to recognize features indicative of subsequent gesture interactions and configured to evaluate input data for a sequence of data frames and to output an indication of a likelihood of the user performing gesture interactions during a predetermined window of data frames. A second neural network is trained to recognize features indicative of whether the user is currently performing one or more gesture interactions and configured to adjust parameters for gesture interaction recognition during the predetermined window based on the indicated likelihood. The second neural network evaluates the predetermined window for performed gesture interactions based on the adjusted parameters, and outputs a signal as to whether the user is performing one or more gesture interactions during the predetermined window.
-
公开(公告)号：US11620000B1
公开(公告)日：2023-04-04
申请号：US17710940
申请日：2022-03-31
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor： Sophie Stellmach , Julia Schwarz , Erian Vazquez , Kristian Jose Davila , Thomas Matthew Gable , Adam Behringer
Abstract: The techniques disclosed herein provide systems that can control the invocation of precision input mode. A system can initially utilize a first input device, such as a head-mounted display device monitoring the eye gaze direction of a user to control the location of an input target. When one or more predetermined input gestures are detected, the system can then invoke a precision mode that transitions the control of the input target from the first input device to a second input device. The second device can include another input device utilizing different input modalities, such as a sensor detecting one or more hand gestures of the user. The predetermined input gestures can include a fixation input gesture, voice commands, or other gestures that may include the use of a user's hands or head. By controlling the invocation of precision input mode using specific gestures, a system can mitigate device coordination issues.
-
-
-
Search Results
4
records
(took 0.015 seconds)
