Invention Grant
- Patent Title: Gesture recognition based on likelihood of interaction
-
Application No.: US18463906Application Date: 2023-09-08
-
Publication No.: US12216832B2Publication Date: 2025-02-04
- Inventor: Julia Schwarz , Bugra Tekin , Sophie Stellmach , Erian Vazquez , Casey Leon Meekhof , Fabian Gobel
- Applicant: Microsoft Technology Licensing, LLC
- Applicant Address: US WA Redmond
- Assignee: Microsoft Technology Licensing, LLC
- Current Assignee: Microsoft Technology Licensing, LLC
- Current Assignee Address: US WA Redmond
- Agency: Alleman Hall & Tuttle LLP
- Main IPC: G06F3/01
- IPC: G06F3/01 ; G06N3/08 ; G06V10/82 ; G06V40/20

Abstract:
A method for evaluating gesture input comprises receiving input data for sequential data frames, including hand tracking data for hands of a user. A first neural network is trained to recognize features indicative of subsequent gesture interactions and configured to evaluate input data for a sequence of data frames and to output an indication of a likelihood of the user performing gesture interactions during a predetermined window of data frames. A second neural network is trained to recognize features indicative of whether the user is currently performing one or more gesture interactions and configured to adjust parameters for gesture interaction recognition during the predetermined window based on the indicated likelihood. The second neural network evaluates the predetermined window for performed gesture interactions based on the adjusted parameters, and outputs a signal as to whether the user is performing one or more gesture interactions during the predetermined window.
Public/Granted literature
- US20230418390A1 GESTURE RECOGNITION BASED ON LIKELIHOOD OF INTERACTION Public/Granted day:2023-12-28
Information query