-
公开(公告)号:US11340707B2
公开(公告)日:2022-05-24
申请号:US16888562
申请日:2020-05-29
Applicant: Microsoft Technology Licensing, LLC
Inventor: Julia Schwarz , Michael Harley Notter , Jenny Kam , Sheng Kai Tang , Kenneth Mitchell Jakubzak , Adam Edwin Behringer , Amy Mun Hong , Joshua Kyle Neff , Sophie Stellmach , Mathew J. Lamb , Nicholas Ferianc Kamuda
Abstract: Examples are disclosed that relate to hand gesture-based emojis. One example provides, on a display device, a method comprising receiving hand tracking data representing a pose of a hand in a coordinate system, based on the hand tracking data, recognizing a hand gesture, and identifying an emoji corresponding to the hand gesture. The method further comprises presenting the emoji on the display device, and sending an instruction to one or more other display devices to present the emoji.
-
公开(公告)号:US11320957B2
公开(公告)日:2022-05-03
申请号:US16363684
申请日:2019-03-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Sheng Kai Tang , Julia Schwarz , Thomas Matthew Gable , Casey Leon Meekhof , Nahil Tawfik Sharkasi , Nicholas Ferianc Kamuda , Joshua Kyle Neff , Alton Kwok
IPC: G06F3/0481 , G06F3/01 , G02B27/00 , G02B27/01 , G06F3/04815
Abstract: A computing system is provided. The computing system includes a head mounted display (HMD) device including a display, a processor configured to execute one or more programs, and associated memory. The processor is configured to display a virtual object at least partially within a field of view of a user on the display, identify a plurality of control points associated with the virtual object, and determine that one or more of the control points associated with the virtual object are further than a predetermined threshold distance from the user. The processor is configured to, based on the determination, invoke a far interaction mode for the virtual object and receive a trigger input from the user. In response to the trigger input in the far interaction mode, the processor is configured to invoke a near interaction mode and display a virtual interaction object within the predetermined threshold distance from the user.
-
公开(公告)号:US11755122B2
公开(公告)日:2023-09-12
申请号:US17664520
申请日:2022-05-23
Applicant: Microsoft Technology Licensing, LLC
Inventor: Julia Schwarz , Michael Harley Notter , Jenny Kam , Sheng Kai Tang , Kenneth Mitchell Jakubzak , Adam Edwin Behringer , Amy Mun Hong , Joshua Kyle Neff , Sophie Stellmach , Mathew J. Lamb , Nicholas Ferianc Kamuda
CPC classification number: G06F3/017 , G06F3/012 , G06F3/013 , G06F3/167 , G06T13/40 , G06V20/20 , G06V40/107 , G06V40/28
Abstract: Examples are disclosed that relate to hand gesture-based emojis. One example provides, on a display device, a method comprising receiving hand tracking data representing a pose of a hand in a coordinate system, based on the hand tracking data, recognizing a hand gesture, and identifying an emoji corresponding to the hand gesture. The method further comprises presenting the emoji on the display device, and sending an instruction to one or more other display devices to present the emoji.
-
公开(公告)号:US11656689B2
公开(公告)日:2023-05-23
申请号:US17647941
申请日:2022-01-13
Applicant: Microsoft Technology Licensing, LLC
Inventor: Julia Schwarz , Noe Moreno Barragan , Michael Harley Notter , Sheng Kai Tang , Joshua Kyle Neff
CPC classification number: G06F3/017 , G06F3/013 , G06T7/246 , G06T7/73 , G06T2207/10028 , G06T2207/30196
Abstract: A method for single-handed microgesture input comprises receiving hand tracking data for a hand of a user. A set of microgesture targets that include software functions are assigned to positions along a length of a first finger. The received hand tracking data is analyzed by a gesture recognition machine. A location of a thumbtip of the hand of the user is determined relative to the positions along the first finger. Responsive to determining that the thumbtip is within a threshold distance of the first finger at a first position along the length of the first finger, a corresponding first microgesture target is designated for selection. Selection of the first microgesture target is enabled based on a duration the thumbtip is at the first position. Responsive to detecting a confirmation action, the corresponding microgesture target executes.
-
公开(公告)号:US11703994B2
公开(公告)日:2023-07-18
申请号:US17661087
申请日:2022-04-28
Applicant: Microsoft Technology Licensing, LLC
Inventor: Sheng Kai Tang , Julia Schwarz , Thomas Matthew Gable , Casey Leon Meekhof , Nahil Tawfik Sharkasi , Nicholas Ferianc Kamuda , Joshua Kyle Neff , Alton Kwok
IPC: G06F3/04815 , G06F3/01 , G02B27/00 , G02B27/01
CPC classification number: G06F3/04815 , G02B27/0093 , G02B27/017 , G06F3/017 , G02B2027/0178
Abstract: A computing system is provided. The computing system includes a head mounted display (HMD) device including a display, a processor configured to execute one or more programs, and associated memory. The processor is configured to display a virtual object at least partially within a field of view of a user on the display, identify a plurality of control points associated with the virtual object, and determine that one or more of the control points associated with the virtual object are further than a predetermined threshold distance from the user. The processor is configured to, based on the determination, invoke a far interaction mode for the virtual object and receive a trigger input from the user. In response to the trigger input in the far interaction mode, the processor is configured to invoke a near interaction mode and display a virtual interaction object within the predetermined threshold distance from the user.
-
公开(公告)号:US11294472B2
公开(公告)日:2022-04-05
申请号:US16365114
申请日:2019-03-26
Applicant: Microsoft Technology Licensing, LLC
Inventor: Sheng Kai Tang , Julia Schwarz , Thomas Matthew Gable , Casey Leon Meekhof , Chuan Qin , Nahil Tawfik Sharkasi , Nicholas Ferianc Kamuda , Ramiro S. Torres , Joshua Kyle Neff , Jamie Bryant Kirschenbaum , Neil Richard Kronlage
IPC: G06F3/01 , G06N3/02 , G06F3/04815
Abstract: A method for augmenting a two-stage hand gesture input comprises receiving hand tracking data for a hand of a user. A gesture recognition machine recognizes that the user has performed a first-stage gesture based on one or more parameters derived from the received hand tracking data satisfying first-stage gesture criteria. An affordance cueing a second-stage gesture is provided to the user responsive to recognizing the first-stage gesture. The gesture recognition machine recognizes that the user has performed the second-stage gesture based on one or more parameters derived from the received hand tracking data satisfying second-stage gesture criteria. A graphical user interface element is displayed responsive to recognizing the second-stage gesture.
-
公开(公告)号:US11249556B1
公开(公告)日:2022-02-15
申请号:US17107848
申请日:2020-11-30
Applicant: Microsoft Technology Licensing, LLC
Inventor: Julia Schwarz , Noe Moreno Barragan , Michael Harley Notter , Sheng Kai Tang , Joshua Kyle Neff
Abstract: A method for single-handed microgesture input comprises receiving hand tracking data for a hand of a user. A set of microgesture targets that include software functions are assigned to positions along a length of a first finger. A visual affordance including indicators for two or more assigned microgesture targets is provided to the user. The received hand tracking data is analyzed by a gesture recognition machine. A location of a thumbtip of the hand of the user is determined relative to the positions along the first finger. Responsive to determining that the thumbtip is within a threshold distance of the first finger at a first position along the length of the first finger, an indicator for a corresponding first microgesture target is augmented, and then further augmented based on a duration the thumbtip is at the first position. Responsive to detecting a confirmation action, the corresponding microgesture target executes.
-
-
-
-
-
-