公开(公告)号：US12147505B1

公开(公告)日：2024-11-19

申请号：US18224373

申请日：2023-07-20

Applicant: ULTRAHAPTICS IP TWO LIMITED

Inventor： Jonathan Marsden ,  Raffi Bedikian ,  David Samuel Holz

IPC: G06K9/62 ,  G06F18/2411 ,  G06K9/00 ,  G06T7/13 ,  G06V10/44 ,  G06V40/20

Abstract: The technology disclosed performs hand pose estimation on a so-called “joint-by-joint” basis. So, when a plurality of estimates for the 28 hand joints are received from a plurality of expert networks (and from master experts in some high-confidence scenarios), the estimates are analyzed at a joint level and a final location for each joint is calculated based on the plurality of estimates for a particular joint. This is a novel solution discovered by the technology disclosed because nothing in the field of art determines hand pose estimates at such granularity and precision. Regarding granularity and precision, because hand pose estimates are computed on a joint-by-joint basis, this allows the technology disclosed to detect in real time even the minutest and most subtle hand movements, such a bend/yaw/tilt/roll of a segment of a finger or a tilt an occluded finger, as demonstrated supra in the Experimental Results section of this application.

公开(公告)号：US11854308B1

公开(公告)日：2023-12-26

申请号：US15432876

申请日：2017-02-14

Applicant: ULTRAHAPTICS IP TWO LIMITED

Inventor： Jonathan Marsden ,  Raffi Bedikian ,  David Samuel Holz

IPC: G06K9/62 ,  G06V40/20 ,  G06F3/01 ,  G06V10/44 ,  G06V30/194 ,  G06V40/10 ,  G06F18/22 ,  G06F18/21

CPC classification number: G06V40/28 ,  G06F3/017 ,  G06F18/217 ,  G06F18/22 ,  G06V10/454 ,  G06V30/194 ,  G06V40/113

Abstract: The technology disclosed also initializes a new hand that enters the field of view of a gesture recognition system using a parallax detection module. The parallax detection module determines candidate regions of interest (ROI) for a given input hand image and computes depth, rotation and position information for the candidate ROI. Then, for each of the candidate ROI, an ImagePatch, which includes the hand, is extracted from the original input hand image to minimize processing of low-information pixels. Further, a hand classifier neural network is used to determine which ImagePatch most resembles a hand. For the qualified, most-hand like ImagePatch, a 3D virtual hand is initialized with depth, rotation and position matching that of the qualified ImagePatch.

公开(公告)号：US20220236808A1

公开(公告)日：2022-07-28

申请号：US17666534

申请日：2022-02-07

Applicant: Ultrahaptics IP Two Limited

Inventor： Raffi Bedikian ,  Jonathan Marsden ,  Keith Mertens ,  David Holz ,  Maxwell Sills ,  Matias Perez ,  Gabriel Hare ,  Ryan Julian

IPC: G06F3/01 ,  G06F3/04815 ,  G06F3/03 ,  G06V10/75 ,  G06V40/20

Abstract: A method and system are provided for controlling a machine using gestures. The method includes sensing a variation of position of a control object using an imaging system, determining, from the variation, one or more primitives describing a characteristic of a control object moving in space, comparing the one or more primitives to one or more gesture templates in a library of gesture templates, selecting, based on a result of the comparing, one or more gesture templates corresponding to the one or more primitives, and providing at least one gesture template of the selected one or more gesture templates as an indication of a command to issue to a machine under control responsive to the variation.

公开(公告)号：US11353962B2

公开(公告)日：2022-06-07

申请号：US16987289

申请日：2020-08-06

Applicant: Ultrahaptics IP Two Limited

Inventor： Raffi Bedikian ,  Jonathan Marsden ,  Keith Mertens ,  David Holz

IPC: G06F3/01 ,  G06F3/03 ,  G06V40/20 ,  G06F3/04845

Abstract: During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.

公开(公告)号：US20210081054A1

公开(公告)日：2021-03-18

申请号：US17093490

申请日：2020-11-09

Applicant: Ultrahaptics IP Two Limited

Inventor： Hua Yang ,  Leonid Kontsevich ,  James Donald ,  David S. Holz ,  Jonathan Marsden ,  Paul Durdik

IPC: G06F3/01 ,  G06T19/00 ,  G06F3/0481 ,  G06F3/0486

Abstract: During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its contact with a “virtual touch plane or surface” (i.e., a plane, portion of a plane, and/or surface computationally defined in space, or corresponding to any physical surface).

公开(公告)号：US10739862B2

公开(公告)日：2020-08-11

申请号：US16054891

申请日：2018-08-03

Applicant: Ultrahaptics IP Two Limited

Inventor： Raffi Bedikian ,  Jonathan Marsden ,  Keith Mertens ,  David Holz

IPC: G06F3/01 ,  G06K9/00 ,  G06F3/03 ,  G06F3/0484

Abstract: During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.