-
公开(公告)号:US12260679B1
公开(公告)日:2025-03-25
申请号:US18391574
申请日:2023-12-20
Applicant: ULTRAHAPTICS IP TWO LIMITED
Inventor: Jonathan Marsden , Raffi Bedikian , David Samuel Holz
Abstract: The technology disclosed also initializes a new hand that enters the field of view of a gesture recognition system using a parallax detection module. The parallax detection module determines candidate regions of interest (ROI) for a given input hand image and computes depth, rotation and position information for the candidate ROI. Then, for each of the candidate ROI, an ImagePatch, which includes the hand, is extracted from the original input hand image to minimize processing of low-information pixels. Further, a hand classifier neural network is used to determine which ImagePatch most resembles a hand. For the qualified, most-hand like ImagePatch, a 3D virtual hand is initialized with depth, rotation and position matching that of the qualified ImagePatch.
-
公开(公告)号:US12229217B1
公开(公告)日:2025-02-18
申请号:US18536151
申请日:2023-12-11
Applicant: ULTRAHAPTICS IP TWO LIMITED
Inventor: Jonathan Marsden , Raffi Bedikian , David Samuel Holz
IPC: G06F18/214 , G06F3/01 , G06F18/24 , G06N3/04 , G06N3/08 , G06T7/246 , G06T7/285 , G06T7/73 , G06V10/70 , G06V20/64 , G06V40/20
Abstract: The technology disclosed introduces two types of neural networks: “master” or “generalists” networks and “expert” or “specialists” networks. Both, master networks and expert networks, are fully connected neural networks that take a feature vector of an input hand image and produce a prediction of the hand pose. Master networks and expert networks differ from each other based on the data on which they are trained. In particular, master networks are trained on the entire data set. In contrast, expert networks are trained only on a subset of the entire dataset. In regards to the hand poses, master networks are trained on the input image data representing all available hand poses comprising the training data (including both real and simulated hand images).
-
公开(公告)号:US12131011B2
公开(公告)日:2024-10-29
申请号:US16941448
申请日:2020-07-28
Applicant: Ultrahaptics IP Two Limited
Inventor: David S. Holz , Raffi Bedikian , Adrian Gasinski , Hua Yang , Gabriel A. Hare , Maxwell Sills
IPC: G06F3/04842 , G06F3/01 , G06F3/02 , G06F3/03 , G06F3/042 , G06T19/00 , G06V10/147 , G06V10/44 , G06V40/10 , G06V40/20
CPC classification number: G06F3/04842 , G06F3/011 , G06F3/017 , G06F3/0213 , G06F3/0304 , G06F3/0325 , G06F3/0425 , G06T19/006 , G06V10/147 , G06V10/443 , G06V40/113 , G06V40/28
Abstract: The technology disclosed relates to providing simplified manipulation of virtual objects by detected hand motions. In particular, it relates to a detecting hand motion and positions of the calculation points relative to a virtual object to be manipulated, dynamically selecting at least one manipulation point proximate to the virtual object based on the detected hand motion and positions of one or more of the calculation points, and manipulating the virtual object by interaction between the detected hand motion and positions of one or more of the calculation points and the dynamically selected manipulation point.
-
公开(公告)号:US11914792B2
公开(公告)日:2024-02-27
申请号:US18111089
申请日:2023-02-17
Applicant: Ultrahaptics IP Two Limited
Inventor: Kevin A. Horowitz , Matias Perez , Raffi Bedikian , David S. Holz , Gabriel A. Hare
IPC: G09G5/00 , G06F3/01 , G06F3/03 , G06T7/20 , G06T19/00 , H04N13/296 , G06F3/0346 , G06V40/20 , G06V40/10 , G06T7/246 , G01S3/00
CPC classification number: G06F3/017 , G01S3/00 , G06F3/011 , G06F3/0304 , G06F3/0346 , G06T7/20 , G06T7/251 , G06T19/006 , G06V40/113 , G06V40/28 , H04N13/296 , G06T2207/10016 , G06T2207/30196
Abstract: The technology disclosed relates to relates to providing command input to a machine under control. It further relates to gesturally interacting with the machine. The technology disclosed also relates to providing monitoring information about a process under control. The technology disclosed further relates to providing biometric information about an individual. The technology disclosed yet further relates to providing abstract features information (pose, grab strength, pinch strength, confidence, and so forth) about an individual.
-
公开(公告)号:US11874970B2
公开(公告)日:2024-01-16
申请号:US17833556
申请日:2022-06-06
Applicant: Ultrahaptics IP Two Limited
Inventor: Raffi Bedikian , Jonathan Marsden , Keith Mertens , David Holz
IPC: G06F3/01 , G06F3/03 , G06V40/20 , G06F3/04845
CPC classification number: G06F3/017 , G06F3/011 , G06F3/0304 , G06F3/04845 , G06V40/20
Abstract: During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.
-
公开(公告)号:US11868687B2
公开(公告)日:2024-01-09
申请号:US18161811
申请日:2023-01-30
Applicant: Ultrahaptics IP Two Limited
Inventor: David S. Holz , Kevin Horowitz , Raffi Bedikian , Hua Yang
Abstract: The technology disclosed relates to simplifying updating of a predictive model using clustering observed points. In particular, it relates to observing a set of points in 3D sensory space, determining surface normal directions from the points, clustering the points by their surface normal directions and adjacency, accessing a predictive model of a hand, refining positions of segments of the predictive model, matching the clusters of the points to the segments, and using the matched clusters to refine the positions of the matched segments. It also relates to distinguishing between alternative motions between two observed locations of a control object in a 3D sensory space by accessing first and second positions of a segment of a predictive model of a control object such that motion between the first position and the second position was at least partially occluded from observation in a 3D sensory space.
-
公开(公告)号:US11586292B2
公开(公告)日:2023-02-21
申请号:US17189152
申请日:2021-03-01
Applicant: Ultrahaptics IP Two Limited
Inventor: Kevin A. Horowitz , Matias Perez , Raffi Bedikian , David S. Holz , Gabriel A. Hare
IPC: G09G5/00 , G06F3/01 , G06F3/03 , G06T7/20 , G06T19/00 , H04N13/296 , G06F3/0346 , G06V40/20 , G06V40/10 , G06T7/246 , G01S3/00
Abstract: The technology disclosed relates to relates to providing command input to a machine under control. It further relates to gesturally interacting with the machine. The technology disclosed also relates to providing monitoring information about a process under control. The technology disclosed further relates to providing biometric information about an individual. The technology disclosed yet further relates to providing abstract features information (pose, grab strength, pinch strength, confidence, and so forth) about an individual.
-
公开(公告)号:US11568105B2
公开(公告)日:2023-01-31
申请号:US17308903
申请日:2021-05-05
Applicant: Ultrahaptics IP Two Limited
Inventor: David S. Holz , Kevin Horowitz , Raffi Bedikian , Hua Yang
Abstract: The technology disclosed relates to simplifying updating of a predictive model using clustering observed points. In particular, it relates to observing a set of points in 3D sensory space, determining surface normal directions from the points, clustering the points by their surface normal directions and adjacency, accessing a predictive model of a hand, refining positions of segments of the predictive model, matching the clusters of the points to the segments, and using the matched clusters to refine the positions of the matched segments. It also relates to distinguishing between alternative motions between two observed locations of a control object in a 3D sensory space by accessing first and second positions of a segment of a predictive model of a control object such that motion between the first position and the second position was at least partially occluded from observation in a 3D sensory space.
-
公开(公告)号:US10936082B2
公开(公告)日:2021-03-02
申请号:US16588876
申请日:2019-09-30
Applicant: Ultrahaptics IP Two Limited
Inventor: Kevin A. Horowitz , Matias Perez , Raffi Bedikian , David S. Holz , Gabriel A. Hare
IPC: G09G5/00 , G06F3/01 , G06K9/00 , G06F3/03 , G06T7/20 , G06T19/00 , H04N13/296 , G06F3/0346 , G06T7/246 , G01S3/00
Abstract: The technology disclosed relates to relates to providing command input to a machine under control. It further relates to gesturally interacting with the machine. The technology disclosed also relates to providing monitoring information about a process under control. The technology disclosed further relates to providing biometric information about an individual. The technology disclosed yet further relates to providing abstract features information (pose, grab strength, pinch strength, confidence, and so forth) about an individual.
-
公开(公告)号:US12243238B1
公开(公告)日:2025-03-04
申请号:US18224551
申请日:2023-07-20
Applicant: ULTRAHAPTICS IP TWO LIMITED
Inventor: Jonathan Marsden , Raffi Bedikian , David Samuel Holz
IPC: G06T7/13
Abstract: The technology disclosed performs hand pose estimation on a so-called “joint-by-joint” basis. So, when a plurality of estimates for the 28 hand joints are received from a plurality of expert networks (and from master experts in some high-confidence scenarios), the estimates are analyzed at a joint level and a final location for each joint is calculated based on the plurality of estimates for a particular joint. This is a novel solution discovered by the technology disclosed because nothing in the field of art determines hand pose estimates at such granularity and precision. Regarding granularity and precision, because hand pose estimates are computed on a joint-by-joint basis, this allows the technology disclosed to detect in real time even the minutest and most subtle hand movements, such a bend/yaw/tilt/roll of a segment of a finger or a tilt an occluded finger, as demonstrated supra in the Experimental Results section of this application.
-
-
-
-
-
-
-
-
-