-
公开(公告)号：US11243612B2
公开(公告)日：2022-02-08
申请号：US16195755
申请日：2018-11-19
发明人： Raffi Bedikian , Jonathan Marsden , Keith Mertens , David Holz , Maxwell Sills , Matias Perez , Gabriel Hare , Ryan Julian
IPC分类号： G06F3/01 , G06F3/0481 , G06F3/03 , G06K9/00 , G06K9/62
摘要： Embodiments of display control based on dynamic user interactions generally include capturing a plurality of temporally sequential images of the user, or a body part or other control object manipulated by the user, and computationally analyzing the images to recognize a gesture performed by the user. In some embodiments, a scale indicative of an actual gesture distance traversed in performance of the gesture is identified, and a movement or action is displayed on the device based, at least in part, on a ratio between the identified scale and the scale of the displayed movement. In some embodiments, a degree of completion of the recognized gesture is determined, and the display contents are modified in accordance therewith. In some embodiments, a dominant gesture is computationally determined from among a plurality of user gestures, and an action displayed on the device is based on the dominant gesture.
-
公开(公告)号：US11854308B1
公开(公告)日：2023-12-26
申请号：US15432876
申请日：2017-02-14
IPC分类号： G06K9/62 , G06V40/20 , G06F3/01 , G06V10/44 , G06V30/194 , G06V40/10 , G06F18/22 , G06F18/21
CPC分类号： G06V40/28 , G06F3/017 , G06F18/217 , G06F18/22 , G06V10/454 , G06V30/194 , G06V40/113
摘要： The technology disclosed also initializes a new hand that enters the field of view of a gesture recognition system using a parallax detection module. The parallax detection module determines candidate regions of interest (ROI) for a given input hand image and computes depth, rotation and position information for the candidate ROI. Then, for each of the candidate ROI, an ImagePatch, which includes the hand, is extracted from the original input hand image to minimize processing of low-information pixels. Further, a hand classifier neural network is used to determine which ImagePatch most resembles a hand. For the qualified, most-hand like ImagePatch, a 3D virtual hand is initialized with depth, rotation and position matching that of the qualified ImagePatch.
-
公开(公告)号：US20220236808A1
公开(公告)日：2022-07-28
申请号：US17666534
申请日：2022-02-07
发明人： Raffi Bedikian , Jonathan Marsden , Keith Mertens , David Holz , Maxwell Sills , Matias Perez , Gabriel Hare , Ryan Julian
IPC分类号： G06F3/01 , G06F3/04815 , G06F3/03 , G06V10/75 , G06V40/20
摘要： A method and system are provided for controlling a machine using gestures. The method includes sensing a variation of position of a control object using an imaging system, determining, from the variation, one or more primitives describing a characteristic of a control object moving in space, comparing the one or more primitives to one or more gesture templates in a library of gesture templates, selecting, based on a result of the comparing, one or more gesture templates corresponding to the one or more primitives, and providing at least one gesture template of the selected one or more gesture templates as an indication of a command to issue to a machine under control responsive to the variation.
-
公开(公告)号：US11353962B2
公开(公告)日：2022-06-07
申请号：US16987289
申请日：2020-08-06
发明人： Raffi Bedikian , Jonathan Marsden , Keith Mertens , David Holz
IPC分类号： G06F3/01 , G06F3/03 , G06V40/20 , G06F3/04845
摘要： During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.
-
公开(公告)号：US11182685B2
公开(公告)日：2021-11-23
申请号：US16000768
申请日：2018-06-05
发明人： David S. Holz , Raffi Bedikian , Adrian Gasinski , Maxwell Sills , Hua Yang , Gabriel Hare
IPC分类号： G06N5/04 , G06F3/0481 , G06F3/0484 , G06F3/03 , G06F3/042 , G06F3/01
摘要： The technology disclosed relates to manipulating a virtual object. In particular, it relates to detecting a hand in a three-dimensional (3D) sensory space and generating a predictive model of the hand, and using the predictive model to track motion of the hand. The predictive model includes positions of calculation points of fingers, thumb and palm of the hand. The technology disclosed relates to dynamically selecting at least one manipulation point proximate to a virtual object based on the motion tracked by the predictive model and positions of one or more of the calculation points, and manipulating the virtual object by interaction between at least some of the calculation points of the predictive model and the dynamically selected manipulation point.
-
公开(公告)号：US10739965B2
公开(公告)日：2020-08-11
申请号：US16228521
申请日：2018-12-20
发明人： David S. Holz , Raffi Bedikian , Adrian Gasinski , Hua Yang , Gabriel A. Hare , Maxwell Sills
IPC分类号： G06F5/01 , G06T19/00 , G06F3/0484 , G06F3/01 , G06K9/46 , G06F3/03 , G06K9/20 , G06F3/042 , G06K9/00 , G06F3/02
摘要： The technology disclosed relates to providing simplified manipulation of virtual objects by detected hand motions. In particular, it relates to a detecting hand motion and positions of the calculation points relative to a virtual object to be manipulated, dynamically selecting at least one manipulation point proximate to the virtual object based on the detected hand motion and positions of one or more of the calculation points, and manipulating the virtual object by interaction between the detected hand motion and positions of one or more of the calculation points and the dynamically selected manipulation point.
-
公开(公告)号：US10739862B2
公开(公告)日：2020-08-11
申请号：US16054891
申请日：2018-08-03
发明人： Raffi Bedikian , Jonathan Marsden , Keith Mertens , David Holz
IPC分类号： G06F3/01 , G06K9/00 , G06F3/03 , G06F3/0484
摘要： During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.
-
公开(公告)号：US11841920B1
公开(公告)日：2023-12-12
申请号：US15432869
申请日：2017-02-14
IPC分类号： G06K9/62 , G06K9/00 , G06T7/73 , G06K9/78 , G06T7/285 , G06T7/246 , G06N3/04 , G06N3/08 , G06F3/01 , G06V10/10 , G06V20/64 , G06V40/20 , G06F18/214 , G06F18/24 , G06V10/70
CPC分类号： G06F18/214 , G06F18/24 , G06N3/04 , G06N3/08 , G06T7/248 , G06T7/285 , G06T7/74 , G06V10/70 , G06V20/64 , G06V40/28 , G06F3/011 , G06F3/017 , G06T2207/10021 , G06T2207/10028 , G06T2207/20081 , G06T2207/30196
摘要： The technology disclosed introduces two types of neural networks: “master” or “generalists” networks and “expert” or “specialists” networks. Both, master networks and expert networks, are fully connected neural networks that take a feature vector of an input hand image and produce a prediction of the hand pose. Master networks and expert networks differ from each other based on the data on which they are trained. In particular, master networks are trained on the entire data set. In contrast, expert networks are trained only on a subset of the entire dataset. In regards to the hand poses, master networks are trained on the input image data representing all available hand poses comprising the training data (including both real and simulated hand images).
-
9.发明授权公开(公告)号：US11740705B2
公开(公告)日：2023-08-29
申请号：US17666534
申请日：2022-02-07
发明人： Raffi Bedikian , Jonathan Marsden , Keith Mertens , David Holz , Maxwell Sills , Matias Perez , Gabriel Hare , Ryan Julian
IPC分类号： G06F3/01 , G06F3/04815 , G06F3/03 , G06V40/20
CPC分类号： G06F3/017 , G06F3/0325 , G06F3/04815 , G06V40/20
摘要： A method and system are provided for controlling a machine using gestures. The method includes sensing a variation of position of a control object using an imaging system, determining, from the variation, one or more primitives describing a characteristic of a control object moving in space, comparing the one or more primitives to one or more gesture templates in a library of gesture templates, selecting, based on a result of the comparing, one or more gesture templates corresponding to the one or more primitives, and providing at least one gesture template of the selected one or more gesture templates as an indication of a command to issue to a machine under control responsive to the variation.
-
公开(公告)号：US11714880B1
公开(公告)日：2023-08-01
申请号：US16508231
申请日：2019-07-10
CPC分类号： G06K9/6269 , G06K9/00355 , G06K9/4604 , G06T7/13 , G06T2207/10028
摘要： The technology disclosed performs hand pose estimation on a so-called “joint-by-joint” basis. So, when a plurality of estimates for the 28 hand joints are received from a plurality of expert networks (and from master experts in some high-confidence scenarios), the estimates are analyzed at a joint level and a final location for each joint is calculated based on the plurality of estimates for a particular joint. This is a novel solution discovered by the technology disclosed because nothing in the field of art determines hand pose estimates at such granularity and precision. Regarding granularity and precision, because hand pose estimates are computed on a joint-by-joint basis, this allows the technology disclosed to detect in real time even the minutest and most subtle hand movements, such a bend/yaw/tilt/roll of a segment of a finger or a tilt an occluded finger, as demonstrated supra in the Experimental Results section of this application.
-
-
-
-
-
-
-
-
-
搜索结果
18 条记录 (耗时 0.02 秒)
