INTERACTIONS WITH VIRTUAL OBJECTS FOR MACHINE CONTROL

    公开(公告)号:US20250103145A1

    公开(公告)日:2025-03-27

    申请号:US18973903

    申请日:2024-12-09

    Abstract: The technology disclosed relates to manipulating a virtual object. In particular, it relates to detecting a hand in a three-dimensional (3D) sensory space and generating a predictive model of the hand, and using the predictive model to track motion of the hand. The predictive model includes positions of calculation points of fingers, thumb and palm of the hand. The technology disclosed relates to dynamically selecting at least one manipulation point proximate to a virtual object based on the motion tracked by the predictive model and positions of one or more of the calculation points, and manipulating the virtual object by interaction between at least some of the calculation points of the predictive model and the dynamically selected manipulation point.

    INTERACTION STRENGTH USING VIRTUAL OBJECTS FOR MACHINE CONTROL

    公开(公告)号:US20200004403A1

    公开(公告)日:2020-01-02

    申请号:US16568022

    申请日:2019-09-11

    Abstract: The technology disclosed relates to using virtual attraction between hand or other control object in a three-dimensional (3D) sensory space and a virtual object in a virtual space. In particular, it relates to defining a virtual attraction zone of a hand or other control object that is tracked in a three-dimensional (3D) sensory space and generating one or more interaction forces between the control object and a virtual object in a virtual space that cause motion of the virtual object responsive to proximity of the control object to the virtual object and escalation with a virtual pinch or grasp action of the control object directed to a manipulation point of the virtual object.

    DYNAMIC, FREE-SPACE USER INTERACTIONS FOR MACHINE CONTROL

    公开(公告)号:US20250130648A1

    公开(公告)日:2025-04-24

    申请号:US18988746

    申请日:2024-12-19

    Abstract: Embodiments of display control based on dynamic user interactions generally include capturing a plurality of temporally sequential images of the user, or a body part or other control object manipulated by the user, and computationally analyzing the images to recognize a gesture performed by the user. In some embodiments, a scale indicative of an actual gesture distance traversed in performance of the gesture is identified, and a movement or action is displayed on the device based, at least in part, on a ratio between the identified scale and the scale of the displayed movement. In some embodiments, a degree of completion of the recognized gesture is determined, and the display contents are modified in accordance therewith. In some embodiments, a dominant gesture is computationally determined from among a plurality of user gestures, and an action displayed on the device is based on the dominant gesture.

    PREDICTIVE INFORMATION FOR FREE SPACE GESTURE CONTROL AND COMMUNICATION

    公开(公告)号:US20240143871A1

    公开(公告)日:2024-05-02

    申请号:US18406059

    申请日:2024-01-05

    CPC classification number: G06F30/20 G06F3/017 G06V20/64 G06V40/28

    Abstract: The technology disclosed relates to simplifying updating of a predictive model using clustering observed points. In particular, it relates to observing a set of points in 3D sensory space, determining surface normal directions from the points, clustering the points by their surface normal directions and adjacency, accessing a predictive model of a hand, refining positions of segments of the predictive model, matching the clusters of the points to the segments, and using the matched clusters to refine the positions of the matched segments. It also relates to distinguishing between alternative motions between two observed locations of a control object in a 3D sensory space by accessing first and second positions of a segment of a predictive model of a control object such that motion between the first position and the second position was at least partially occluded from observation in a 3D sensory space.

    PREDICTIVE INFORMATION FOR FREE SPACE GESTURE CONTROL AND COMMUNICATION

    公开(公告)号:US20230169236A1

    公开(公告)日:2023-06-01

    申请号:US18161811

    申请日:2023-01-30

    CPC classification number: G06F30/20 G06F3/017 G06V20/64 G06V40/28

    Abstract: The technology disclosed relates to simplifying updating of a predictive model using clustering observed points. In particular, it relates to observing a set of points in 3D sensory space, determining surface normal directions from the points, clustering the points by their surface normal directions and adjacency, accessing a predictive model of a hand, refining positions of segments of the predictive model, matching the clusters of the points to the segments, and using the matched clusters to refine the positions of the matched segments. It also relates to distinguishing between alternative motions between two observed locations of a control object in a 3D sensory space by accessing first and second positions of a segment of a predictive model of a control object such that motion between the first position and the second position was at least partially occluded from observation in a 3D sensory space.

Patent Agency Ranking