公开(公告)号：US20220385804A1

公开(公告)日：2022-12-01

申请号：US17887378

申请日：2022-08-12

Applicant: Ultrahaptics IP Two Limited

Inventor： David S. HOLZ

IPC: H04N5/232 ,  G06T7/50 ,  G06V40/20 ,  G06T7/70

Abstract: The technology disclosed relates to adjusting the monitored field of view of a camera and/or a view of a virtual scene from a point of view of a virtual camera based on the distance between tracked objects. For example, if the user's hand is being tracked for gestures, the closer the hand gets to another object, the tighter the frame can become—i.e., the more the camera can zoom in so that the hand and the other object occupy most of the frame. The camera can also be reoriented so that the hand and the other object remain in the center of the field of view. The distance between two objects in a camera's field of view can be determined and a parameter adjusted based thereon. In particular, the pan and/or zoom levels of the camera may be adjusted in accordance with the distance.

公开(公告)号：US20220350417A1

公开(公告)日：2022-11-03

申请号：US17862212

申请日：2022-07-11

Applicant: Ultrahaptics IP Two Limited

Inventor： David S. HOLZ

IPC: G06F3/01 ,  G06K9/00 ,  G06F3/03 ,  G06V10/145 ,  G06V40/10

Abstract: A region of space may be monitored for the presence or absence of one or more control objects, and object attributes and changes thereto may be interpreted as control information provided as input to a machine or application. In some embodiments, the region is monitored using a combination of scanning and image-based sensing.

公开(公告)号：US20220198776A1

公开(公告)日：2022-06-23

申请号：US17693200

申请日：2022-03-11

Applicant: Ultrahaptics IP Two Limited

Inventor： David S. HOLZ ,  Hua Yang

IPC: G06V10/75 ,  G06T7/246 ,  G06T7/254 ,  H04N13/254 ,  G06T7/70 ,  G06T7/11 ,  G06T7/215 ,  G06F3/01 ,  G06F3/03 ,  H04N5/232 ,  G06V10/25 ,  G06V10/40 ,  G06V10/141 ,  G06V20/64 ,  G06V40/10 ,  G06T7/194 ,  G06T7/10 ,  G06T7/262 ,  G06T7/33 ,  G06T7/37 ,  G06T7/90

Abstract: A method for detecting a finger is provided. The method includes obtaining a plurality of digital images including a first digital image captured by a camera from a field of view containing a background and a hand including at least one finger, and obtaining an identification of pixels of the plurality of digital images that correspond to at least one finger that is visible in the plurality of digital images rather than to the background, the pixels being identified by: obtaining, from the digital images, a Gaussian brightness falloff pattern indicative of at least one finger, identifying an axis of the at least one finger based on the obtained Gaussian brightness falloff pattern indicative of the at least one finger without identifying edges of the at least one finger, and identifying the pixels that correspond to the at least one finger based on the identified axis.

公开(公告)号：US20210256182A1

公开(公告)日：2021-08-19

申请号：US17308903

申请日：2021-05-05

Applicant: Ultrahaptics IP Two Limited

Inventor： David S. HOLZ ,  Kevin HOROWITZ ,  Raffi BEDIKIAN ,  Hua YANG

IPC: G06F30/20 ,  G06K9/00 ,  G06F3/01

Abstract: The technology disclosed relates to simplifying updating of a predictive model using clustering observed points. In particular, it relates to observing a set of points in 3D sensory space, determining surface normal directions from the points, clustering the points by their surface normal directions and adjacency, accessing a predictive model of a hand, refining positions of segments of the predictive model, matching the clusters of the points to the segments, and using the matched clusters to refine the positions of the matched segments. It also relates to distinguishing between alternative motions between two observed locations of a control object in a 3D sensory space by accessing first and second positions of a segment of a predictive model of a control object such that motion between the first position and the second position was at least partially occluded from observation in a 3D sensory space.

公开(公告)号：US20210181859A1

公开(公告)日：2021-06-17

申请号：US17189152

申请日：2021-03-01

Applicant: Ultrahaptics IP Two Limited

Inventor： Kevin A. HOROWITZ ,  Matias PEREZ ,  Raffi BEDIKIAN ,  David S. HOLZ ,  Gabriel A. HARE

IPC: G06F3/01 ,  G06K9/00 ,  G06F3/03 ,  G06T7/20 ,  G06T19/00 ,  H04N13/296 ,  G06F3/0346 ,  G06T7/246 ,  G01S3/00

Abstract: The technology disclosed relates to relates to providing command input to a machine under control. It further relates to gesturally interacting with the machine. The technology disclosed also relates to providing monitoring information about a process under control. The technology disclosed further relates to providing biometric information about an individual. The technology disclosed yet further relates to providing abstract features information (pose, grab strength, pinch strength, confidence, and so forth) about an individual.

公开(公告)号：US20200241651A1

公开(公告)日：2020-07-30

申请号：US16848703

申请日：2020-04-14

Applicant: Ultrahaptics IP Two Limited

Inventor： David S. HOLZ

IPC: G06F3/01 ,  G06K9/00

Abstract: The technology disclosed relates to filtering gestures, according to one implementation. In particular, it relates to distinguishing between interesting gestures from non-interesting gestures in a three-dimensional (3D) sensory space by comparing characteristics of user-defined reference gestures against characteristics of actual gestures performed in the 3D sensory space. Based on the comparison, a set of gestures of interest are filtered from all the gestures performed in the 3D sensory space. The technology disclosed also relates to customizing gesture interpretation for a particular user, according to another implementation. In particular, it relates to setting parameters for recognizing gestures by prompting the user to select values for characteristics of the gestures. In one implementation, the technology disclosed includes performing characteristic focused demonstrations of boundaries of the gesture. It further includes testing the interpretation of gestures by prompting the user to perform complete gesture demonstrations and receiving evaluation from the user regarding the interpretation.

公开(公告)号：US20200033951A1

公开(公告)日：2020-01-30

申请号：US16588876

申请日：2019-09-30

Applicant: Ultrahaptics IP Two Limited

Inventor： Kevin A. HOROWITZ ,  Matias PEREZ ,  Raffi BEDIKIAN ,  David S. HOLZ ,  Gabriel A. HARE

IPC: G06F3/01 ,  G06F3/0346 ,  G06K9/00 ,  G06F3/03 ,  G06T7/20 ,  G06T19/00 ,  H04N13/296 ,  G06T7/246 ,  G01S3/00

Abstract: The technology disclosed relates to relates to providing command input to a machine under control. It further relates to gesturally interacting with the machine. The technology disclosed also relates to providing monitoring information about a process under control. The technology disclosed further relates to providing biometric information about an individual. The technology disclosed yet further relates to providing abstract features information (pose, grab strength, pinch strength, confidence, and so forth) about an individual.

公开(公告)号：US20240143871A1

公开(公告)日：2024-05-02

申请号：US18406059

申请日：2024-01-05

Applicant: ULTRAHAPTICS IP TWO LIMITED

Inventor： David S. HOLZ ,  Kevin HOROWITZ ,  Raffi BEDIKIAN ,  Hua YANG

IPC: G06F30/20 ,  G06F3/01 ,  G06V20/64 ,  G06V40/20

CPC classification number: G06F30/20 ,  G06F3/017 ,  G06V20/64 ,  G06V40/28

Abstract: The technology disclosed relates to simplifying updating of a predictive model using clustering observed points. In particular, it relates to observing a set of points in 3D sensory space, determining surface normal directions from the points, clustering the points by their surface normal directions and adjacency, accessing a predictive model of a hand, refining positions of segments of the predictive model, matching the clusters of the points to the segments, and using the matched clusters to refine the positions of the matched segments. It also relates to distinguishing between alternative motions between two observed locations of a control object in a 3D sensory space by accessing first and second positions of a segment of a predictive model of a control object such that motion between the first position and the second position was at least partially occluded from observation in a 3D sensory space.

公开(公告)号：US20240004479A1

公开(公告)日：2024-01-04

申请号：US18369768

申请日：2023-09-18

Applicant: Ultrahaptics IP Two Limited

Inventor： David S. HOLZ ,  Hua YANG

IPC: G06F3/01 ,  G06T7/246 ,  G06T7/254 ,  H04N13/254 ,  G06T7/70 ,  G06T7/11 ,  G06T7/215 ,  G06F3/03 ,  G06V20/64 ,  G06V40/10 ,  H04N23/661 ,  G06T7/194 ,  G06T7/10 ,  G06T7/262 ,  G06T7/33 ,  G06T7/37 ,  G06T7/90

CPC classification number: G06F3/017 ,  G06T7/248 ,  G06T7/254 ,  G06T7/251 ,  H04N13/254 ,  G06T7/70 ,  G06T7/11 ,  G06T7/215 ,  G06F3/0304 ,  G06V20/64 ,  G06V40/107 ,  H04N23/661 ,  G06T7/194 ,  G06T7/10 ,  G06T7/262 ,  G06T7/344 ,  G06T7/37 ,  G06T7/90 ,  G06F18/00

Abstract: A method for detecting a finger is provided. The method includes obtaining a plurality of digital images including a first digital image captured by a camera from a field of view containing a background and a hand including at least one finger, and obtaining an identification of pixels of the plurality of digital images that correspond to at least one finger that is visible in the plurality of digital images rather than to the background, the pixels being identified by: obtaining, from the digital images, a Gaussian brightness falloff pattern indicative of at least one finger, identifying an axis of the at least one finger based on the obtained Gaussian brightness falloff pattern indicative of the at least one finger without identifying edges of the at least one finger, and identifying the pixels that correspond to the at least one finger based on the identified axis.

公开(公告)号：US20240004438A1

公开(公告)日：2024-01-04

申请号：US18370338

申请日：2023-09-19

Applicant: ULTRAHAPTICS IP TWO LIMITED

Inventor： David S. HOLZ ,  Paul DURDIK

IPC: G06F1/16 ,  G06F3/01 ,  G06F3/00 ,  G06F3/042 ,  H04N23/67 ,  H04N23/90 ,  G02B5/04 ,  G02B7/18

CPC classification number: G06F1/1686 ,  G06F3/017 ,  G06F3/005 ,  G06F3/0425 ,  H04N23/67 ,  H04N23/90 ,  G02B5/04 ,  G02B5/045 ,  G02B7/1805 ,  G06F2200/1633

Abstract: The technology disclosed relates to enhancing the fields of view of one or more cameras of a gesture recognition system for augmenting the three-dimensional (3D) sensory space of the gesture recognition system. The augmented 3D sensory space allows for inclusion of previously uncaptured of regions and points for which gestures can be interpreted i.e. blind spots of the cameras of the gesture recognition system. Some examples of such blind spots include areas underneath the cameras and/or within 20-85 degrees of a tangential axis of the cameras. In particular, the technology disclosed uses a Fresnel prismatic element and/or a triangular prism element to redirect the optical axis of the cameras, giving the cameras fields of view that cover at least 45 to 80 degrees from tangential to the vertical axis of a display screen on which the cameras are mounted.