公开(公告)号：US10671172B2

公开(公告)日：2020-06-02

申请号：US15696084

申请日：2017-09-05

Applicant: Ultrahaptics IP Two Limited

Inventor： David Holz

IPC: G06F3/01 ,  G06F3/03

Abstract: The technology disclosed relates to using gestures to supplant or augment use of a standard input device coupled to a system. It also relates to controlling a display using gestures. It further relates to controlling a system using more than one input device. In particular, it relates to detecting a standard input device that causes on-screen actions on a display in response to control manipulations performed using the standard input device. Further, a library of analogous gestures is identified, which includes gestures that are analogous to the control manipulations and also cause the on-screen actions responsive to the control manipulations. Thus, when a gesture from the library of analogous gestures is detected, a signal is generated that mimics a standard signal from the standard input device and causes at least one on-screen action.

公开(公告)号：US11874970B2

公开(公告)日：2024-01-16

申请号：US17833556

申请日：2022-06-06

Applicant: Ultrahaptics IP Two Limited

Inventor： Raffi Bedikian ,  Jonathan Marsden ,  Keith Mertens ,  David Holz

IPC: G06F3/01 ,  G06F3/03 ,  G06V40/20 ,  G06F3/04845

CPC classification number: G06F3/017 ,  G06F3/011 ,  G06F3/0304 ,  G06F3/04845 ,  G06V40/20

Abstract: During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.

公开(公告)号：US12293478B2

公开(公告)日：2025-05-06

申请号：US18629845

申请日：2024-04-08

Applicant: Ultrahaptics IP Two Limited

Inventor： Alex Marcolina ,  David Holz

IPC: G06T19/00 ,  G06F3/01 ,  G06T7/73 ,  G06T19/20 ,  G06V20/20 ,  G06V40/20

Abstract: The technology disclosed relates to a method of realistic rendering of a real object as a virtual object in a virtual space using an offset in the position of the hand in a three-dimensional (3D) sensory space. An offset between expected positions of the eye(s) of a wearer of a head mounted device and a sensor attached to the head mounted device for sensing a position of at least one hand in a three-dimensional (3D) sensory space is determined. A position of the hand in the three-dimensional (3D) sensory space can be sensed using a sensor. The sensed position of the hand can be transformed by the offset into a re-rendered position of the hand as would appear to the wearer of the head mounted device if the wearer were looking at the actual hand. The re-rendered hand can be depicted to the wearer of the head mounted device.

公开(公告)号：US20240419256A1

公开(公告)日：2024-12-19

申请号：US18820050

申请日：2024-08-29

Applicant: Ultrahaptics IP Two Limited

Inventor： David Holz

IPC: G06F3/01 ,  G06F3/03 ,  G06F9/4401 ,  G06F13/10 ,  G06F16/50

Abstract: The technology disclosed relates to using gestures to supplant or augment use of a standard input device coupled to a system. It also relates to controlling a display using gestures. It further relates to controlling a system using more than one input device. In particular, it relates to detecting a standard input device that causes on-screen actions on a display in response to control manipulations performed using the standard input device. Further, a library of analogous gestures is identified, which includes gestures that are analogous to the control manipulations and also cause the on-screen actions responsive to the control manipulations. Thus, when a gesture from the library of analogous gestures is detected, a signal is generated that mimics a standard signal from the standard input device and causes at least one on-screen action.

公开(公告)号：US12147609B2

公开(公告)日：2024-11-19

申请号：US18387142

申请日：2023-11-06

Applicant: ULTRAHAPTICS IP TWO LIMITED

Inventor： David Holz

IPC: G06F3/01 ,  G06F3/03 ,  G06F3/042 ,  G06T7/55 ,  G06V10/20 ,  G06V10/40 ,  G06V20/64 ,  G09G3/34 ,  H04N23/71 ,  H04N23/73 ,  H04N23/74 ,  G06V20/20

Abstract: The technology disclosed relates to identifying an object in a field of view of a camera. In particular, it relates to identifying a display in the field of view of the camera. This is achieved by monitoring a space including acquiring a series of image frames of the space using the camera and detecting one or more light sources in the series of image frames. Further, one or more frequencies of periodic intensity or brightness variations, also referred to as ‘refresh rate’, of light emitted from the light sources is measured. Based on the one or more frequencies of periodic intensity variations of light emitted from the light sources, at least one display that includes the light sources is identified.

公开(公告)号：US12086323B2

公开(公告)日：2024-09-10

申请号：US17532990

申请日：2021-11-22

Applicant: Ultrahaptics IP Two Limited

Inventor： David Holz

IPC: G06F3/01 ,  G06F3/03 ,  G06F9/4401 ,  G06F13/10 ,  G06F16/50

CPC classification number: G06F3/017 ,  G06F3/0304 ,  G06F9/4411 ,  G06F13/105 ,  G06F16/50 ,  G06F2203/0382

Abstract: A method and system for controlling an electronic device using gesture and/or a device is provided. The method includes capturing, in a 3D sensor space, an image including a user manipulable hand-held input device and a body part of a user, finding an entry in a database of multiple user manipulable hand-held input devices that matches the image of the user manipulable hand-held input device, wherein each user manipulable hand-held input device, having an entry in the database, respectively generates signals in response to performing one or more specific control manipulations, determining a primary control mode of primarily controlling the electronic device using 3D gestures or using control manipulations directly from the user manipulable hand-held input device, the primary control mode being determined based on a predetermined priority level associated with the user manipulable hand-held input device and controlling the electronic device using the determined primary control mode.

公开(公告)号：US11775078B2

公开(公告)日：2023-10-03

申请号：US17865283

申请日：2022-07-14

Applicant: Ultrahaptics IP Two Limited

Inventor： David Holz

IPC: G06F3/01 ,  G06F3/00

CPC classification number: G06F3/017 ,  G06F3/005

Abstract: The technology disclosed relates to operating a motion-capture system responsive to available computational resources. In particular, it relates to assessing a level of image acquisition and image-analysis resources available using benchmarking of system components. In response, one or more image acquisition parameters and/or image-analysis parameters are adjusted. Acquisition and/or analysis of image data are then made compliant with the adjusted image acquisition parameters and/or image-analysis parameters. In some implementations, image acquisition parameters include frame resolution and frame capture rate and image-analysis parameters include analysis algorithm and analysis density.

公开(公告)号：US11740705B2

公开(公告)日：2023-08-29

申请号：US17666534

申请日：2022-02-07

Applicant: Ultrahaptics IP Two Limited

Inventor： Raffi Bedikian ,  Jonathan Marsden ,  Keith Mertens ,  David Holz ,  Maxwell Sills ,  Matias Perez ,  Gabriel Hare ,  Ryan Julian

IPC: G06F3/01 ,  G06F3/04815 ,  G06F3/03 ,  G06V40/20

CPC classification number: G06F3/017 ,  G06F3/0325 ,  G06F3/04815 ,  G06V40/20

Abstract: A method and system are provided for controlling a machine using gestures. The method includes sensing a variation of position of a control object using an imaging system, determining, from the variation, one or more primitives describing a characteristic of a control object moving in space, comparing the one or more primitives to one or more gesture templates in a library of gesture templates, selecting, based on a result of the comparing, one or more gesture templates corresponding to the one or more primitives, and providing at least one gesture template of the selected one or more gesture templates as an indication of a command to issue to a machine under control responsive to the variation.

公开(公告)号：US20220277527A1

公开(公告)日：2022-09-01

申请号：US17666533

申请日：2022-02-07

Applicant: Ultrahaptics IP Two Limited

Inventor： Alex Marcolina ,  David Holz

IPC: G06T19/00 ,  G06T19/20 ,  G06F3/01 ,  G06V40/20 ,  G06T7/73 ,  G06V20/20

Abstract: The technology disclosed relates to a method of realistic rendering of a real object as a virtual object in a virtual space using an offset in the position of the hand in a three-dimensional (3D) sensory space. An offset between expected positions of the eye(s) of a wearer of a head mounted device and a sensor attached to the head mounted device for sensing a position of at least one hand in a three-dimensional (3D) sensory space is determined. A position of the hand in the three-dimensional (3D) sensory space can be sensed using a sensor. The sensed position of the hand can be transformed by the offset into a re-rendered position of the hand as would appear to the wearer of the head mounted device if the wearer were looking at the actual hand. The re-rendered hand can be depicted to the wearer of the head mounted device.

公开(公告)号：US11035926B2

公开(公告)日：2021-06-15

申请号：US16403481

申请日：2019-05-03

Applicant: Ultrahaptics IP Two Limited

Inventor： David Holz

IPC: G06T7/70 ,  G01S3/786 ,  G01S17/46

Abstract: A method and system determines object orientation using a light source to create a shadow line extending from the light source. A camera captures an image including the shadow line on an object surface. An orientation module determines the surface orientation from the shadow line. In some examples a transparency imperfection in a window through which a camera receives light can be detected and a message sent to a user as to the presence of a light-blocking or light-distorting substance or particle. A system can control illumination while imaging an object in space using a light source mounted to a support structure so a camera captures an image of the illuminated object. Direct illumination of the camera by light from the light source can be prevented such as by blocking the light or using a light-transmissive window adjacent the camera to reject light transmitted directly from the light source.