Touchscreen hover detection in an augmented and/or virtual reality environment

    公开(公告)号:US10338673B2

    公开(公告)日:2019-07-02

    申请号:US15251573

    申请日:2016-08-30

    Applicant: GOOGLE INC.

    Abstract: A system for detecting and tracking a hover position of a manual pointing device, such as finger(s), on a handheld electronic device may include overlaying a rendered mono-chromatic keying screen, or green screen, on a user interface, such as a keyboard, of the handheld electronic device. A position of the finger(s) relative to the keyboard may be determined based on the detection of the finger(s) on the green screen and a known arrangement of the keyboard. An image of the keyboard and the position of the finger(s) may be rendered and displayed, for example, on a head mounted display, to facilitate user interaction via the keyboard with a virtual immersive experience generated by the head mounted display.

    CONTROLLER TRACKING FOR MULTIPLE DEGREES OF FREEDOM

    公开(公告)号:US20190033988A1

    公开(公告)日:2019-01-31

    申请号:US15660216

    申请日:2017-07-26

    Applicant: Google Inc.

    Abstract: A method for controller tracking with multiple degrees of freedom includes generating depth data at an electronic device based on a local environment proximate the electronic device. A set of positional data is generated for at least one spatial feature associated with a controller based on a pose of the electronic device, as determined using the depth data, relative to the at least one spatial feature associated with the controller. A set of rotational data is received that represents three degrees-of-freedom (3DoF) orientation of the controller within the local environment, and a six degrees-of-freedom (6DoF) position of the controller within the local environment is tracked based on the set of positional data and the set of rotational data.

    SYSTEM FOR TRACKING A HANDHELD DEVICE IN VIRTUAL REALITY
    7.
    发明申请
    SYSTEM FOR TRACKING A HANDHELD DEVICE IN VIRTUAL REALITY 审中-公开
    用于在虚拟现实中跟踪手持设备的系统

    公开(公告)号:US20170011553A1

    公开(公告)日:2017-01-12

    申请号:US15193777

    申请日:2016-06-27

    Applicant: Google Inc.

    Abstract: A system for tracking a first electronic device, such as a handheld smartphone, in a virtual reality environment generated by a second electronic device, such as a head mounted display may include detection, by a camera included in one of the first electronic device or the second electronic device, of at least one visual marker included on the other of the first electronic device or the second electronic device. Features detected within the field of view corresponding to known features of the visual markers may be used to locate and track movement of the first electronic device relative to the second electronic device, so that movement of the second electronic device may be translated into an interaction in a virtual experience generated by the second electronic device.

    Abstract translation: 用于跟踪由诸如头戴式显示器的第二电子设备产生的虚拟现实环境中的诸如手持式智能手机的第一电子设备的系统可以包括通过包括在第一电子设备之一或 第二电子设备,包括在第一电子设备或第二电子设备中的另一个上的至少一个视觉标记。 在与视觉标记的已知特征相对应的视野内检测到的特征可以用于定位和跟踪第一电子设备相对于第二电子设备的移动,使得第二电子设备的移动可以被转换为 由第二电子设备产生的虚拟体验。

Patent Agency Ranking