公开(公告)号：US10275023B2

公开(公告)日：2019-04-30

申请号：US15386594

申请日：2016-12-21

Applicant: Google Inc.

Inventor： Chris McKenzie ,  Chun Yat Frank Li ,  Hayes S. Raffle

IPC: G06F3/01 ,  G06F3/023 ,  G06F3/0482 ,  G06F3/0488 ,  G06F3/038 ,  G06F3/0346 ,  G06F3/0484 ,  G06T19/00

Abstract: In a virtual reality system, an optical tracking device may detect and track a user's eye gaze direction and/or movement, and/or sensors may detect and track a user's head gaze direction and/or movement, relative to virtual user interfaces displayed in a virtual environment. A processor may process the detected gaze direction and/or movement as a user input, and may translate the user input into a corresponding interaction in the virtual environment. Gaze directed swipes on a virtual keyboard displayed in the virtual environment may be detected and tracked, and translated into a corresponding text input, either alone or together with user input(s) received by the controller. The user may also interact with other types of virtual interfaces in the virtual environment using gaze direction and movement to provide an input, either alone or together with a controller input.

公开(公告)号：US20170330387A1

公开(公告)日：2017-11-16

申请号：US15594186

申请日：2017-05-12

Applicant: Google Inc.

Inventor： David Dearman ,  Chun Yat Frank Li ,  Erica Morse

IPC: G06T19/20 ,  G06F3/02 ,  G06F3/01 ,  G06F3/0346

CPC classification number: G06T19/20 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/02 ,  G06F3/0346 ,  G06F3/0383 ,  G06T2219/2004

Abstract: Systems, devices, methods, computer program products, and electronic apparatuses for aligning components in virtual reality environments are provided. An example method includes detecting a first input from a handheld controller of a virtual reality system, responsive to detecting the first input, instructing a user to orient a handheld controller in a designated direction, detecting a second input from the handheld controller; and responsive to detecting the second input, storing alignment data representative of an alignment of the handheld controller.

公开(公告)号：US09575563B1

公开(公告)日：2017-02-21

申请号：US14144177

申请日：2013-12-30

Applicant: Google Inc.

Inventor： Chun Yat Frank Li ,  Daniel Rodriguez Magana ,  Thiago Teixeira ,  Charles Chen ,  Anand Agarawala

IPC: G06F3/041 ,  G06F3/01 ,  G10L15/00 ,  G06F3/044 ,  G02B27/01

CPC classification number: G06F3/167 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/0141 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/017 ,  G06F3/03547 ,  G06F3/038 ,  G06F3/044 ,  G06F3/0484 ,  G06F3/04883 ,  G06F9/453 ,  G06Q30/0601 ,  G10L15/00 ,  G10L15/26 ,  G10L15/265 ,  G10L15/30

Abstract: Embodiments may relate to intuitive user-interface features for a head-mountable device (HMD), in the context of a hybrid human and computer-automated response system. An illustrative method may involve a head-mountable device (HMD) that comprises a touchpad: (a) sending a speech-segment message to a hybrid response system, wherein the speech-segment message is indicative of a speech segment that is detected in audio data captured at the HMD, and wherein the speech-segment is associated with a first user-account with the hybrid response system, (b) receiving a response message that includes a response to the speech-segment message and an indication of a next action corresponding to the response to the speech-segment message, (c) displaying a card interface that includes an indication of the response, and (d) while displaying the response, detecting a singular touch gesture and responsively initiating the at least one next action.

Abstract translation: 实施例可以涉及在混合式人机和计算机自动化响应系统的上下文中用于可头戴式设备（HMD）的直观用户界面特征。 说明性方法可以涉及包括触摸板的可头戴式装置（HMD）：（a）向混合响应系统发送语音段消息，其中所述语音段消息指示在音频中检测到的语音段 在HMD处捕获的数据，并且其中所述语音段与具有所述混合响应系统的第一用户帐户相关联，（b）接收包括对所述语音段消息的响应的响应消息和下一动作的指示 （c）显示包括所述响应的指示的卡接口，以及（d）在显示所述响应的同时，检测单个触摸手势并且响应地启动所述至少一个下一个动作。

公开(公告)号：US09285872B1

公开(公告)日：2016-03-15

申请号：US14103980

申请日：2013-12-12

Applicant: Google Inc.

Inventor： Hayes Solos Raffle ,  Chun Yat Frank Li

IPC: G09G5/00 ,  G06F3/01 ,  G02B27/01

CPC classification number: G06F3/012 ,  G02B27/0093 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346

Abstract: Embodiments described herein may help to provide a wake-up mechanism for a computing device. An example method involves, the computing device: (a) receiving head-movement data that is indicative of head movement; (b) detecting at least a portion of the head-movement data that is indicative of a head gesture; (c) receiving eye-position data that is indicative of eye position; (d) detecting at least a portion of the eye-position data that is indicative of an eye being directed towards a display of a head-mounted device (HMD); and (e) causing the HMD to switch from a first operating mode to a second operating mode in response to the detection of both: (i) the eye-movement data that is indicative of an eye directed towards the display, and (ii) the head-movement data indicative of the head gesture.

Abstract translation: 本文描述的实施例有助于为计算设备提供唤醒机制。 一个示例性方法涉及计算设备：（a）接收指示头部移动的头部移动数据; （b）检测指示头部手势的头部移动数据的至少一部分; （c）接收指示眼睛位置的眼位置数据; （d）检测指示眼睛指向头戴式装置（HMD）的显示器的眼睛位置数据的至少一部分; 以及（e）响应于两者的检测，使HMD从第一操作模式切换到第二操作模式：（i）指示针对显示器的眼睛的眼睛运动数据，以及（ii） 表示头部手势的头部移动数据。

公开(公告)号：US10509487B2

公开(公告)日：2019-12-17

申请号：US15379770

申请日：2016-12-15

Applicant: Google Inc.

Inventor： David Dearman ,  Chun Yat Frank Li

IPC: G06F3/0488 ,  G06F3/0485 ,  G06F3/0346 ,  G06F3/0484 ,  G06T19/00 ,  G06F1/16 ,  G06F3/01 ,  H04N21/41 ,  G02B27/01

Abstract: A system for combining a gyromouse input with a touch surface input in an augmented reality (AR) environment and/or a virtual reality (VR) environment, a virtual display of virtual items and/or features may be adjusted in response to movement of the gyromouse combined with touch inputs, or touch and drag inputs, received on a touch surface of the gyromouse. Use of the gyromouse in the AR/VR environment may allow touch screen capabilities to be accurately projected into a three dimensional virtual space, providing a controller having improved functionality and utility in the AR/VR environment, and enhancing the user's experience.

公开(公告)号：US20170336915A1

公开(公告)日：2017-11-23

申请号：US15585905

申请日：2017-05-03

Applicant: Google Inc.

Inventor： Chun Yat Frank Li ,  Hayes S. Raffle ,  Eric Allan MacIntosh

IPC: G06F3/041 ,  G06T3/20 ,  G09G5/12 ,  G06F3/045 ,  G06F3/044

Abstract: A method for aligning an image on a mobile device disposed within a head-mounted display (HMD) housing includes: detecting a request to align an image on a touchscreen of a mobile device; detecting, on the touchscreen, a first detected location corresponding to a first touchscreen input event; determining a first displacement of the first detected location with respect to a first target location of the first touchscreen input event; and transposing the image on the touchscreen based on the first displacement. A virtual reality system includes: a mobile device having a touchscreen configured to display an image; and a HMD housing having a first contact configured to generate a first input event at a first location on the touchscreen when the mobile device is disposed within the HMD housing.

公开(公告)号：US20170139567A1

公开(公告)日：2017-05-18

申请号：US13935125

申请日：2013-07-03

Applicant: Google Inc.

Inventor： Chun Yat Frank Li

IPC: G06F3/0487

CPC classification number: G06F3/0487 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/017

Abstract: Embodiments described herein may help to provide a lock-screen for a computing device. An example method involves: (a) displaying two or more rows of characters and an input region that is moveable over the rows of characters, (b) based on head-movement data, determining movement of the input region with respect to the rows of characters, (c) determining an input sequence, where the sequence includes one character from each of the rows of characters that is selected based at least in part on the one or more movements of the input region with respect to the rows of characters, (d) determining whether or not the input sequence matches a predetermined unlock sequence, and (e) if the input sequence matches the predetermined unlock sequence, then unlocking the computing device.

公开(公告)号：US09547365B2

公开(公告)日：2017-01-17

申请号：US14486360

申请日：2014-09-15

Applicant: Google Inc.

Inventor： Hayes Solos Raffle ,  Michael Patrick Johnson ,  Alok Chandel ,  Chun Yat Frank Li

IPC: G06F3/01 ,  G06F3/0482 ,  G02B27/01

CPC classification number: G06F3/013 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/0482

Abstract: An example method includes receiving, by a head-mountable device (HMD), data corresponding to an information event, and providing an indication corresponding to the information event in response to receiving the data. The method further includes determining a gaze direction of an eye and determining that the gaze direction of the eye is an upward direction that corresponds to a location of a display of the HMD. The display is located in an upper periphery of a forward-looking field of view of the eye when the HMD is worn. The method further includes, in response to determining that the gaze direction of the eye is the upward direction, displaying graphical content related to the information event in the display.

Abstract translation: 一种示例性方法包括由可头戴式装置（HMD）接收对应于信息事件的数据，以及响应于接收到的数据提供对应于该信息事件的指示。 该方法还包括确定眼睛的凝视方向并确定眼睛的视线方向是与HMD的显示位置对应的向上方向。 当HMD磨损时，显示器位于眼睛的前视视野的上边缘。 该方法还包括响应于确定眼睛的注视方向是向上方向，在显示器中显示与信息事件相关的图形内容。

公开(公告)号：US20150130688A1

公开(公告)日：2015-05-14

申请号：US14078255

申请日：2013-11-12

Applicant: Google Inc.

Inventor： Chun Yat Frank Li ,  Nirmal Patel

IPC: G02B27/01

CPC classification number: G02B27/017 ,  G02B2027/014 ,  G02B2027/0178

Abstract: Methods and systems are described herein for providing text to a head-mountable display (HMD) from a remote device. The remote device can receive a notification of an event related to the HMD. The remote device can determine whether the event corresponds to a text input for the HMD. After determining that the event does corresponds to the text input, the remote device can: cause a display of a text-input interface on the HMD, receive text using a text-input component of the remote device, and send the text to the HMD.

Abstract translation: 本文描述了将方法和系统从远程设备提供到可头戴式显示器（HMD）的文本。 远程设备可以接收与HMD相关的事件的通知。 远程设备可以确定事件是否对应于HMD的文本输入。 在确定事件对应于文本输入后，远程设备可以：在HMD上显示文本输入接口，使用远程设备的文本输入组件接收文本，并将文本发送到HMD 。