-
公开(公告)号:US20180011534A1
公开(公告)日:2018-01-11
申请号:US15714063
申请日:2017-09-25
发明人: Adam Poulos , Cameron Brown , Daniel McCulloch , Jeff Cole
IPC分类号: G06F3/01
摘要: Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes receiving a user input selecting an object in a field of view of the see-through display system, determining a first group of commands currently operable based on one or more of an identification of the selected object and a state of the object, and presenting the first group of commands to a user. The method may further include receiving a command from the first group of commands, changing the state of the selected object from a first state to a second state in response to the command, determining a second group of commands based on the second state, where the second group of commands is different than the first group of commands, and presenting the second group of commands to the user.
-
公开(公告)号:US09280972B2
公开(公告)日:2016-03-08
申请号:US13892094
申请日:2013-05-10
发明人: Daniel McCulloch , Abby Lin Lee , Adam Benjamin Smith-Kipnis , Jonathan William Plumb , Alexandre David , Michael O Hale , Jeff Cole , Hendrik Mark Langerak
摘要: Embodiments that relate to converting audio inputs from an environment into text are disclosed. For example, in one disclosed embodiment a speech conversion program receives audio inputs from a microphone array of a head-mounted display device. Image data is captured from the environment, and one or more possible faces are detected from image data. Eye-tracking data is used to determine a target face on which a user is focused. A beamforming technique is applied to at least a portion of the audio inputs to identify target audio inputs that are associated with the target face. The target audio inputs are converted into text that is displayed via a transparent display of the head-mounted display device.
摘要翻译: 公开了将音频输入从环境转换为文本的实施例。 例如,在一个公开的实施例中,语音转换程序从头戴式显示设备的麦克风阵列接收音频输入。 从环境中捕获图像数据,并且从图像数据检测到一个或多个可能的面。 眼睛跟踪数据用于确定用户聚焦的目标脸部。 波束形成技术被应用于至少一部分音频输入以识别与目标面相关联的目标音频输入。 目标音频输入被转换成通过头戴式显示设备的透明显示器显示的文本。
-
公开(公告)号:US10705602B2
公开(公告)日:2020-07-07
申请号:US15714063
申请日:2017-09-25
发明人: Adam Poulos , Cameron Brown , Daniel McCulloch , Jeff Cole
摘要: Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes receiving a user input selecting an object in a field of view of the see-through display system, determining a first group of commands currently operable based on one or more of an identification of the selected object and a state of the object, and presenting the first group of commands to a user. The method may further include receiving a command from the first group of commands, changing the state of the selected object from a first state to a second state in response to the command, determining a second group of commands based on the second state, where the second group of commands is different than the first group of commands, and presenting the second group of commands to the user.
-
公开(公告)号:US09791921B2
公开(公告)日:2017-10-17
申请号:US13770725
申请日:2013-02-19
发明人: Adam Poulos , Cameron Brown , Daniel McCulloch , Jeff Cole
CPC分类号: G06F3/013 , G06F3/011 , G06F2203/0381
摘要: Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes receiving a user input selecting an object in a field of view of the see-through display system, determining a first group of commands currently operable based on one or more of an identification of the selected object and a state of the object, and presenting the first group of commands to a user. The method may further include receiving a command from the first group of commands, changing the state of the selected object from a first state to a second state in response to the command, determining a second group of commands based on the second state, where the second group of commands is different than the first group of commands, and presenting the second group of commands to the user.
-
公开(公告)号:US09710130B2
公开(公告)日:2017-07-18
申请号:US13916193
申请日:2013-06-12
发明人: Kathleen Mulcahy , Aaron Burns , Todd Omotani , Felicia Williams , Jeff Cole , Tim Psiaki
IPC分类号: G06F3/048 , G06F3/0481 , G06F3/01 , G06F3/0482 , G06F3/0487
CPC分类号: G06F3/04815 , G06F3/012 , G06F3/013 , G06F3/0482 , G06F3/0487
摘要: A user input for a near-eye, see-through display device is disclosed. Hands-free user input in an augmented reality environment is provided for. A user can provide input by moving the orientation of their head. For example, the user could rotate their head. In one aspect, a user can provide input by moving their eye gaze along a direction. In one aspect, when the user directs their attention at a user interface symbol, a handle extends away from the user interface symbol. The handle may serve as a type of selection device such that if the user directs their attention along the handle, away from the user interface symbol, a selection can be made. “As one example, the selection causes a spoke menu to appear which the user can select by rotating their head such that the system determines the user is looking along the spoke away from a central hub.
-
-
-
-