CONTEXT-AWARE AUGMENTED REALITY OBJECT COMMANDS

    公开(公告)号:US20180011534A1

    公开(公告)日:2018-01-11

    申请号:US15714063

    申请日:2017-09-25

    IPC分类号: G06F3/01

    摘要: Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes receiving a user input selecting an object in a field of view of the see-through display system, determining a first group of commands currently operable based on one or more of an identification of the selected object and a state of the object, and presenting the first group of commands to a user. The method may further include receiving a command from the first group of commands, changing the state of the selected object from a first state to a second state in response to the command, determining a second group of commands based on the second state, where the second group of commands is different than the first group of commands, and presenting the second group of commands to the user.

    Speech to text conversion
    2.
    发明授权
    Speech to text conversion 有权
    演讲文字转换

    公开(公告)号:US09280972B2

    公开(公告)日:2016-03-08

    申请号:US13892094

    申请日:2013-05-10

    IPC分类号: G10L15/00 G10L15/26 G06F1/16

    摘要: Embodiments that relate to converting audio inputs from an environment into text are disclosed. For example, in one disclosed embodiment a speech conversion program receives audio inputs from a microphone array of a head-mounted display device. Image data is captured from the environment, and one or more possible faces are detected from image data. Eye-tracking data is used to determine a target face on which a user is focused. A beamforming technique is applied to at least a portion of the audio inputs to identify target audio inputs that are associated with the target face. The target audio inputs are converted into text that is displayed via a transparent display of the head-mounted display device.

    摘要翻译: 公开了将音频输入从环境转换为文本的实施例。 例如,在一个公开的实施例中,语音转换程序从头戴式显示设备的麦克风阵列接收音频输入。 从环境中捕获图像数据,并且从图像数据检测到一个或多个可能的面。 眼睛跟踪数据用于确定用户聚焦的目标脸部。 波束形成技术被应用于至少一部分音频输入以识别与目标面相关联的目标音频输入。 目标音频输入被转换成通过头戴式显示设备的透明显示器显示的文本。

    Context-aware augmented reality object commands

    公开(公告)号:US10705602B2

    公开(公告)日:2020-07-07

    申请号:US15714063

    申请日:2017-09-25

    IPC分类号: G06F3/048 G06F3/01

    摘要: Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes receiving a user input selecting an object in a field of view of the see-through display system, determining a first group of commands currently operable based on one or more of an identification of the selected object and a state of the object, and presenting the first group of commands to a user. The method may further include receiving a command from the first group of commands, changing the state of the selected object from a first state to a second state in response to the command, determining a second group of commands based on the second state, where the second group of commands is different than the first group of commands, and presenting the second group of commands to the user.

    Context-aware augmented reality object commands

    公开(公告)号:US09791921B2

    公开(公告)日:2017-10-17

    申请号:US13770725

    申请日:2013-02-19

    IPC分类号: G06F3/16 G06F3/01

    摘要: Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes receiving a user input selecting an object in a field of view of the see-through display system, determining a first group of commands currently operable based on one or more of an identification of the selected object and a state of the object, and presenting the first group of commands to a user. The method may further include receiving a command from the first group of commands, changing the state of the selected object from a first state to a second state in response to the command, determining a second group of commands based on the second state, where the second group of commands is different than the first group of commands, and presenting the second group of commands to the user.