Methods and apparatus to define virtual scenes using natural language commands and natural gestures

    公开(公告)号:US10403285B1

    公开(公告)日:2019-09-03

    申请号:US15831617

    申请日:2017-12-05

    Applicant: Google LLC

    Abstract: The disclosed methods and apparatus allow a lay person to easily and intuitively define virtual scenes using natural language commands and natural gestures. Natural language commands include statements that a person would naturally (e.g., spontaneously, simply, easily, intuitively, etc.) speak without any or little training. Example natural language commands include “put a cat on the box,” or “put a ball in front of the red box.” Natural gestures include gestures that a person would naturally do, perform or carry out (e.g., spontaneously, simply, easily, intuitively, etc.) without any or little training. Example natural gestures include pointing, a distance between hands, gazing, head tilt, kicking, etc. The person can simply speak and gesture how it naturally occurs to them.

    Virtual instruction tool
    2.
    发明授权

    公开(公告)号:US10810899B1

    公开(公告)日:2020-10-20

    申请号:US15830806

    申请日:2017-12-04

    Applicant: Google LLC

    Abstract: A method includes: identifying a physical environment to be a basis for virtual training, the physical environment associated with performance of operations; creating, in a computer system, a three-dimensional (3D) model of the physical environment; defining, in the computer system, virtual operations to be performable during the virtual training, the virtual operations corresponding to the operations of the physical environment; identifying, in the computer system, a controllable component in the physical environment; creating, in the computer system, a 3D model of the identified controllable component; creating, in the computer system, a state model of the physical environment; and assembling, in the computer system, a virtual environment from the 3D model of the physical environment and the 3D model of the identified controllable component, and associating the created state model with the virtual environment.

Patent Agency Ranking