摘要:
A head mounted display (HMD) device is configured with a sensor package that enables head tracking to determine the device user's proximity to holographic objects in mixed reality or virtual reality environments. A fade volume including concentrically-arranged volumetric shells is placed around the user including a near shell that is closest to the user, and a far shell that is farthest from the user. When a holographic object is beyond the far shell, the HMD device renders the object with full opacity (i.e., with no transparency). As the user moves towards a holographic object and it intersects the far shell, its opacity begins to fade out with increasing transparency to reveal the background behind it. The transparency of the holographic object increases as the object gets closer to the near shell and the object becomes fully transparent when the near shell reaches it so that the background becomes fully visible.
摘要:
An application running on a computing platform that employs three-dimensional (3D) modeling is extended using a virtual viewport into which 3D holograms are rendered by a mixed-reality head mounted display (HMD) device. The HMD device user can position the viewport to be rendered next to a real world 2D monitor and use it as a natural extension of the 3D modeling application. For example, the user can interact with modeled objects in mixed-reality and move objects between the monitor and the viewport. The 3D modeling application and HMD device are configured to exchange scene data for modeled objects (such as geometry, lighting, rotation, scale) and user interface parameters (such as mouse and keyboard inputs). The HMD device implements head tracking to determine where the user is looking so that user inputs are appropriately directed to the monitor or viewport.
摘要:
An HMD device renders a virtual reality environment in which areas of the real world are masked out so that real world objects such as computer monitors, doors, people, faces, and the like appear visible to the device user and no holographic or virtual reality content is rendered over the visible objects. The HMD device includes a sensor package to support application of surface reconstruction techniques to dynamically detect edges and surfaces of the real world objects and keep objects visible on the display as the user changes position or head pose or when the real world objects move or their positions are changed. The HMD device can expose controls to enable the user to select which real world objects are visible in the virtual reality environment.
摘要:
An HMD device is configured to check the placement of newly introduced objects in a virtual reality environment such as interactive elements like menus, widgets, and notifications to confirm that the objects are significantly present within the user's field of view. If the intended original placement would locate the object outside the field of view, the HMD device relocates the object so that a portion of the object is viewable at the edge of the HMD display closest to its original placement. Such smart placement of virtual objects enables the user to readily discover new objects when they are introduced into the virtual reality environment, and then interact with the objects within a range of motions and/or head positions that is comfortable to support a more optimal interaction and user experience.
摘要:
An HMD device with a see-through display and depth sensing capability is configured to selectively dim or fade out a display of a virtual reality environment to enable a user to see the real world without obstruction by the virtual world when a distance between the user and a real world object is determined to be less than a threshold distance. The current height of the user's head (i.e., the distance from head to ground) may be utilized when performing the dimming/fading so that different threshold distances can be used depending on whether the user is standing or seated.
摘要:
A head mounted display (HMD) device operating in a real world physical environment is configured with a sensor package that enables determination of an intersection of a projection of the device user's gaze with a location in a mixed or virtual reality environment. When a projected gaze ray is visibly rendered on other HMD devices (where all the devices are operatively coupled), users of those devices can see what the user is looking at in the environment. In multi-user settings, each HMD device user can see each other's projected gaze rays which can facilitate collaboration in a commonly-shared and experienced mixed or virtual reality environment. The gaze projection can be used much like a finger to point at an object, or to indicate a location on a surface with precision and accuracy.
摘要:
A head mounted display (HMD) device operating in a real world physical environment is configured with a sensor package that enables determination of an intersection of a device user's projected gaze with a location in a virtual reality environment so that virtual objects can be placed into the environment with high precision. Surface reconstruction of the physical environment can be applied using data from the sensor package to determine the user's view position in the virtual world. A gaze ray originating from the view position is projected outward and a cursor or similar indicator is rendered on the HMD display at the ray's closest intersection with the virtual world such as a virtual object, floor/ground, etc. In response to user input, such as a gesture, voice interaction, or control manipulation, a virtual object is placed at the point of intersection between the projected gaze ray and the virtual reality environment.
摘要:
A mixed-reality head mounted display (HMD) device supports a three dimensional (3D) virtual world application with which a real world desktop displayed on a monitor coupled to a personal computer (PC) may interact and share mouse input. A mouse input server executing on the PC tracks mouse movements on the desktop displayed on a monitor. When movement of the mouse takes it beyond the edge of the monitor screen, the mouse input server takes control of the mouse and stops mouse messages from propagating through the PC's system. The mouse input server communicates over a network connection to a mouse input client exposed by the application to inform the client that the mouse has transitioned to operating in the virtual world and passes mouse messages describing movements and control operation such as button presses.