公开(公告)号：US11580704B2

公开(公告)日：2023-02-14

申请号：US17227078

申请日：2021-04-09

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Andrew D. Wilson ,  Christian Holz ,  Eyal Ofek ,  Jeremy Hartmann

IPC: G06T19/00 ,  G06T19/20

Abstract: Various embodiments are provided herein for tracking a user's physical environment, to facilitate on-the-fly blending of a virtual environment with detected aspects of the physical environment. Embodiments can be employed to facilitate virtual roaming by compositing virtual representations of detected physical objects into virtual environments. A computing device coupled to a HMD can select portions of a depth map generated based on the user's physical environment, to generate virtual objects that correspond to the selected portions. The computing device can composite the generated virtual objects into an existing virtual environment, such that the user can traverse the virtual environment while remaining aware of their physical environment. Among other things, the computing device can employ various blending techniques for compositing, and further provide image pass-through techniques for selective viewing of the physical environment while remaining fully-immersed in virtual reality.

公开(公告)号：US10885710B2

公开(公告)日：2021-01-05

申请号：US16353912

申请日：2019-03-14

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Christian Holz ,  Eyal Ofek ,  Andrew D. Wilson ,  Lung-Pan Cheng ,  Junrui Yang

IPC: G06T19/00 ,  G06T19/20 ,  H04N13/271 ,  G06F3/01 ,  G02B27/01

Abstract: In various embodiments, computerized methods and systems for dynamically updating a fully-immersive virtual environment based on tracked physical environment data. A computing device coupled to a HMD receives sensor data from a variety of sensors. The computing device can generate a virtual scene based on the received sensor data, whereby the virtual scene includes at least a portion of a virtual path that corresponds to at least a portion of a navigable path determined based on the received sensor data. The computing device can modify the virtual scene include a virtual obstruction that corresponds to a physical object detected based on additional sensor data received from the sensors. The modified virtual scene is presented to the user for display, so that the user can safely traverse the physical environment while staying fully-immersed in the virtual environment.

公开(公告)号：US10290153B2

公开(公告)日：2019-05-14

申请号：US15703093

申请日：2017-09-13

Applicant: Microsoft Technology Licensing, LLC

Inventor： Hrvoje Benko ,  Andrew D. Wilson ,  Eyal Ofek ,  Mahdi Azmandian ,  Mark Hancock

IPC: G06T19/00 ,  G06F3/01

Abstract: Dynamic haptic retargeting can be implemented using world warping techniques and body warping techniques. World warping is applied to improve an alignment between a virtual object and a physical object, while body warping is applied to redirect a user's motion to increase a likelihood that a physical hand will reach the physical object at the same time a virtual representation of the hand reaches the virtual object. Threshold values and/or a combination of world warping a body warping can be used to mitigate negative impacts that may be caused by using either technique excessively or independently.

公开(公告)号：US20190094958A1

公开(公告)日：2019-03-28

申请号：US15718995

申请日：2017-09-28

Applicant: Microsoft Technology Licensing, LLC

Inventor： Shane Williams ,  Andrew D. Wilson

IPC: G06F3/01 ,  G06F3/0482

Abstract: Representative embodiments disclose mechanisms for selection of items using eye tracking. One or more primary selection targets are presented to the user. When the user selects a primary selection target, secondary selection targets are presented in close proximity to the primary selection target, either before or after selection of the primary selection target. The secondary selection targets are animated in a way that moves them away from the primary selection target. The user's eye naturally follows the secondary selection target of interest, if any, producing a vector having a magnitude and a direction. The magnitude and direction of the vector are used to identify which, if any, of the secondary selection targets are intended ty the user.

公开(公告)号：US11509861B2

公开(公告)日：2022-11-22

申请号：US15380690

申请日：2016-12-15

Applicant: Microsoft Technology Licensing, LLC

Inventor： Sasa Junuzovic ,  William Thomas Blank ,  Bruce Arnold Cleary, III ,  Anoop Gupta ,  Andrew D. Wilson

IPC: H04N7/18 ,  H04N7/14 ,  G06Q10/10 ,  G06F3/01 ,  G06F3/042 ,  G06F3/14 ,  H04N7/15 ,  G01B11/24

Abstract: The interactive and shared surface technique described herein employs hardware that can project on any surface, capture color video of that surface, and get depth information of and above the surface while preventing visual feedback (also known as video feedback, video echo, or visual echo). The technique provides N-way sharing of a surface using video compositing. It also provides for automatic calibration of hardware components, including calibration of any projector, RGB camera, depth camera and any microphones employed by the technique. The technique provides object manipulation with physical, visual, audio, and hover gestures and interaction between digital objects displayed on the surface and physical objects placed on or above the surface. It can capture and scan the surface in a manner that captures or scans exactly what the user sees, which includes both local and remote objects, drawings, annotations, hands, and so forth.

公开(公告)号：US11190741B2

公开(公告)日：2021-11-30

申请号：US15934881

申请日：2018-03-23

Applicant: Microsoft Technology Licensing, LLC

Inventor： Sasa Junuzovic ,  William Thomas Blank ,  Steven Bathiche ,  Anoop Gupta ,  Andrew D. Wilson

IPC: H04N9/31 ,  H04N13/207 ,  H04N13/254 ,  H04N13/271 ,  G06F3/042 ,  G03B15/05 ,  H04N5/225 ,  H04N5/247 ,  H04N7/14 ,  G03B17/54 ,  G06F3/00 ,  H04L12/18 ,  H04N5/33

Abstract: A “Concurrent Projector-Camera” uses an image projection device in combination with one or more cameras to enable various techniques that provide visually flicker-free projection of images or video, while real-time image or video capture is occurring in that same space. The Concurrent Projector-Camera provides this projection in a manner that eliminates video feedback into the real-time image or video capture. More specifically, the Concurrent Projector-Camera dynamically synchronizes a combination of projector lighting (or light-control points) on-state temporal compression in combination with on-state temporal shifting during each image frame projection to open a “capture time slot” for image capture during which no image is being projected. This capture time slot represents a tradeoff between image capture time and decreased brightness of the projected image. Examples of image projection devices include LED-LCD based projection devices, DLP-based projection devices using LED or laser illumination in combination with micromirror arrays, etc.

公开(公告)号：US11055891B1

公开(公告)日：2021-07-06

申请号：US16814130

申请日：2020-03-10

Applicant: Microsoft Technology Licensing, LLC

Inventor： Eyal Ofek ,  Mar Gonzalez Franco ,  Andrew D. Wilson ,  Karan Ahuja ,  Christian Holz

IPC: G06T13/40 ,  G06T13/80 ,  G06F3/01

Abstract: Examples of the present disclosure describe systems and methods for providing real-time motion styling in virtual reality (VR), augmented reality (AR), and/or mixed reality (MR) environments. In aspects, input data corresponding to user interaction with a VR, an AR, or an MR environment may be received. The input data may be featurized to generate a feature set. The feature set may be compared to a set of stored motion data comprising motion capture data representing one or more motion styles for executing an action or activity. Based on the comparison, the feature set may be matched to feature data for one or more motions styles in the stored motion data. The one or more motions styles may then be executed by a virtual avatar or a virtual object in the VR/AR/MR environment.

公开(公告)号：US20190107884A1

公开(公告)日：2019-04-11

申请号：US15726282

申请日：2017-10-05

Applicant: Microsoft Technology Licensing, LLC

Inventor： Shane Williams ,  Andrew D. Wilson

IPC: G06F3/01

Abstract: Representative embodiments disclose mechanisms for calibrating an eye gaze selection system. When the calibration is triggered, a snapshot of an area around the current user's gaze point is taken. The snapshot area is then animated to cause motion of the snapshot area. As the snapshot is animated, the user's gaze will naturally track the thing the user was focusing on. This creates an eye tracking vector with a magnitude and direction. The magnitude and direction of the eye tracking vector can then be used to calculate a correction factor for the current user's gaze point. Calibration can be triggered manually by the user or based on some criteria such as error rates in item selection by the user.

公开(公告)号：US10168827B2

公开(公告)日：2019-01-01

申请号：US15640507

申请日：2017-07-01

Applicant: Microsoft Technology Licensing, LLC

Inventor： Ken Hinckley ,  Hrvoje Benko ,  Michel Pahud ,  Andrew D. Wilson ,  Pourang Polad Irani ,  Francois Guimbretiere

IPC: G06F3/041 ,  G06F3/0487 ,  G06F3/0488 ,  G06F3/0354 ,  G06F3/038 ,  G06F3/0482

Abstract: Pen and computing device sensor correlation technique embodiments correlate sensor signals received from various grips on a touch-sensitive pen and touches to a touch-sensitive computing device in order to determine the context of such grips and touches and to issue context-appropriate commands to the touch sensitive pen or the touch-sensitive computing device. A combination of concurrent sensor inputs received from both a touch-sensitive pen and a touch-sensitive computing device are correlated. How the touch-sensitive pen and the touch-sensitive computing device are touched or gripped are used to determine the context of their use and the user's intent. A context-appropriate user interface action based can then be initiated. Also the context can be used to label metadata.

公开(公告)号：US20180074678A1

公开(公告)日：2018-03-15

申请号：US15818452

申请日：2017-11-20

Applicant: Microsoft Technology Licensing, LLC

Inventor： Hrvoje Benko ,  Andrew D. Wilson ,  Patrick M. Baudisch

IPC: G06F3/0481 ,  G06F3/0488

CPC classification number: G06F3/04812 ,  G06F3/0488 ,  G06F2203/04808

Abstract: A unique system and method is provided that facilitates pixel-accurate targeting with respect to multi-touch sensitive displays when selecting or viewing content with a cursor. In particular, the system and method can track dual inputs from a primary finger and a secondary finger, for example. The primary finger can control movement of the cursor while the secondary finger can adjust a control-display ratio of the screen. As a result, cursor steering and selection of an assistance mode can be performed at about the same time or concurrently. In addition, the system and method can stabilize a cursor position at a top middle point of a user's finger in order to mitigate clicking errors when making a selection.