-
公开(公告)号:US10674142B2
公开(公告)日:2020-06-02
申请号:US16379182
申请日:2019-04-09
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael Scavezze , Arthur Tomlin , Rui Cai , Zhiwei Li
IPC: G06T19/00 , H04N13/344 , H04N13/128 , G06T7/30 , G06T7/70 , G06T7/55 , H04N13/239 , G06T17/10
Abstract: Sensor fusion is utilized in an electronic device such as a head mounted display (HMD) device that has a sensor package equipped with different sensors so that information that is supplemental to captured 2D images of objects or scenes in a real world environment may be utilized to determine an optimized transform of image stereo-pairs and to discard erroneous data that would otherwise prevent successful scans used for construction of a 3D model in, for example, virtual world applications. Such supplemental information can include one or more of world location, world rotation, image data from an extended field of view (FOV), or depth map data.
-
公开(公告)号:US10257505B2
公开(公告)日:2019-04-09
申请号:US15017799
申请日:2016-02-08
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael Scavezze , Arthur Tomlin , Rui Cai , Zhiwei Li
IPC: G06T17/00 , H04N13/344 , H04N13/128 , G06T17/10 , G06T7/30 , G06T7/70 , G06T7/55 , H04N13/239
Abstract: Sensor fusion is utilized in an electronic device such as a head mounted display (HMD) device that has a sensor package equipped with different sensors so that information that is supplemental to captured 2D images of objects or scenes in a real world environment may be utilized to determine an optimized transform of image stereo-pairs and to discard erroneous data that would otherwise prevent successful scans used for construction of a 3D model in, for example, virtual world applications. Such supplemental information can include one or more of world location, world rotation, image data from an extended field of view (FOV), or depth map data.
-
公开(公告)号:US10254546B2
公开(公告)日:2019-04-09
申请号:US15174920
申请日:2016-06-06
Applicant: Microsoft Technology Licensing, LLC
Inventor: Adam G. Poulos , Arthur Tomlin , Alexandru Octavian Balan , Constantin Dulu , Christopher Douglas Edmonds
Abstract: A mixed reality system may comprise a head-mounted display (HMD) device with a location sensor and a base station, mounted a predetermined offset from the location sensor, that emits an electromagnetic field (EMF). An EMF sensor affixed to an object may sense the EMF, forming a magnetic tracking system. The HMD device may determine a relative location of the EMF sensor therefrom and determine a location of the EMF sensor in space based on the relative location, the predetermined offset, and the location of the location sensor. An optical tracking system comprising a marker an optical sensor configured to capture optical data may be included to augment the magnetic tracking system based on the optical data and a location of the optical sensor or marker. The HMD device may display augmented reality images and overlay a hologram corresponding to the location of the EMF sensor over time.
-
公开(公告)号:US10037626B2
公开(公告)日:2018-07-31
申请号:US15199657
申请日:2016-06-30
Applicant: Microsoft Technology Licensing, LLC
Inventor: Adam Gabriel Poulos , Cameron Graeme Brown , Andrew Austin Jackson , Cheyne Rory Quin Mathey-Owens , Michael Robert Thomas , Arthur Tomlin
CPC classification number: G06T19/006 , G06F1/163 , G06F3/011 , G06F3/012 , G06F3/017 , G06F3/0304 , G06F3/0346 , G06F3/038 , G06F3/04815 , G06F3/04842 , G06Q10/10
Abstract: Motion and/or rotation of an input mechanism can be tracked and/or analyzed to determine limits on a user's range of motion and/or a user's range of rotation in three-dimensional space. The user's range of motion and/or the user's range of rotation in three-dimensional space may be limited by a personal restriction for the user (e.g., a broken arm). The user's range of motion and/or the user's range of rotation in three-dimensional space may additionally or alternatively be limited by an environmental restriction (e.g., a physical object in a room). Accordingly, the techniques described herein can take steps to accommodate the personal restriction and/or the environmental restriction thereby optimizing user interactions involving the input mechanism and a virtual object.
-
公开(公告)号:US09892562B2
公开(公告)日:2018-02-13
申请号:US15298528
申请日:2016-10-20
Applicant: Microsoft Technology Licensing, LLC
Inventor: Jonathan Steed , Aaron Krauss , Mike Scavezze , Wei Zhang , Arthur Tomlin , Tony Ambrus , Brian Mount , Stephen Latta , Ryan Hastings
CPC classification number: G06T19/006 , G06T15/50 , G06T2215/16
Abstract: Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.
-
公开(公告)号:US09836889B2
公开(公告)日:2017-12-05
申请号:US15446967
申请日:2017-03-01
Applicant: Microsoft Technology Licensing, LLC
Inventor: Ben Sugden , John Clavin , Ben Vaught , Stephen Latta , Kathryn Stone Perez , Daniel McCulloch , Jason Scott , Wei Zhang , Darren Bennett , Ryan Hastings , Arthur Tomlin , Kevin Geisner
CPC classification number: G06T19/006 , G02B27/01 , G02B27/017 , G02B27/0172 , G02B2027/0138 , G02B2027/014 , G02B2027/0141 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/017 , G06F3/1407 , G06F3/167 , G06F17/30241 , G06T7/12 , G06T7/194 , G06T7/215
Abstract: Embodiments for interacting with an executable virtual object associated with a real object are disclosed. In one example, a method for interacting with an executable virtual object associated with a real object includes receiving sensor input from one or more sensors attached to the portable see-through display device, and obtaining information regarding a location of the user based on the sensor input. The method also includes, if the location includes a real object comprising an associated executable virtual object, then determining an intent of the user to interact with the executable virtual object, and if the intent to interact is determined, then interacting with the executable object.
-
公开(公告)号:US09530252B2
公开(公告)日:2016-12-27
申请号:US15005530
申请日:2016-01-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Adam G. Poulos , Evan Michael Keibler , Arthur Tomlin , Cameron Brown , Daniel McCulloch , Brian Mount , Dan Kroymann , Gregory Lowell Alt
CPC classification number: G06T19/006 , G02B27/017 , G02B27/0172 , G02B2027/0112 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/013 , G06F3/147 , G09G2340/0464
Abstract: Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a display system. For example, one disclosed embodiment includes displaying a virtual object via the display system as free-floating, detecting a trigger to display the object as attached to a surface, and, in response to the trigger, displaying the virtual object as attached to the surface via the display system. The method may further include detecting a trigger to detach the virtual object from the surface and, in response to the trigger to detach the virtual object from the surface, detaching the virtual object from the surface and displaying the virtual object as free-floating.
Abstract translation: 公开了涉及在包括显示系统的增强现实计算设备上操作用户界面的实施例。 例如,一个公开的实施例包括经由显示系统显示虚拟对象为自由浮动,检测触发器以附接到表面上显示对象,并且响应于触发器,显示虚拟对象附加到表面 通过显示系统。 该方法还可以包括检测触发器以将虚拟对象与表面分离,并且响应于将虚拟对象与表面分离的触发器,从虚拟对象脱离表面并将虚拟对象显示为自由浮动。
-
公开(公告)号:US09313481B2
公开(公告)日:2016-04-12
申请号:US14184482
申请日:2014-02-19
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Roger Sebastian Sylvan , Arthur Tomlin , Daniel Joseph McCulloch , Brian Mount , Tony Ambrus
CPC classification number: H04N13/332 , G02B27/0093 , G02B27/017 , G02B27/0172 , G02B27/2228 , G02B2027/0134 , G02B2027/0178 , G02B2027/0181 , G02B2027/0185 , G02B2027/0187 , G06F3/013 , H04N13/344 , H04N13/371 , H04N13/383 , H04N13/398
Abstract: A method for displaying virtual imagery on a stereoscopic display system having a display matrix. The virtual imagery presents a surface of individually renderable loci viewable to an eye of the user. The method includes, for each locus of the viewable surface, illuminating a pixel of the display matrix. The illuminated pixel is chosen based on a pupil position of the eye as determined by the stereoscopic display system. For each locus of the viewable surface, a virtual image of the illuminated pixel is formed in a plane in front of the eye. The virtual image is positioned on a straight line passing through the locus, the plane, and the pupil position. In this manner, the virtual image tracks change in the user's pupil position.
Abstract translation: 一种用于在具有显示矩阵的立体显示系统上显示虚拟图像的方法。 虚拟图像呈现出可以看到用户眼睛的单独渲染的基座的表面。 对于可视表面的每个轨迹,该方法包括照亮显示矩阵的像素。 基于由立体显示系统确定的眼睛的瞳孔位置来选择照明像素。 对于可视表面的每个轨迹,在眼睛前方的平面中形成照明像素的虚像。 虚拟图像位于通过轨迹,平面和瞳孔位置的直线上。 以这种方式,虚拟图像轨迹在用户的瞳孔位置改变。
-
39.
公开(公告)号:US09201243B2
公开(公告)日:2015-12-01
申请号:US14602746
申请日:2015-01-22
Applicant: Microsoft Technology Licensing, LLC
Inventor: Ben Sugden , John Clavin , Ben Vaught , Stephen Latta , Kathryn Stone Perez , Daniel McCulloch , Jason Scott , Wei Zhang , Darren Bennett , Ryan Hastings , Arthur Tomlin , Kevin Geisner
CPC classification number: G06T19/006 , G02B27/01 , G02B27/017 , G02B27/0172 , G02B2027/0138 , G02B2027/014 , G02B2027/0141 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/017 , G06F3/1407 , G06F3/167 , G06F17/30241 , G06T7/12 , G06T7/194 , G06T7/215
Abstract: Embodiments for interacting with an executable virtual object associated with a real object are disclosed. In one example, a method for interacting with an executable virtual object associated with a real object includes receiving sensor input from one or more sensors attached to the portable see-through display device, and obtaining information regarding a location of the user based on the sensor input. The method also includes, if the location includes a real object comprising an associated executable virtual object, then determining an intent of the user to interact with the executable virtual object, and if the intent to interact is determined, then interacting with the executable object.
Abstract translation: 公开了与与真实对象相关联的可执行虚拟对象进行交互的实施例。 在一个示例中,用于与与真实对象相关联的可执行虚拟对象交互的方法包括从附接到便携式透视显示设备的一个或多个传感器接收传感器输入,以及基于传感器获得关于用户位置的信息 输入。 该方法还包括,如果位置包括包括相关联的可执行虚拟对象的真实对象,则确定用户与可执行虚拟对象交互的意图,并且如果确定了交互意图,则与可执行对象进行交互。
-
-
-
-
-
-
-
-