公开(公告)号：US20170372457A1

公开(公告)日：2017-12-28

申请号：US15195918

申请日：2016-06-28

申请人： Roger Sebastian Kevin Sylvan ,  Phillip Charles Heckinger ,  Arthur Tomlin ,  Nikolai Michael Faaland

发明人： Roger Sebastian Kevin Sylvan ,  Phillip Charles Heckinger ,  Arthur Tomlin ,  Nikolai Michael Faaland

IPC分类号： G06T5/00 ,  G02B27/01 ,  G06T1/20 ,  G09G5/28 ,  G06T19/00 ,  G06T15/04 ,  G06T11/00 ,  G06F3/048

CPC分类号： G06T5/003 ,  G02B27/017 ,  G02B27/0179 ,  G02B2027/0187 ,  G06F1/163 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/048 ,  G06T1/20 ,  G06T11/001 ,  G06T15/04 ,  G06T15/20 ,  G06T19/006 ,  G09G5/28 ,  G09G2340/0407 ,  G09G2360/18

摘要： A computing device is provided, which includes an input device, a display device, and a processor configured to, at a rendering stage of a rendering pipeline, render visual scene data to a frame buffer, and generate a signed distance field of edges of vector graphic data, and, at a reprojection stage of the rendering pipeline prior to displaying the rendered visual scene, receive post rendering user input via the input device that updates the user perspective, reproject the rendered visual scene data in the frame buffer based on the updated user perspective, reproject data of the signed distance field based on an updated user perspective, evaluate the signed distance field to generate reprojected vector graphic data, and generate a composite image including the reprojected rendered visual scene data and the reprojected graphic data, and display the composite image on the display device.

公开(公告)号：US20170363867A1

公开(公告)日：2017-12-21

申请号：US15184681

申请日：2016-06-16

申请人： Adam Poulos ,  Lorenz Henric Jentz ,  Cameron Brown ,  Anthony Ambrus ,  Arthur Tomlin ,  James Dack ,  Jeffrey Kohler ,  Eric Scott Rehmeyer ,  Edward Daniel Parker ,  Nicolas Denhez ,  Benjamin Boesel

发明人： Adam Poulos ,  Lorenz Henric Jentz ,  Cameron Brown ,  Anthony Ambrus ,  Arthur Tomlin ,  James Dack ,  Jeffrey Kohler ,  Eric Scott Rehmeyer ,  Edward Daniel Parker ,  Nicolas Denhez ,  Benjamin Boesel

IPC分类号： G02B27/01 ,  G06T19/00

CPC分类号： G02B27/0103 ,  G02B27/0172 ,  G02B27/0179 ,  G02B2027/0127 ,  G02B2027/0134 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0174 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/0304 ,  G06T19/006

摘要： A head-mounted display device may display a holographic element with a portable control device. Image data of a physical environment including the control device may be received and used to generate a three dimensional model of at least a portion of the environment. Using position information of the control device, a holographic element is displayed with the control device. Using the position information, it is determined that the control device is within a predetermined proximity of either a holographic object or a physical object. Based on determining that the control device is within the predetermined proximity, the displayed holographic element is modified.

公开(公告)号：US20170352184A1

公开(公告)日：2017-12-07

申请号：US15174937

申请日：2016-06-06

申请人： Adam G. Poulos ,  Arthur Tomlin ,  Alexandru Octavian Balan ,  Constantin Dulu ,  Christopher Douglas Edmonds

发明人： Adam G. Poulos ,  Arthur Tomlin ,  Alexandru Octavian Balan ,  Constantin Dulu ,  Christopher Douglas Edmonds

IPC分类号： G06T19/00 ,  G02B27/01

CPC分类号： G06T19/006 ,  G02B27/0172 ,  G02B2027/0174 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/012 ,  G06F3/017

摘要： A mixed reality system may comprise a base station, affixed to an object, that emits an electromagnetic field (EMF) and a head-mounted display (HMD) device with a location sensor and an EMF sensor mounted a predetermined offset therefrom. The base station and EMF sensor together may form a magnetic tracking system. The HMD device may determine a relative location of the EMF sensor based on sensing the EMF and determine a location of the base station in space based on the relative location, the predetermined offset, and the location of the location sensor. An optical tracking system comprising a marker and an optical sensor may be included to augment the magnetic tracking system based on captured optical data and a location of the optical sensor or marker. The HMD device may display augmented reality images and overlay a hologram corresponding to the location of the base station over time.

公开(公告)号：US20150237336A1

公开(公告)日：2015-08-20

申请号：US14184482

申请日：2014-02-19

申请人： Roger Sebastian Sylvan ,  Arthur Tomlin ,  Daniel Joseph McCulloch ,  Brian Mount ,  Tony Ambrus

发明人： Roger Sebastian Sylvan ,  Arthur Tomlin ,  Daniel Joseph McCulloch ,  Brian Mount ,  Tony Ambrus

IPC分类号： H04N13/04

CPC分类号： H04N13/332 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0172 ,  G02B27/2228 ,  G02B2027/0134 ,  G02B2027/0178 ,  G02B2027/0181 ,  G02B2027/0185 ,  G02B2027/0187 ,  G06F3/013 ,  H04N13/344 ,  H04N13/371 ,  H04N13/383 ,  H04N13/398

摘要： A method for displaying virtual imagery on a stereoscopic display system having a display matrix. The virtual imagery presents a surface of individually renderable loci viewable to an eye of the user. The method includes, for each locus of the viewable surface, illuminating a pixel of the display matrix. The illuminated pixel is chosen based on a pupil position of the eye as determined by the stereoscopic display system. For each locus of the viewable surface, a virtual image of the illuminated pixel is formed in a plane in front of the eye. The virtual image is positioned on a straight line passing through the locus, the plane, and the pupil position. In this manner, the virtual image tracks change in the user's pupil position.

摘要翻译： 一种用于在具有显示矩阵的立体显示系统上显示虚拟图像的方法。 虚拟图像呈现出可以看到用户眼睛的单独渲染的基座的表面。 对于可视表面的每个轨迹，该方法包括照亮显示矩阵的像素。 基于由立体显示系统确定的眼睛的瞳孔位置来选择照明像素。 对于可视表面的每个轨迹，在眼睛前方的平面中形成照明像素的虚像。 虚拟图像位于通过轨迹，平面和瞳孔位置的直线上。 以这种方式，虚拟图像轨迹在用户的瞳孔位置改变。

公开(公告)号：US20150116354A1

公开(公告)日：2015-04-30

申请号：US14066442

申请日：2013-10-29

申请人： Arthur Tomlin ,  Tony Ambrus ,  Ron Amador-Leon ,  Nicholas Gervase Fajt ,  Ryan Hastings ,  Matthew G. Kaplan ,  Michael Scavezze ,  Daniel McCulloch

发明人： Arthur Tomlin ,  Tony Ambrus ,  Ron Amador-Leon ,  Nicholas Gervase Fajt ,  Ryan Hastings ,  Matthew G. Kaplan ,  Michael Scavezze ,  Daniel McCulloch

IPC分类号： G06T19/00 ,  G02B27/01

CPC分类号： G06T19/006 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0118 ,  G02B2027/0138 ,  G02B2027/0141 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/04815 ,  G06T15/60

摘要： Various embodiments relating to creating a virtual shadow of an object in an image displayed with a see-through display are provided. In one embodiment, an image of a virtual object may be displayed with the see-through display. The virtual object may appear in front of a real-world background when viewed through the see-through display. A relative brightness of the real-world background around a virtual shadow of the virtual object may be increased when viewed through the see-through display. The virtual shadow may appear to result from a spotlight that is fixed relative to a vantage point of the see-through display.

摘要翻译： 提供了与通过显示器显示的图像中的对象的虚拟阴影相关的各种实施例。 在一个实施例中，可以用透视显示显示虚拟对象的图像。 当通过透视显示器查看时，虚拟对象可能会出现在真实背景的前方。 当通过透视显示器观看时，虚拟物体的虚拟阴影周围的真实世界背景的相对亮度可能会增加。 虚拟阴影可能看起来是相对于透视显示的有利位置固定的聚光灯。

公开(公告)号：US20140125668A1

公开(公告)日：2014-05-08

申请号：US13668953

申请日：2012-11-05

申请人： Jonathan Steed ,  Aaron Krauss ,  Mike Scavezze ,  Wei Zhang ,  Arthur Tomlin ,  Tony Ambrus ,  Brian Mount ,  Stephen Latta ,  Ryan Hastings

发明人： Jonathan Steed ,  Aaron Krauss ,  Mike Scavezze ,  Wei Zhang ,  Arthur Tomlin ,  Tony Ambrus ,  Brian Mount ,  Stephen Latta ,  Ryan Hastings

IPC分类号： G06T15/50 ,  G09G5/00

CPC分类号： G06T19/006 ,  G06T15/50 ,  G06T2215/16

摘要： Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.

摘要翻译： 公开了有效地构建具有全局照明效果的增强现实环境的实施例。 例如，一个公开的实施例提供了一种经由显示装置显示增强现实图像的方法。 该方法包括接收图像数据，捕获显示设备的本地环境的图像的图像数据，以及经由图像数据识别本地环境的物理特征。 该方法还包括构建虚拟结构的增强现实图像，用于在从用户的角度来的物理特征的空间配准中的物理特征上显示，增强现实图像包括布置在相邻位置中的多个模块化虚拟结构段 形成虚拟结构特征，每个模块化虚拟结构段包括预先计算的全局照明效果，并将增强现实图像输出到显示设备。

公开(公告)号：US20130194164A1

公开(公告)日：2013-08-01

申请号：US13360281

申请日：2012-01-27

申请人： Ben Sugden ,  John Clavin ,  Ben Vaught ,  Stephen Latta ,  Kathryn Stone Perez ,  Daniel McCulloch ,  Jason Scott ,  Wei Zhang ,  Darren Bennett ,  Ryan Hastings ,  Arthur Tomlin ,  Kevin Geisner

发明人： Ben Sugden ,  John Clavin ,  Ben Vaught ,  Stephen Latta ,  Kathryn Stone Perez ,  Daniel McCulloch ,  Jason Scott ,  Wei Zhang ,  Darren Bennett ,  Ryan Hastings ,  Arthur Tomlin ,  Kevin Geisner

IPC分类号： G09G5/00

CPC分类号： G06T19/006 ,  G02B27/01 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/1407 ,  G06F3/167 ,  G06F17/30241 ,  G06T7/12 ,  G06T7/194 ,  G06T7/215

摘要： Embodiments for interacting with an executable virtual object associated with a real object are disclosed. In one example, a method for interacting with an executable virtual object associated with a real object includes receiving sensor input from one or more sensors attached to the portable see-through display device, and obtaining information regarding a location of the user based on the sensor input. The method also includes, if the location includes a real object comprising an associated executable virtual object, then determining an intent of the user to interact with the executable virtual object, and if the intent to interact is determined, then interacting with the executable object.

公开(公告)号：US20140333666A1

公开(公告)日：2014-11-13

申请号：US13893146

申请日：2013-05-13

申请人： Adam G. Poulos ,  Evan Michael Keibler ,  Arthur Tomlin ,  Cameron Brown ,  Daniel McCulloch ,  Brian Mount ,  Dan Kroymann ,  Gregory Lowell Alt

发明人： Adam G. Poulos ,  Evan Michael Keibler ,  Arthur Tomlin ,  Cameron Brown ,  Daniel McCulloch ,  Brian Mount ,  Dan Kroymann ,  Gregory Lowell Alt

IPC分类号： G06T19/00 ,  G02B27/01

CPC分类号： G06T19/006 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0112 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/013 ,  G06F3/147 ,  G09G2340/0464

摘要： Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a display system. For example, one disclosed embodiment includes displaying a virtual object via the display system as free-floating, detecting a trigger to display the object as attached to a surface, and, in response to the trigger, displaying the virtual object as attached to the surface via the display system. The method may further include detecting a trigger to detach the virtual object from the surface and, in response to the trigger to detach the virtual object from the surface, detaching the virtual object from the surface and displaying the virtual object as free-floating.

摘要翻译： 公开了涉及在包括显示系统的增强现实计算设备上操作用户界面的实施例。 例如，一个公开的实施例包括经由显示系统显示虚拟对象为自由浮动，检测触发器以附接到表面上显示对象，并且响应于触发器，显示虚拟对象附加到表面 通过显示系统。 该方法还可以包括检测触发器以将虚拟对象与表面分离，并且响应于将虚拟对象与表面分离的触发器，从虚拟对象脱离表面并将虚拟对象显示为自由浮动。

公开(公告)号：US20130194259A1

公开(公告)日：2013-08-01

申请号：US13360492

申请日：2012-01-27

申请人： Darren Bennett ,  Brian Mount ,  Stephen Latta ,  Alex Kipman ,  Ryan Hastings ,  Arthur Tomlin ,  Sebastian Sylvan ,  Daniel McCulloch ,  Jonathan Steed ,  Jason Scott ,  Mathew Lamb

发明人： Darren Bennett ,  Brian Mount ,  Stephen Latta ,  Alex Kipman ,  Ryan Hastings ,  Arthur Tomlin ,  Sebastian Sylvan ,  Daniel McCulloch ,  Jonathan Steed ,  Jason Scott ,  Mathew Lamb

IPC分类号： G09G5/00 ,  G06T17/00

CPC分类号： G06T19/006 ,  G05B2219/35503 ,  G06K9/00671 ,  H04M2203/359

摘要： A system and related methods for visually augmenting an appearance of a physical environment as seen by a user through a head-mounted display device are provided. In one embodiment, a virtual environment generating program receives eye-tracking information, lighting information, and depth information from the head-mounted display. The program generates a virtual environment that models the physical environment and is based on the lighting information and the distance of a real-world object from the head-mounted display. The program visually augments a virtual object representation in the virtual environment based on the eye-tracking information, and renders the virtual object representation on a transparent display of the head-mounted display device.

摘要翻译： 提供了一种系统和相关方法，用于通过头戴式显示装置可视地增加用户看到的物理环境的外观。 在一个实施例中，虚拟环境生成程序从头戴式显示器接收眼睛跟踪信息，照明信息和深度信息。 该程序生成虚拟环境，对物理环境进行建模，并基于照明信息和现实世界对象与头戴式显示器的距离。 该程序基于眼睛跟踪信息在虚拟环境中视觉上增加虚拟对象表示，并且将虚拟对象表示呈现在头戴式显示设备的透明显示器上。

公开(公告)号：US20170287219A1

公开(公告)日：2017-10-05

申请号：US15087833

申请日：2016-03-31

申请人： Adam G. Poulos ,  Daniel Joseph McCulloch ,  Nicholas Gervase Fajt ,  Arthur Tomlin ,  Brian Mount ,  Lev Cherkashin ,  Lorenz Henric Jentz

发明人： Adam G. Poulos ,  Daniel Joseph McCulloch ,  Nicholas Gervase Fajt ,  Arthur Tomlin ,  Brian Mount ,  Lev Cherkashin ,  Lorenz Henric Jentz

IPC分类号： G06T19/00 ,  G02B27/01

CPC分类号： G06T19/006 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0174 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/0346

摘要： A mixed reality system may comprise a head-mounted display (HMD) device with a location sensor from which the HMD device determines a location of the location sensor in space and a base station mounted a predetermined offset from the location sensor and configured to emit an electromagnetic field (EMF). An EMF sensor affixed to an object may be configured to sense a strength of the EMF. The HMD device may determine a location of the EMF sensor relative to the base station based on the sensed strength and determine a location of the EMF sensor in space based on the relative location, the predetermined offset, and the location of the location sensor in space. In some aspects, the HMD device may comprise a see-through display configured to display augmented reality images and overlay a hologram that corresponds to the location of the EMF sensor in space over time.