公开(公告)号：US08767306B1

公开(公告)日：2014-07-01

申请号：US13240994

申请日：2011-09-22

申请人： Xiaoyu Miao ,  Adrian Wong ,  Babak Amirparviz ,  Mark Spitzer

发明人： Xiaoyu Miao ,  Adrian Wong ,  Babak Amirparviz ,  Mark Spitzer

IPC分类号： G02B27/14 ,  G02B27/01 ,  G02B27/09

CPC分类号： G02B27/0172 ,  G02B27/0093 ,  G02B27/0983 ,  G02B27/1006 ,  G02B2027/0138 ,  G02B2027/0178

摘要： An optical system has an aperture through which virtual and real-world images are viewable along a viewing axis. The optical system may be incorporated into a head-mounted display (HMD). By illuminating a viewing location with an infrared light source, an eye pupil may be illuminated. Infrared light is reflected from the viewing location and is collected with a proximal beam splitter. An image former is configured to reflect at least a portion of the visible light pattern generated by the display panel to form the virtual image and transmit at least a portion of the collected infrared light. The transmitted infrared light may be imaged by a camera. The HMD may use images from the camera to provide, for example, context-sensitive virtual images to a wearer.

摘要翻译： 一个光学系统具有一个光阑，虚拟和真实世界的图像沿观察轴可见。 光学系统可以结合到头戴式显示器（HMD）中。 通过用红外光源照射观察位置，可以照亮眼睛瞳孔。 红外光从观察位置反射并用近端分束器收集。 图像形成器被配置为反射由显示面板产生的可见光图案的至少一部分，以形成虚像，并传送所收集的红外光的至少一部分。 透射的红外光可以由相机成像。 HMD可以使用来自相机的图像来向佩戴者提供例如上下文相关的虚拟图像。

公开(公告)号：US20150153572A1

公开(公告)日：2015-06-04

申请号：US13253341

申请日：2011-10-05

申请人： Xiaoyu Miao ,  Adrian Wong ,  Mark Spitzer

发明人： Xiaoyu Miao ,  Adrian Wong ,  Mark Spitzer

IPC分类号： G09G5/00 ,  G02B27/01

CPC分类号： G02B27/017 ,  G02B2027/0127 ,  G02B2027/0138 ,  G02B2027/014

摘要： An optical system has an aperture through which virtual and real-world images are viewable along a viewing axis. The optical system may be incorporated into a head-mounted display (HMD). By modulating the length of the optical path along an optical axis within the optical system, the virtual image may appear to be at different distances away from the HMD wearer. The wearable computer of the HMD may be used to control the length of the optical path. The length of the optical path may be modulated using, for example, a piezoelectric actuator or stepper motor. By determining the distance to an object with respect to the HMD using a range-finder or autofocus camera, the virtual images may be controlled to appear at various distances and locations in relation to the target object and/or HMD wearer.

摘要翻译： 一个光学系统具有一个光阑，虚拟和真实世界的图像沿观察轴可见。 光学系统可以结合到头戴式显示器（HMD）中。 通过在光学系统内沿着光轴调节光路的长度，虚拟图像可能看起来与HMD佩戴者不同的距离。 可以使用HMD的可佩戴计算机来控制光路的长度。 可以使用例如压电致动器或步进电机来调制光路的长度。 通过使用测距仪或自动对焦摄像机确定与HMD相对于物体的距离，可以将虚拟图像控制为出现在与目标物体和/或HMD佩戴者相关的各种距离和位置处。

公开(公告)号：US08990682B1

公开(公告)日：2015-03-24

申请号：US13253695

申请日：2011-10-05

申请人： Adrian Wong ,  Xiaoyu Miao

发明人： Adrian Wong ,  Xiaoyu Miao

IPC分类号： G09G5/00 ,  G02B27/01

CPC分类号： G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0178 ,  G06T19/006

摘要： Disclosed are methods and devices for rendering interactions between virtual and physical objects on a substantially transparent display are disclosed. In one embodiment, the method includes displaying a user-interface on a substantially transparent display of a wearable computing device. The method further includes displaying a virtual object in the view region at a focal length along a first line of sight and detecting a physical object at a physical distance along a second line of sight. The method still further includes determining that a relationship between the focal length and the physical distance is such that the virtual object and the physical object appear substantially co-located in a user-view through the view region and, responsive to the determination, initiating a collision action between the virtual object and the physical object.

摘要翻译： 公开了用于在基本上透明的显示器上呈现虚拟和物理对象之间的交互的方法和装置。 在一个实施例中，该方法包括在可穿戴计算设备的基本上透明的显示器上显示用户界面。 该方法还包括在沿着第一视线的焦点处在视野区域中显示虚拟对象，并沿着第二视线检测物理距离处的物理对象。 该方法还包括确定焦距和物理距离之间的关系使得虚拟对象和物理对象通过视图区域显现为基本上位于用户视图中，并且响应于该确定，启动一个 虚拟对象与物理对象之间的碰撞动作。

公开(公告)号：US20130088413A1

公开(公告)日：2013-04-11

申请号：US13253419

申请日：2011-10-05

申请人： Hayes Solos Raffle ,  Adrian Wong ,  Xiaoyu Miao

发明人： Hayes Solos Raffle ,  Adrian Wong ,  Xiaoyu Miao

IPC分类号： G09G5/00 ,  G02B27/01

CPC分类号： G02B27/0101 ,  G02B7/005 ,  G02B2027/0127 ,  G09G3/003 ,  G09G2340/14 ,  G09G2354/00

摘要： An optical system has an aperture through which virtual and real-world images are viewable along a viewing axis. The optical system may be incorporated into a head-mounted display (HMD). By modulating the length of the optical path along an optical axis within the optical system, the virtual image may appear to be at different distances away from the HMD wearer. The wearable computer of the HMD may be used to control the length of the optical path. The length of the optical path may be modulated using, for example, a piezoelectric actuator or stepper motor. By determining the distance to an object with respect to the HMD using a range-finder or autofocus camera, the virtual images may be controlled to appear at various distances and locations in relation to the target object and/or HMD wearer.

摘要翻译： 一个光学系统具有一个光阑，虚拟和真实世界的图像沿观察轴可见。 光学系统可以结合到头戴式显示器（HMD）中。 通过在光学系统内沿着光轴调节光路的长度，虚拟图像可能看起来与HMD佩戴者不同的距离。 可以使用HMD的可佩戴计算机来控制光路的长度。 可以使用例如压电致动器或步进电机来调制光路的长度。 通过使用测距仪或自动对焦摄像机确定与HMD相对于物体的距离，可以将虚拟图像控制为出现在与目标物体和/或HMD佩戴者相关的各种距离和位置处。

公开(公告)号：US09081177B2

公开(公告)日：2015-07-14

申请号：US13267963

申请日：2011-10-07

申请人： Adrian Wong ,  Xiaoyu Miao

发明人： Adrian Wong ,  Xiaoyu Miao

IPC分类号： G09G5/00 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01

CPC分类号： G06T19/006 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0172 ,  G02B27/0176 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/015 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/013 ,  G06F3/04815 ,  G06F3/0482 ,  G06F3/167 ,  G06K9/00664 ,  G06T2200/24

摘要： Exemplary methods and systems relate to detecting physical objects near a substantially transparent head-mounted display (HMD) system and activating a collision-avoidance action to alert a user of the detected objects. Detection techniques may include receiving data from distance and/or relative movement sensors and using this data as a basis for determining an appropriate collision-avoidance action. Exemplary collision-avoidance actions may include de-emphasizing virtual objects displayed on the HMD to provide a less cluttered view of the physical objects through the substantially transparent display and/or presenting new virtual objects.

摘要翻译： 示例性方法和系统涉及检测基本上透明的头戴式显示器（HMD）系统附近的物理物体，并激活防止碰撞的动作，以向用户通知检测到的物体。 检测技术可以包括从距离和/或相对运动传感器接收数据，并且使用该数据作为确定适当的避免碰撞动作的基础。 示例性的避免冲突动作可以包括去强调在HMD上显示的虚拟对象，以通过基本上透明的显示器和/或呈现新的虚拟对象来提供对物理对象的较少杂乱的视图。

公开(公告)号：US20130069985A1

公开(公告)日：2013-03-21

申请号：US13238557

申请日：2011-09-21

申请人： Adrian Wong ,  Xiaoyu Miao

发明人： Adrian Wong ,  Xiaoyu Miao

IPC分类号： G09G5/373

CPC分类号： G06F3/0487 ,  G02B27/017 ,  G02B27/0189 ,  G02B2027/0138 ,  G02B2027/014 ,  G05B19/124 ,  G06F1/163 ,  G06F3/011 ,  G06F3/017 ,  G06F3/14 ,  G06F2200/1613

摘要： A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device determines that a target device is within its environment, the wearable computing device obtains target device information related to the target device. The target device information may include information that defines a virtual control interface for controlling the target device and an identification of a defined area of the target device on which the virtual control image is to be provided. The wearable computing device controls the HMD to display the virtual control image as an image superimposed over the defined area of the target device in the field of view.

公开(公告)号：US09239415B2

公开(公告)日：2016-01-19

申请号：US13415694

申请日：2012-03-08

申请人： Xiaoyu Miao ,  Babak Amirparviz ,  Adrian Wong

发明人： Xiaoyu Miao ,  Babak Amirparviz ,  Adrian Wong

IPC分类号： G02B5/30 ,  G02B27/01

CPC分类号： G02B5/30 ,  G02B27/0172 ,  G02B2027/0138

摘要： Embodiments of a near-to-eye display include a light guide with a proximal end, a distal end, a front surface spaced apart from a back surface, an ambient input region on the front surface and an output region on the back surface. A display and a camera are positioned at or near the proximal end. A proximal optical element is positioned in the light guide and optically coupled to the display and the camera. A distal optical element is positioned in the light guide and optically coupled to the proximal optical element, the ambient input region and the output region. The proximal optical element can direct display light toward the distal optical element and ambient light to the camera, and the distal optical element can direct display light to the output region and ambient light to the output region and to the proximal optical element.

摘要翻译： 近视显示器的实施例包括具有近端，远端，与背面间隔开的前表面，前表面上的环境输入区域和背表面上的输出区域的光导。 显示器和相机位于近端处或附近。 近端光学元件被定位在光导中并且光耦合到显示器和照相机。 远端光学元件被定位在光导中并且光耦合到近端光学元件，环境输入区域和输出区域。 近端光学元件可以将远端光学元件的显示光和照相机的环境光引导到远端光学元件，并且远端光学元件可以将输出区域和环境光的显示光引导到输出区域和近端光学元件。

公开(公告)号：US20150177518A1

公开(公告)日：2015-06-25

申请号：US14626294

申请日：2015-02-19

申请人： Adrian Wong ,  Xiaoyu Miao

发明人： Adrian Wong ,  Xiaoyu Miao

IPC分类号： G02B27/01 ,  G06T19/00

CPC分类号： G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0178 ,  G06T19/006

摘要： Disclosed are methods and devices for rendering interactions between virtual and physical objects on a substantially transparent display are disclosed. In one embodiment, the method includes displaying a user-interface on a substantially transparent display of a wearable computing device. The method further includes displaying a virtual object in the view region at a focal length along a first line of sight and detecting a physical object at a physical distance along a second line of sight. The method still further includes determining that a relationship between the focal length and the physical distance is such that the virtual object and the physical object appear substantially co-located in a user-view through the view region and, responsive to the determination, initiating a collision action between the virtual object and the physical object.

摘要翻译： 公开了用于在基本上透明的显示器上呈现虚拟和物理对象之间的交互的方法和装置。 在一个实施例中，该方法包括在可穿戴计算设备的基本上透明的显示器上显示用户界面。 该方法还包括在沿着第一视线的焦点处在视野区域中显示虚拟对象，并沿着第二视线检测物理距离处的物理对象。 该方法还包括确定焦距和物理距离之间的关系使得虚拟对象和物理对象通过视图区域显现为基本上位于用户视图中，并且响应于该确定，启动一个 虚拟对象与物理对象之间的碰撞动作。

公开(公告)号：US08493204B2

公开(公告)日：2013-07-23

申请号：US13448636

申请日：2012-04-17

申请人： Adrian Wong ,  Xiaoyu Miao

发明人： Adrian Wong ,  Xiaoyu Miao

IPC分类号： G08B1/08 ,  G08B23/00 ,  G01S15/00 ,  H04R29/00

CPC分类号： H04R29/008 ,  G01H3/12 ,  G01H3/14 ,  G01S3/8036

摘要： Example methods and systems for displaying one or more indications that indicate (i) the direction of a source of sound and (ii) the intensity level of the sound are disclosed. A method may involve receiving audio data corresponding to sound detected by a wearable computing system. Further, the method may involve analyzing the audio data to determine both (i) a direction from the wearable computing system of a source of the sound and (ii) an intensity level of the sound. Still further, the method may involve causing the wearable computing system to display one or more indications that indicate (i) the direction of the source of the sound and (ii) the intensity level of the sound.

摘要翻译： 公开了一种用于显示一个或多个指示的方法和系统，所述指示指示（i）声源的方向和（ii）声音的强度水平。 一种方法可以涉及接收对应于由可穿戴计算系统检测到的声音的音频数据。 此外，该方法可以包括分析音频数据以确定（i）来自可佩戴计算系统的声源的方向和（ii）声音的强度级别。 此外，该方法可以包括使可穿戴计算系统显示指示（i）声源的方向和（ii）声音的强度水平的一个或多个指示。

公开(公告)号：US20130063486A1

公开(公告)日：2013-03-14

申请号：US13230276

申请日：2011-09-12

申请人： Max Braun ,  Babak Amirparviz ,  Xiaoyu Miao ,  Adrian Wong

发明人： Max Braun ,  Babak Amirparviz ,  Xiaoyu Miao ,  Adrian Wong

IPC分类号： G09G5/00

CPC分类号： G09G3/002 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G09G2320/066 ,  G09G2340/0464 ,  G09G2340/10 ,  G09G2340/14 ,  G09G2360/144

摘要： A method includes generating a light pattern using a display panel and forming a virtual image from the light pattern utilizing one or more optical components. The virtual image is viewable from a viewing location. The method also includes receiving external light from a real-world environment incident on an optical sensor. The real-world environment is viewable from the viewing location. Further, the method includes obtaining an image of the real-world environment from the received external light, identifying a background feature in the image of the real-world environment over which the virtual image is overlaid, and extracting one or more visual characteristics of the background feature. Additionally, the method includes comparing the one or more visual characteristics to an upper threshold value and a lower threshold value and controlling the generation of the light pattern based on the comparison.

摘要翻译： 一种方法包括使用显示面板产生光图案，并使用一个或多个光学部件从光图案形成虚拟图像。 可以从观看位置查看虚拟图像。 该方法还包括从入射在光学传感器上的真实环境中接收外部光。 从观看位置可以看到真实世界的环境。 此外，该方法包括从接收到的外部光中获取真实环境的图像，识别虚拟图像被重叠的真实环境的图像中的背景特征，以及提取一个或多个视觉特征 背景特征。 此外，该方法包括将一个或多个视觉特征与上阈值和下阈值进行比较，并且基于比较来控制光图案的生成。