GAZE DETECTION IN A SEE-THROUGH, NEAR-EYE, MIXED REALITY DISPLAY
    31.
    发明申请
    GAZE DETECTION IN A SEE-THROUGH, NEAR-EYE, MIXED REALITY DISPLAY 有权
    在一个看到眼睛,近眼睛,混合现实显示的GAZE检测

    公开(公告)号:US20130286178A1

    公开(公告)日:2013-10-31

    申请号:US13844453

    申请日:2013-03-15

    IPC分类号: G06F3/01

    摘要: The technology provides various embodiments for gaze determination within a see-through, near-eye, mixed reality display device. In some embodiments, the boundaries of a gaze detection coordinate system can be determined from a spatial relationship between a user eye and gaze detection elements such as illuminators and at least one light sensor positioned on a support structure such as an eyeglasses frame. The gaze detection coordinate system allows for determination of a gaze vector from each eye based on data representing glints on the user eye, or a combination of image and glint data. A point of gaze may be determined in a three-dimensional user field of view including real and virtual objects. The spatial relationship between the gaze detection elements and the eye may be checked and may trigger a re-calibration of training data sets if the boundaries of the gaze detection coordinate system have changed.

    摘要翻译: 该技术提供了在透视,近眼,混合现实显示设备内的凝视确定的各种实施例。 在一些实施例中,可以从用户眼睛和注视检测元件(例如照明器)和位于诸如眼镜框架的支撑结构上的至少一个光传感器之间的空间关系来确定注视检测坐标系的边界。 注视检测坐标系允许基于用户眼睛上的闪烁的数据,或图像和闪光数据的组合来确定来自每只眼睛的注视矢量。 注视点可以在包括实际和虚拟对象的三维用户视野中确定。 可以检查注视检测元件和眼睛之间的空间关系,并且如果注视检测坐标系的边界已经改变,则可以触发训练数据集的重新校准。

    ENHANCING AN OBJECT OF INTEREST IN A SEE-THROUGH, MIXED REALITY DISPLAY DEVICE
    33.
    发明申请
    ENHANCING AN OBJECT OF INTEREST IN A SEE-THROUGH, MIXED REALITY DISPLAY DEVICE 有权
    在一个完美的混合现实显示设备中增强兴趣的对象

    公开(公告)号:US20130050432A1

    公开(公告)日:2013-02-28

    申请号:US13221770

    申请日:2011-08-30

    IPC分类号: G09G5/00 H04N13/02

    摘要: Technology is disclosed for enhancing the experience of a user wearing a see-through, near eye mixed reality display device. Based on an arrangement of gaze detection elements on each display optical system for each eye of the display device, a respective gaze vector is determined and a current user focal region is determined based on the gaze vectors. Virtual objects are displayed at their respective focal regions in a user field of view for a natural sight view. Additionally, one or more objects of interest to a user may be identified. The identification may be based on a user intent to interact with the object. For example, the intent may be determined based on a gaze duration. Augmented content may be projected over or next to an object, real or virtual. Additionally, a real or virtual object intended for interaction may be zoomed in or out.

    摘要翻译: 公开了用于增强佩戴透明近眼睛混合现实显示装置的用户体验的技术。 基于在显示装置的每个眼睛的每个显示光学系统上的注视检测元件的布置,确定相应的注视向量,并且基于注视向量来确定当前用户聚焦区域。 在用户视野中的虚拟对象在其各自的焦点区域处显示,用于自然视野。 另外,可以识别用户感兴趣的一个或多个对象。 识别可以基于用户与对象交互的意图。 例如,可以基于注视持续时间来确定意图。 增强的内容可以投射在对象的真实或虚拟的上方或旁边。 另外,可以放大或缩小用于交互的实际或虚拟对象。

    Updating printed content with personalized virtual data
    34.
    发明授权
    Updating printed content with personalized virtual data 有权
    使用个性化虚拟数据更新打印内容

    公开(公告)号:US09229231B2

    公开(公告)日:2016-01-05

    申请号:US13346674

    申请日:2012-01-09

    摘要: The technology provides for updating printed content with personalized virtual data using a see-through, near-eye, mixed reality display device system. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. Virtual data is selected from available virtual data for the printed content selection based on user profile data, and the display device system displays the selected virtual data in a position registered to the position of the printed content selection. In some examples, a task related to the printed content item is determined based on physical action user input, and personalized virtual data is displayed registered to the printed content item in accordance with the task.

    摘要翻译: 该技术提供使用透视,近眼,混合的现实显示设备系统来更新具有个性化虚拟数据的打印内容。 从显示装置上的照相机拍摄的图像数据识别出打印的内容项目,例如书籍或杂志,并且基于物理动作用户输入来识别打印内容项目内的打印内容选择的用户选择,例如眼睛 注视或手势。 基于用户简档数据从打印内容选择的可用虚拟数据中选择虚拟数据,并且显示设备系统将所选择的虚拟数据显示在登记在打印内容选择位置的位置。 在一些示例中,基于物理动作用户输入确定与打印的内容项相关的任务,并且根据任务将个性化虚拟数据显示登记到打印内容项。

    Displaying virtual data as printed content
    35.
    发明授权
    Displaying virtual data as printed content 有权
    显示虚拟数据作为打印内容

    公开(公告)号:US09183807B2

    公开(公告)日:2015-11-10

    申请号:US13347576

    申请日:2012-01-10

    摘要: The technology provides embodiments for displaying virtual data as printed content by a see-through, near-eye, mixed reality display device system. One or more literary content items registered to a reading object in a field of view of the display device system are displayed with print layout characteristics. Print layout characteristics from a publisher of each literary content item are selected if available. The reading object has a type like a magazine, book, journal or newspaper and may be a real object or a virtual object displayed by the display device system. The reading object type of the virtual object is based on a reading object type associated with a literary content item to be displayed. Virtual augmentation data registered to a literary content item is displayed responsive to detecting user physical action in image data. An example of a physical action is a page flipping gesture.

    摘要翻译: 该技术提供了通过透视,近眼,混合现实显示设备系统将虚拟数据显示为打印内容的实施例。 在显示装置系统的视野中登记到读取对象的一个​​或多个文学内容项以打印布局特征显示。 选择每个文学内容项目的发布者的打印布局特征(如果可用)。 读取对象具有类似于杂志,书籍,日记或报纸的类型,并且可以是由显示设备系统显示的真实对象或虚拟对象。 虚拟对象的读取对象类型基于与要显示的文学内容项相关联的读取对象类型。 响应于检测到图像数据中的用户身体动作,显示登记到文学内容项目的虚拟增强数据。 物理动作的一个例子是翻页手势。

    ALIGNING INTER-PUPILLARY DISTANCE IN A NEAR-EYE DISPLAY SYSTEM
    36.
    发明申请
    ALIGNING INTER-PUPILLARY DISTANCE IN A NEAR-EYE DISPLAY SYSTEM 有权
    在近视显示系统中对准间隔距离

    公开(公告)号:US20130050642A1

    公开(公告)日:2013-02-28

    申请号:US13221662

    申请日:2011-08-30

    IPC分类号: A61B3/11

    摘要: The technology provides for automatic alignment of a see-through near-eye, mixed reality device with an inter-pupillary distance (IPD). A determination is made as to whether a see-through, near-eye, mixed reality display device is aligned with an IPD of a user. If the display device is not aligned with the IPD, the display device is automatically adjusted. In some examples, the alignment determination is based on determinations of whether an optical axis of each display optical system positioned to be seen through by a respective eye is aligned with a pupil of the respective eye in accordance with an alignment criteria. The pupil alignment may be determined based on an arrangement of gaze detection elements for each display optical system including at least one sensor for capturing data of the respective eye and the captured data. The captured data may be image data, image and glint data, and glint data only.

    摘要翻译: 该技术提供了透视近眼,混合现实设备与瞳孔间距离(IPD)的自动对准。 确定透视,近眼,混合现实显示设备是否与用户的IPD对准。 如果显示设备未与IPD对齐,则会自动调整显示设备。 在一些示例中,对准确定是基于根据对准标准确定位于通过各个眼睛看到的每个显示光学系统的光轴是否与各个眼睛的瞳孔对齐的确定。 可以基于每个显示光学系统的注视检测元件的布置来确定瞳孔对准,包括用于捕获各个眼睛的数据和捕获的数据的至少一个传感器。 捕获的数据可以仅是图像数据,图像和闪烁数据,以及闪烁数据。

    Method and device for adjusting sound levels of sources based on sound source priority
    37.
    发明授权
    Method and device for adjusting sound levels of sources based on sound source priority 有权
    基于声源优先级调节声源水平的方法和装置

    公开(公告)号:US09384737B2

    公开(公告)日:2016-07-05

    申请号:US13538731

    申请日:2012-06-29

    CPC分类号: G10L17/00 H03G3/10

    摘要: A system for generating one or more enhanced audio signals such that one or more sound levels corresponding with sounds received from one or more sources of sound within an environment may be dynamically adjusted based on contextual information is described. The one or more enhanced audio signals may be generated by a head-mounted display device (HMD) worn by an end user within the environment and outputted to earphones associated with the HMD such that the end user may listen to the one or more enhanced audio signals in real-time. In some cases, each of the one or more sources of sound may correspond with a priority level. The priority level may be dynamically assigned depending on whether the end user of the HMD is focusing on a particular source of sound or has specified a predetermined level of importance corresponding with the particular source of sound.

    摘要翻译: 描述了一种用于生成一个或多个增强音频信号的系统,以便可以基于上下文信息来动态地调整与环境中的一个或多个声源所接收的声音相对应的一个或多个声级。 一个或多个增强音频信号可以由环境中终端用户佩戴的头戴式显示设备(HMD)产生,并且输出到与HMD相关联的耳机,使得终端用户可以收听一个或多个增强音频 信号实时。 在一些情况下,一个或多个声源中的每一个可以对应于优先级。 可以根据HMD的最终用户是聚焦于特定的声源还是指定了与特定的声源相对应的预定重要程度,来动态地分配优先级。