Synthesis of information from multiple audiovisual sources
    1.
    发明授权
    Synthesis of information from multiple audiovisual sources 有权
    从多个视听源综合信息

    公开(公告)号:US08602887B2

    公开(公告)日:2013-12-10

    申请号:US12792961

    申请日:2010-06-03

    IPC分类号: G06F17/00

    摘要: A system and method are disclosed for synthesizing information received from multiple audio and visual sources focused on a single scene. The system may determine the positions of capture devices based on a common set of cues identified in the image data of the capture devices. As a scene may often have users and objects moving into and out of the scene, data from the multiple capture devices may be time synchronized to ensure that data from the audio and visual sources are providing data of the same scene at the same time. Audio and/or visual data from the multiple sources may be reconciled and assimilated together to improve an ability of the system to interpret audio and/or visual aspects from the scene.

    摘要翻译: 公开了一种用于合成从聚焦在单个场景上的多个音频和视频源接收的信息的系统和方法。 系统可以基于在捕获设备的图像数据中识别的一组公共信号来确定捕获设备的位置。 由于场景通常可能使用户和对象进出场景,来自多个捕获设备的数据可能是时间同步的,以确保来自音频和视频源的数据同时提供相同场景的数据。 来自多个源的音频和/或视觉数据可以一起协调和同化,以提高系统从场景中解释音频和/或视觉方面的能力。

    SYNTHESIS OF INFORMATION FROM MULTIPLE AUDIOVISUAL SOURCES
    2.
    发明申请
    SYNTHESIS OF INFORMATION FROM MULTIPLE AUDIOVISUAL SOURCES 有权
    从多个音频来源合成信息

    公开(公告)号:US20110300929A1

    公开(公告)日:2011-12-08

    申请号:US12792961

    申请日:2010-06-03

    IPC分类号: A63F13/00 G06K9/40 G06K9/36

    摘要: A system and method are disclosed for synthesizing information received from multiple audio and visual sources focused on a single scene. The system may determine the positions of capture devices based on a common set of cues identified in the image data of the capture devices. As a scene may often have users and objects moving into and out of the scene, data from the multiple capture devices may be time synchronized to ensure that data from the audio and visual sources are providing data of the same scene at the same time. Audio and/or visual data from the multiple sources may be reconciled and assimilated together to improve an ability of the system to interpret audio and/or visual aspects from the scene.

    摘要翻译: 公开了一种用于合成从聚焦在单个场景上的多个音频和视频源接收的信息的系统和方法。 系统可以基于在捕获设备的图像数据中识别的一组公共信号来确定捕获设备的位置。 由于场景通常可能使用户和对象进出场景,来自多个捕获设备的数据可能是时间同步的,以确保来自音频和视频源的数据同时提供相同场景的数据。 来自多个源的音频和/或视觉数据可以一起协调和同化,以提高系统从场景中解释音频和/或视觉方面的能力。

    Aligning inter-pupillary distance in a near-eye display system
    4.
    发明授权
    Aligning inter-pupillary distance in a near-eye display system 有权
    在近眼显示系统中对准瞳孔间距离

    公开(公告)号:US09213163B2

    公开(公告)日:2015-12-15

    申请号:US13221662

    申请日:2011-08-30

    摘要: The technology provides for automatic alignment of a see-through near-eye, mixed reality device with an inter-pupillary distance (IPD). A determination is made as to whether a see-through, near-eye, mixed reality display device is aligned with an IPD of a user. If the display device is not aligned with the IPD, the display device is automatically adjusted. In some examples, the alignment determination is based on determinations of whether an optical axis of each display optical system positioned to be seen through by a respective eye is aligned with a pupil of the respective eye in accordance with an alignment criteria. The pupil alignment may be determined based on an arrangement of gaze detection elements for each display optical system including at least one sensor for capturing data of the respective eye and the captured data. The captured data may be image data, image and glint data, and glint data only.

    摘要翻译: 该技术提供了透视近眼,混合现实设备与瞳孔间距离(IPD)的自动对准。 确定透视,近眼,混合现实显示设备是否与用户的IPD对准。 如果显示设备未与IPD对齐,则会自动调整显示设备。 在一些示例中,对准确定是基于根据对准标准确定位于通过各个眼睛看到的每个显示光学系统的光轴是否与各个眼睛的瞳孔对齐的确定。 可以基于每个显示光学系统的注视检测元件的布置来确定瞳孔对准,包括用于捕获各个眼睛的数据和捕获的数据的至少一个传感器。 捕获的数据可以仅是图像数据,图像和闪烁数据,以及闪烁数据。

    PERSONAL AUDIO/VISUAL SYSTEM WITH HOLOGRAPHIC OBJECTS
    9.
    发明申请
    PERSONAL AUDIO/VISUAL SYSTEM WITH HOLOGRAPHIC OBJECTS 审中-公开
    个人音乐/视觉系统与全息图对象

    公开(公告)号:US20130083018A1

    公开(公告)日:2013-04-04

    申请号:US13430972

    申请日:2012-03-27

    IPC分类号: G06T17/00 G09G5/00

    CPC分类号: G06F3/011

    摘要: A system for generating an augmented reality environment using state-based virtual objects is described. A state-based virtual object may be associated with a plurality of different states. Each state of the plurality of different states may correspond with a unique set of triggering events different from those of any other state. The set of triggering events associated with a particular state may be used to determine when a state change from the particular state is required. In some cases, each state of the plurality of different states may be associated with a different 3-D model or shape. The plurality of different states may be defined using a predetermined and standardized file format that supports state-based virtual objects. In some embodiments, one or more potential state changes from a particular state may be predicted based on one or more triggering probabilities associated with the set of triggering events.

    摘要翻译: 描述使用基于状态的虚拟对象来生成增强现实环境的系统。 基于状态的虚拟对象可以与多个不同的状态相关联。 多个不同状态的每个状态可以对应于与任何其他状态不同的唯一的触发事件集合。 可以使用与特定状态相关联的一组触发事件来确定何时需要状态从特定状态改变。 在一些情况下,多个不同状态的每个状态可以与不同的3-D模型或形状相关联。 可以使用支持基于状态的虚拟对象的预定和标准化文件格式来定义多个不同的状态。 在一些实施例中,可以基于与该组触发事件相关联的一个或多个触发概率来预测来自特定状态的一个或多个潜在状态改变。

    ADJUSTMENT OF A MIXED REALITY DISPLAY FOR INTER-PUPILLARY DISTANCE ALIGNMENT
    10.
    发明申请
    ADJUSTMENT OF A MIXED REALITY DISPLAY FOR INTER-PUPILLARY DISTANCE ALIGNMENT 有权
    调整混合现实显示用于机构间距离对齐

    公开(公告)号:US20130050833A1

    公开(公告)日:2013-02-28

    申请号:US13221707

    申请日:2011-08-30

    IPC分类号: G02B27/01

    摘要: The technology provides for adjusting a see-through, near-eye, mixed reality display device for alignment with an inter-pupillary distance (IPD) of a user by different examples of display adjustment mechanisms. The see-through, near-eye, mixed reality system includes for each eye a display optical system having an optical axis. Each display optical system is positioned to be seen through by a respective eye, and is supported on a respective movable support structure. A display adjustment mechanism attached to the display device also connects with each movable support structure for moving the structure. A determination is automatically made as to whether the display device is aligned with an IPD of a user. If not aligned, one or more adjustment values for a position of at least one of the display optical systems is automatically determined. The display adjustment mechanism moves the at least one display optical system in accordance with the adjustment values.

    摘要翻译: 该技术提供了通过显示调整机构的不同示例来调整透视眼睛混合现实显示设备,以与用户的瞳孔间距(IPD)对准。 透视,近眼,混合现实系统包括每个眼睛具有光轴的显示光学系统。 每个显示光学系统定位成通过相应的眼睛看到,并被支撑在相应的可移动支撑结构上。 附接到显示装置的显示调节机构也与用于移动结构的每个可移动支撑结构连接。 自动确定显示设备是否与用户的IPD对齐。 如果不对齐,则自动确定至少一个显示光学系统的位置的一个或多个调整值。 显示调整机构根据调整值移动至少一个显示光学系统。