Constructing augmented reality environment with pre-computed lighting

    公开(公告)号:US09892562B2

    公开(公告)日:2018-02-13

    申请号:US15298528

    申请日:2016-10-20

    CPC classification number: G06T19/006 G06T15/50 G06T2215/16

    Abstract: Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.

    Augmented reality display of scene behind surface

    公开(公告)号:US09799145B2

    公开(公告)日:2017-10-24

    申请号:US14805727

    申请日:2015-07-22

    CPC classification number: G06T19/006 G02B27/0172 G02B2027/0178

    Abstract: Embodiments are disclosed that relate to augmenting an appearance of a surface via a see-through display device. For example, one disclosed embodiment provides, on a computing device comprising a see-through display device, a method of augmenting an appearance of a surface. The method includes acquiring, via an outward-facing image sensor, image data of a first scene viewable through the display. The method further includes recognizing a surface viewable through the display based on the image data and, in response to recognizing the surface, acquiring a representation of a second scene comprising one or more of a scene located physically behind the surface viewable through the display and a scene located behind a surface contextually related to the surface viewable through the display. The method further includes displaying the representation via the see-through display.

    CONSTRUCTING AUGMENTED REALITY ENVIRONMENT WITH PRE-COMPUTED LIGHTING
    4.
    发明申请
    CONSTRUCTING AUGMENTED REALITY ENVIRONMENT WITH PRE-COMPUTED LIGHTING 有权
    用预先计算的照明来构建现实环境

    公开(公告)号:US20170039773A1

    公开(公告)日:2017-02-09

    申请号:US15298528

    申请日:2016-10-20

    CPC classification number: G06T19/006 G06T15/50 G06T2215/16

    Abstract: Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.

    Abstract translation: 公开了有效地构建具有全局照明效果的增强现实环境的实施例。 例如,一个公开的实施例提供了一种经由显示装置显示增强现实图像的方法。 该方法包括接收图像数据,捕获显示设备的本地环境的图像的图像数据,以及经由图像数据识别本地环境的物理特征。 该方法还包括构建虚拟结构的增强现实图像,用于在从用户的角度来的物理特征的空间配准中的物理特征上显示,增强现实图像包括布置在相邻位置中的多个模块化虚拟结构段 形成虚拟结构特征,每个模块化虚拟结构段包括预先计算的全局照明效果,并将增强现实图像输出到显示设备。

    Constructing augmented reality environment with pre-computed lighting
    5.
    发明授权
    Constructing augmented reality environment with pre-computed lighting 有权
    用预先计算的照明构建增强现实环境

    公开(公告)号:US09524585B2

    公开(公告)日:2016-12-20

    申请号:US13668953

    申请日:2012-11-05

    CPC classification number: G06T19/006 G06T15/50 G06T2215/16

    Abstract: Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.

    Abstract translation: 公开了有效地构建具有全局照明效果的增强现实环境的实施例。 例如,一个公开的实施例提供了一种经由显示装置显示增强现实图像的方法。 该方法包括接收图像数据,捕获显示设备的本地环境的图像的图像数据,以及经由图像数据识别本地环境的物理特征。 该方法还包括构建虚拟结构的增强现实图像,用于在从用户的角度来的物理特征的空间配准中的物理特征上显示,增强现实图像包括布置在相邻位置中的多个模块化虚拟结构段 形成虚拟结构特征,每个模块化虚拟结构段包括预先计算的全局照明效果,并将增强现实图像输出到显示设备。

    Mixed reality interactions
    6.
    发明授权

    公开(公告)号:US10510190B2

    公开(公告)日:2019-12-17

    申请号:US15694476

    申请日:2017-09-01

    Abstract: Embodiments that relate to interacting with a physical object in a mixed reality environment via a head-mounted display are disclosed. In one embodiment a mixed reality interaction program identifies an object based on an image from captured by the display. An interaction context for the object is determined based on an aspect of the mixed reality environment. A profile for the physical object is queried to determine interaction modes for the object. A selected interaction mode is programmatically selected based on the interaction context. A user input directed at the object is received via the display and interpreted to correspond to a virtual action based on the selected interaction mode. The virtual action is executed with respect to a virtual object associated with the physical object to modify an appearance of the virtual object. The modified virtual object is then displayed via the display.

    OBJECT TRACKING
    8.
    发明申请
    OBJECT TRACKING 有权
    对象追踪

    公开(公告)号:US20160373570A1

    公开(公告)日:2016-12-22

    申请号:US15256235

    申请日:2016-09-02

    Abstract: Embodiments are disclosed herein that relate to the automatic tracking of objects. For example, one disclosed embodiment provides a method of operating a mobile computing device having an image sensor. The method includes acquiring image data, identifying an inanimate moveable object in the image data, determining whether the inanimate moveable object is a tracked object, if the inanimate moveable object is a tracked object, then storing information regarding a state of the inanimate moveable object, detecting a trigger to provide a notification of the state of the inanimate moveable object, and providing an output of the notification of the state of the inanimate moveable object.

    Abstract translation: 本文公开的实施例涉及物体的自动跟踪。 例如,一个公开的实施例提供了一种操作具有图像传感器的移动计算设备的方法。 该方法包括获取图像数据,识别图像数据中的无生命可移动对象,确定无生命可移动对象是否是跟踪对象,如果无效可移动对象是被跟踪对象,则存储关于无生命可移动对象的状态的信息, 检测触发器以提供无生命可移动对象的状态的通知,以及提供无生命可移动对象的状态的通知的输出。

    User authentication on augmented reality display device
    9.
    发明授权
    User authentication on augmented reality display device 有权
    增强现实显示设备上的用户认证

    公开(公告)号:US09092600B2

    公开(公告)日:2015-07-28

    申请号:US13669255

    申请日:2012-11-05

    Abstract: Embodiments are disclosed that relate to authenticating a user of a display device. For example, one disclosed embodiment includes displaying one or more virtual images on the display device, wherein the one or more virtual images include a set of augmented reality features. The method further includes identifying one or more movements of the user via data received from a sensor of the display device, and comparing the identified movements of the user to a predefined set of authentication information for the user that links user authentication to a predefined order of the augmented reality features. If the identified movements indicate that the user selected the augmented reality features in the predefined order, then the user is authenticated, and if the identified movements indicate that the user did not select the augmented reality features in the predefined order, then the user is not authenticated.

    Abstract translation: 公开了涉及认证显示设备的用户的实施例。 例如,一个公开的实施例包括在显示设备上显示一个或多个虚拟图像,其中一个或多个虚拟图像包括一组增强现实特征。 所述方法还包括通过从所述显示设备的传感器接收的数据来识别所述用户的一个或多个移动,以及将所识别的用户移动与所述用户认证信息的预定义集合进行比较,所述用户认证信息将用户认证链接到 增强的现实功能。 如果所识别的移动指示用户以预定义的顺序选择增强的现实特征,则用户被认证,并且如果所识别的移动指示用户没有以预定义的顺序选择增强的真实特征,则用户不是 认证。

    Constructing augmented reality environment with pre-computed lighting

    公开(公告)号:US10229544B2

    公开(公告)日:2019-03-12

    申请号:US15815634

    申请日:2017-11-16

    Abstract: Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.

Patent Agency Ranking