-
公开(公告)号:US20130300653A1
公开(公告)日:2013-11-14
申请号:US13941439
申请日:2013-07-12
申请人: John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez
发明人: John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez
IPC分类号: G06F3/01
CPC分类号: G06F3/013 , A61B3/113 , G02B27/0093 , G02B27/017 , G02B27/2228 , G02B2027/0138 , G02B2027/014 , G02B2027/0187 , G06K9/00604
摘要: The technology provides various embodiments for gaze determination within a see-through, near-eye, mixed reality display device. In some embodiments, the boundaries of a gaze detection coordinate system can be determined from a spatial relationship between a user eye and gaze detection elements such as illuminators and at least one light sensor positioned on a support structure such as an eyeglasses frame. The gaze detection coordinate system allows for determination of a gaze vector from each eye based on data representing glints on the user eye, or a combination of image and glint data. A point of gaze may be determined in a three-dimensional user field of view including real and virtual objects. The spatial relationship between the gaze detection elements and the eye may be checked and may trigger a re-calibration of training data sets if the boundaries of the gaze detection coordinate system have changed.
-
公开(公告)号:US20130147838A1
公开(公告)日:2013-06-13
申请号:US13346674
申请日:2012-01-09
IPC分类号: G09G5/00
CPC分类号: G02B27/017 , G02B2027/0138 , G02B2027/014 , G06F3/013 , G06F3/017 , G06F3/0483 , G06F3/167 , G10L2015/228
摘要: The technology provides for updating printed content with personalized virtual data using a see-through, near-eye, mixed reality display device system. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. Virtual data is selected from available virtual data for the printed content selection based on user profile data, and the display device system displays the selected virtual data in a position registered to the position of the printed content selection. In some examples, a task related to the printed content item is determined based on physical action user input, and personalized virtual data is displayed registered to the printed content item in accordance with the task.
摘要翻译: 该技术提供使用透视,近眼,混合的现实显示设备系统来更新具有个性化虚拟数据的打印内容。 从显示装置上的照相机拍摄的图像数据识别出打印的内容项目,例如书籍或杂志,并且基于物理动作用户输入来识别打印内容项目内的打印内容选择的用户选择,例如眼睛 注视或手势。 基于用户简档数据从打印内容选择的可用虚拟数据中选择虚拟数据,并且显示设备系统将所选择的虚拟数据显示在登记到打印内容选择位置的位置。 在一些示例中,基于物理动作用户输入确定与打印的内容项相关的任务,并且根据任务将个性化虚拟数据显示登记到打印内容项。
-
公开(公告)号:US20130147836A1
公开(公告)日:2013-06-13
申请号:US13313368
申请日:2011-12-07
IPC分类号: G09G5/00
CPC分类号: G06T19/006 , G02B27/0093 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/017 , G06K9/00671
摘要: The technology provides embodiments for making static printed content being viewed through a see-through, mixed reality display device system more dynamic with display of virtual data. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. A task in relation to the printed content selection can also be determined based on physical action user input. Virtual data for the printed content selection is displayed in accordance with the task. Additionally, virtual data can be linked to a work embodied in a printed content item. Furthermore, a virtual version of the printed material may be displayed at a more comfortable reading position and with improved visibility of the content.
摘要翻译: 该技术提供了通过具有虚拟数据的显示更动态的透明,混合现实显示设备系统来制作静态打印内容的实施例。 从显示装置上的照相机拍摄的图像数据识别出打印的内容项目,例如书籍或杂志,并且基于用户输入的物理动作来识别打印内容项目内的打印内容选择的用户选择,例如眼睛 注视或手势。 关于印刷内容选择的任务也可以基于物理动作用户输入来确定。 根据任务显示打印内容选择的虚拟数据。 此外,虚拟数据可以链接到打印的内容项目中体现的作品。 此外,打印材料的虚拟版本可以以更舒适的阅读位置显示并且改善内容的可视性。
-
公开(公告)号:US20130147687A1
公开(公告)日:2013-06-13
申请号:US13347576
申请日:2012-01-10
IPC分类号: G09G5/00
CPC分类号: G09G5/00 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/015 , G06F3/017 , G06F3/0346 , G06F3/0483 , G06F3/04842 , G06T19/006 , G09G2354/00 , G09G2380/14
摘要: The technology provides embodiments for displaying virtual data as printed content by a see-through, near-eye, mixed reality display device system. One or more literary content items registered to a reading object in a field of view of the display device system are displayed with print layout characteristics. Print layout characteristics from a publisher of each literary content item are selected if available. The reading object has a type like a magazine, book, journal or newspaper and may be a real object or a virtual object displayed by the display device system. The reading object type of the virtual object is based on a reading object type associated with a literary content item to be displayed. Virtual augmentation data registered to a literary content item is displayed responsive to detecting user physical action in image data. An example of a physical action is a page flipping gesture.
摘要翻译: 该技术提供了通过透视,近眼,混合现实显示设备系统将虚拟数据显示为打印内容的实施例。 在显示装置系统的视野中登记到读取对象的一个或多个文学内容项以打印布局特征显示。 选择每个文学内容项目的发布者的打印布局特征(如果可用)。 读取对象具有类似于杂志,书籍,日记或报纸的类型,并且可以是由显示设备系统显示的真实对象或虚拟对象。 虚拟对象的读取对象类型基于与要显示的文学内容项相关联的读取对象类型。 响应于检测到图像数据中的用户身体动作,显示登记到文学内容项目的虚拟增强数据。 物理动作的一个例子是翻页手势。
-
公开(公告)号:US20130050070A1
公开(公告)日:2013-02-28
申请号:US13221739
申请日:2011-08-30
申请人: John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez
发明人: John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez
CPC分类号: G06F3/013 , A61B3/113 , G02B27/0093 , G02B27/017 , G02B27/2228 , G02B2027/0138 , G02B2027/014 , G02B2027/0187 , G06K9/00604
摘要: The technology provides various embodiments for gaze determination within a see-through, near-eye, mixed reality display device. In some embodiments, the boundaries of a gaze detection coordinate system can be determined from a spatial relationship between a user eye and gaze detection elements such as illuminators and at least one light sensor positioned on a support structure such as an eyeglasses frame. The gaze detection coordinate system allows for determination of a gaze vector from each eye based on data representing glints on the user eye, or a combination of image and glint data. A point of gaze may be determined in a three-dimensional user field of view including real and virtual objects. The spatial relationship between the gaze detection elements and the eye may be checked and may trigger a re-calibration of training data sets if the boundaries of the gaze detection coordinate system have changed.
-
公开(公告)号:US09038127B2
公开(公告)日:2015-05-19
申请号:US13212673
申请日:2011-08-18
CPC分类号: G06Q50/184 , G06F3/011 , G06F21/10 , G06T2219/024 , H04L67/38
摘要: Technology is provided for transferring a right to a digital content item based on one or more physical actions detected in data captured by a see-through, augmented reality display device system. A digital content item may be represented by a three-dimensional (3D) virtual object displayed by the device system. A user can hold the virtual object in some examples, and transfer a right to the content item the object represents by handing the object to another user within a defined distance, who indicates acceptance of the right based upon one or more physical actions including taking hold of the transferred object. Other examples of physical actions performed by a body part of a user may also indicate offer and acceptance in the right transfer. Content may be transferred from display device to display device while rights data is communicated via a network with a service application executing remotely.
摘要翻译: 技术被提供用于基于在透视增强现实显示设备系统捕获的数据中检测到的一个或多个物理动作来传送数字内容项目的权利。 数字内容项目可以由设备系统显示的三维(3D)虚拟对象来表示。 用户可以在一些示例中保存虚拟对象,并且通过在定义的距离内将对象传递给另一用户来传送对象所表示的内容的权利,所述对象指示基于一个或多个身体动作(包括保持)接受该权利 的转移对象。 用户的身体部位执行的身体动作的其他示例也可以指示在正确传送中的提议和接受。 内容可以从显示设备传送到显示设备,而通过远程执行服务应用的网络传送权限数据。
-
公开(公告)号:US20130042296A1
公开(公告)日:2013-02-14
申请号:US13212673
申请日:2011-08-18
IPC分类号: G06F21/00
CPC分类号: G06Q50/184 , G06F3/011 , G06F21/10 , G06T2219/024 , H04L67/38
摘要: Technology is provided for transferring a right to a digital content item based on one or more physical actions detected in data captured by a see-through, augmented reality display device system. A digital content item may be represented by a three-dimensional (3D) virtual object displayed by the device system. A user can hold the virtual object in some examples, and transfer a right to the content item the object represents by handing the object to another user within a defined distance, who indicates acceptance of the right based upon one or more physical actions including taking hold of the transferred object. Other examples of physical actions performed by a body part of a user may also indicate offer and acceptance in the right transfer. Content may be transferred from display device to display device while rights data is communicated via a network with a service application executing remotely.
摘要翻译: 技术被提供用于基于在透视增强现实显示设备系统捕获的数据中检测到的一个或多个物理动作来传送数字内容项目的权利。 数字内容项目可以由设备系统显示的三维(3D)虚拟对象来表示。 用户可以在一些示例中保存虚拟对象,并且通过将对象传递给定义的距离内的另一用户来传送对象所表示的内容的权利,所述对象指示基于一个或多个身体动作(包括保持)接受该权利 的转移对象。 用户的身体部位执行的身体动作的其他示例也可以指示在正确传送中的提议和接受。 内容可以从显示设备传送到显示设备,而通过远程执行服务应用的网络传送权限数据。
-
公开(公告)号:US20140168261A1
公开(公告)日:2014-06-19
申请号:US13713910
申请日:2012-12-13
申请人: Jeffrey N. Margolis , Benjamin I. Vaught , Alex Aben-Athar Kipman , Georg Klein , Frederik Schaffalitzky , David Nister , Russ McMackin , Doug Barnes
发明人: Jeffrey N. Margolis , Benjamin I. Vaught , Alex Aben-Athar Kipman , Georg Klein , Frederik Schaffalitzky , David Nister , Russ McMackin , Doug Barnes
IPC分类号: G06T19/00
CPC分类号: G06T19/006 , A63F13/211 , A63F13/65 , A63F13/98 , G06F3/011 , H04N13/156 , H04N13/344
摘要: A system and method are disclosed for interacting with virtual objects in a virtual environment using an accessory such as a hand held object. The virtual object may be viewed using a display device. The display device and hand held object may cooperate to determine a scene map of the virtual environment, the display device and hand held object being registered in the scene map.
摘要翻译: 公开了一种用于使用诸如手持对象的附件在虚拟环境中与虚拟对象交互的系统和方法。 可以使用显示设备来查看虚拟对象。 显示装置和手持物体可以协作以确定在场景图中登记的虚拟环境,显示装置和手持物体的场景图。
-
公开(公告)号:US20130021373A1
公开(公告)日:2013-01-24
申请号:US13193563
申请日:2011-07-28
IPC分类号: G09G5/00
CPC分类号: G06F3/011 , G02B27/017 , G02B2027/0178 , G02B2027/0187 , G06F3/013 , G09G2320/0261 , G09G2380/02
摘要: A see-through head-mounted display (HMD) device, e.g., in the form of glasses, provides view an augmented reality image including text, such as in an electronic book or magazine, word processing document, email, karaoke, teleprompter or other public speaking assistance application. The presentation of text and/or graphics can be adjusted based on sensor inputs indicating a gaze direction, focal distance and/or biological metric of the user. A current state of the text can be bookmarked when the user looks away from the image and subsequently resumed from the bookmarked state. A forward facing camera can adjust the text if a real word object passes in front of it, or adjust the appearance of the text based on a color of pattern of a real world background object. In a public speaking or karaoke application, information can be displayed regarding a level of interest of the audience and names of audience members.
摘要翻译: 透视式头戴式显示器(HMD)装置,例如以眼镜的形式,提供包括文本的增强现实图像,例如电子书或杂志,文字处理文件,电子邮件,卡拉OK,电报或其他 公开演讲援助申请 可以基于指示用户的注视方向,焦距和/或生物学度量的传感器输入来调整文本和/或图形的呈现。 当用户远离图像并随后从书签状态恢复时,文本的当前状态可被加入书签。 如果真正的字对象在其前方通过,则前向摄像头可以调整文本,或者基于真实世界背景对象的图案的颜色来调整文本的外观。 在公开演讲或卡拉OK应用程序中,可以显示关于观众的兴趣水平和观众成员名称的信息。
-
公开(公告)号:US20140253437A1
公开(公告)日:2014-09-11
申请号:US14285938
申请日:2014-05-23
CPC分类号: G06F3/011 , G02B27/017 , G02B2027/0178 , G02B2027/0187 , G06F3/013 , G09G2320/0261 , G09G2380/02
摘要: A see-through head-mounted display (HMD) device, e.g., in the form of glasses, provides view an augmented reality image including text, such as in an electronic book or magazine, word processing document, email, karaoke, teleprompter or other public speaking assistance application. The presentation of text and/or graphics can be adjusted based on sensor inputs indicating a gaze direction, focal distance and/or biological metric of the user. A current state of the text can be bookmarked when the user looks away from the image and subsequently resumed from the bookmarked state. A forward facing camera can adjust the text if a real word object passes in front of it, or adjust the appearance of the text based on a color of pattern of a real world background object. In a public speaking or karaoke application, information can be displayed regarding a level of interest of the audience and names of audience members.
摘要翻译: 透视式头戴式显示器(HMD)装置,例如以眼镜的形式,提供包括文本的增强现实图像,例如电子书或杂志,文字处理文件,电子邮件,卡拉OK,电报或其他 公开演讲援助申请 可以基于指示用户的注视方向,焦距和/或生物学度量的传感器输入来调整文本和/或图形的呈现。 当用户远离图像并随后从书签状态恢复时,文本的当前状态可被加入书签。 如果真正的字对象在其前方通过,则前向摄像头可以调整文本,或者基于真实世界背景对象的图案的颜色来调整文本的外观。 在公开演讲或卡拉OK应用程序中,可以显示关于观众的兴趣水平和观众成员名称的信息。
-
-
-
-
-
-
-
-
-