-
公开(公告)号:US10019962B2
公开(公告)日:2018-07-10
申请号:US13212172
申请日:2011-08-17
申请人: James C. Liu , Anton O. Andrews , Benjamin I. Vaught , Craig R. Maitlen , Christopher M. Novak , Sheridan Martin Small
发明人: James C. Liu , Anton O. Andrews , Benjamin I. Vaught , Craig R. Maitlen , Christopher M. Novak , Sheridan Martin Small
IPC分类号: G09G5/00 , G06F3/01 , G02B27/01 , H04N13/02 , H04N13/04 , G06T19/00 , G09G3/00 , G09G3/34 , G09G5/12 , G09G5/14
CPC分类号: G09G5/00 , G02B27/017 , G02B2027/0112 , G02B2027/014 , G02B2027/0178 , G06F3/011 , G06T19/006 , G09G3/002 , G09G3/3413 , G09G5/12 , G09G5/14 , G09G2340/12 , G09G2354/00 , H04N13/271 , H04N13/344
摘要: A user interface includes a virtual object having an appearance in context with a real environment of a user using a see-through, near-eye augmented reality display device system. A virtual type of object and at least one real world object are selected based on compatibility criteria for forming a physical connection like attachment, supporting or integration of the virtual object with the at least one real object. Other appearance characteristics, e.g. color, size or shape, of the virtual object are selected for satisfying compatibility criteria with the selected at least one real object. Additionally, a virtual object type and appearance characteristics of the virtual object may be selected based on a social context of the user, a personal context of the user or both.
-
公开(公告)号:US09182815B2
公开(公告)日:2015-11-10
申请号:US13313368
申请日:2011-12-07
CPC分类号: G06T19/006 , G02B27/0093 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/017 , G06K9/00671
摘要: The technology provides embodiments for making static printed content being viewed through a see-through, mixed reality display device system more dynamic with display of virtual data. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. A task in relation to the printed content selection can also be determined based on physical action user input. Virtual data for the printed content selection is displayed in accordance with the task. Additionally, virtual data can be linked to a work embodied in a printed content item. Furthermore, a virtual version of the printed material may be displayed at a more comfortable reading position and with improved visibility of the content.
摘要翻译: 该技术提供了通过具有虚拟数据的显示更动态的透明,混合现实显示设备系统来制作静态打印内容的实施例。 从显示装置上的照相机拍摄的图像数据识别出打印的内容项目,例如书籍或杂志,并且基于物理动作用户输入来识别打印内容项目内的打印内容选择的用户选择,例如眼睛 注视或手势。 关于印刷内容选择的任务也可以基于物理动作用户输入来确定。 根据任务显示打印内容选择的虚拟数据。 此外,虚拟数据可以链接到打印的内容项目中体现的作品。 此外,打印材料的虚拟版本可以以更舒适的阅读位置显示并且改善内容的可视性。
-
3.
公开(公告)号:US09342610B2
公开(公告)日:2016-05-17
申请号:US13218298
申请日:2011-08-25
申请人: James Chia-Ming Liu , Anton Oguzhan Alford Andrews , Craig R. Maitlen , Christopher M. Novak , Darren A. Bennett , Sheridan Martin Small
发明人: James Chia-Ming Liu , Anton Oguzhan Alford Andrews , Craig R. Maitlen , Christopher M. Novak , Darren A. Bennett , Sheridan Martin Small
CPC分类号: G06F17/3087 , G02B27/017 , G02B2027/0127 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/005 , G06F3/012 , G06F3/013 , G06F3/038 , G06F2203/0381 , G06T19/006 , H04N13/344 , H04N13/366 , H04N13/383
摘要: A see-through head-mounted display (HMD) device provides an augmented reality image which is associated with a real-world object, such as a picture frame, wall or billboard. Initially, the object is identified by a user, e.g., based on the user gazing at the object for a period of time, making a gesture such as pointing at the object and/or providing a verbal command. The location and visual characteristics of the object are determined by a front-facing camera of the HMD device, and stored in a record. The user selects from among candidate data streams, such as a web page, game feed, video or stocker ticker. Subsequently, when the user is in the location of the object and looks at the object, the HMD device matches the visual characteristics to the record to identify the data stream, and displays corresponding augmented reality images registered to the object.
摘要翻译: 透视式头戴式显示器(HMD)装置提供与现实世界对象(例如相框,墙壁或广告牌)相关联的增强现实图像。 最初,用户例如基于用户在对象上注视一段时间来标识对象,进行诸如指向对象的手势和/或提供口头命令。 物体的位置和视觉特征由HMD装置的前置照相机确定,并存储在记录中。 用户从候选数据流中选择诸如网页,游戏馈送,视频或股票代码。 随后,当用户处于对象的位置并查看对象时,HMD设备将视觉特征与记录相匹配以识别数据流,并且显示登记到对象的相应的增强现实图像。
-
公开(公告)号:US09146398B2
公开(公告)日:2015-09-29
申请号:US13181156
申请日:2011-07-12
CPC分类号: G02B27/017 , G02B2027/014 , G02B2027/0178 , G06F3/011 , G06F3/013 , G06F3/017 , G06F3/0304 , G06F3/147
摘要: Techniques are provided for displaying electronic communications using a head mounted display (HMD). Each electronic communication may be displayed to represent a physical object that indentifies it as a specific type or nature of electronic communication. Therefore, the user is able to process the electronic communications more efficiently. In some aspects, computer vision allows a user to interact with the representation of the physical objects. One embodiment includes accessing electronic communications, and determining physical objects that are representative of at least a subset of the electronic communications. A head mounted display (HMD) is instructed how to display a representation of the physical objects in this embodiment.
摘要翻译: 提供了使用头戴显示器(HMD)显示电子通信的技术。 可以显示每个电子通信以表示将其识别为电子通信的特定类型或性质的物理对象。 因此,用户能够更有效地处理电子通信。 在某些方面,计算机视觉允许用户与物理对象的表示进行交互。 一个实施例包括访问电子通信,以及确定表示电子通信的至少一个子集的物理对象。 在本实施例中,头戴显示器(HMD)被指示如何显示物理对象的表示。
-
公开(公告)号:US08640021B2
公开(公告)日:2014-01-28
申请号:US12945664
申请日:2010-11-12
IPC分类号: G06F17/00
CPC分类号: G06Q30/02 , G06Q30/06 , G06Q30/0631 , H04N21/42203 , H04N21/4223 , H04N21/441 , H04N21/44218 , H04N21/4532 , H04N21/4661 , H04N21/4667 , H04N21/4668
摘要: A system and method are disclosed for delivering content customized to the specific user or users interacting with the system. The system includes one or more modules for recognizing an identity of a user. These modules may include for example a gesture recognition engine, a facial recognition engine, a body language recognition engine and a voice recognition engine. The user may also be carrying a mobile device such as a smart phone which identifies the user. One or more of these modules may cooperate to identify a user, and then customize the user's content based on the user's identity. In particular, the system receives user preferences indicating the content a user wishes to receive and the conditions under which it is to be received. Based on the user preferences and recognition of a user identity and/or other traits, the system presents content customized for a particular user.
摘要翻译: 公开了一种系统和方法,用于递送针对特定用户定制的内容或与系统交互的用户。 该系统包括用于识别用户身份的一个或多个模块。 这些模块可以包括例如手势识别引擎,面部识别引擎,身体语言识别引擎和语音识别引擎。 用户还可以携带识别用户的诸如智能电话的移动设备。 这些模块中的一个或多个可以协作以识别用户,然后基于用户的身份来定制用户的内容。 特别地,系统接收用户偏好,指示用户希望接收的内容以及要接收的内容。 基于用户偏好和用户身份和/或其他特征的识别,系统呈现针对特定用户定制的内容。
-
公开(公告)号:US20130016033A1
公开(公告)日:2013-01-17
申请号:US13181156
申请日:2011-07-12
IPC分类号: G09G5/00
CPC分类号: G02B27/017 , G02B2027/014 , G02B2027/0178 , G06F3/011 , G06F3/013 , G06F3/017 , G06F3/0304 , G06F3/147
摘要: Techniques are provided for displaying electronic communications using a head mounted display (HMD). Each electronic communication may be displayed to represent a physical object that indentifies it as a specific type or nature of electronic communication. Therefore, the user is able to process the electronic communications more efficiently. In some aspects, computer vision allows a user to interact with the representation of the physical objects. One embodiment includes accessing electronic communications, and determining physical objects that are representative of at least a subset of the electronic communications. A head mounted display (HMD) is instructed how to display a representation of the physical objects in this embodiment.
摘要翻译: 提供了使用头戴显示器(HMD)显示电子通信的技术。 可以显示每个电子通信以表示将其识别为电子通信的特定类型或性质的物理对象。 因此,用户能够更有效地处理电子通信。 在某些方面,计算机视觉允许用户与物理对象的表示进行交互。 一个实施例包括访问电子通信,以及确定表示电子通信的至少一个子集的物理对象。 在本实施例中,头戴显示器(HMD)被指示如何显示物理对象的表示。
-
公开(公告)号:US20120206452A1
公开(公告)日:2012-08-16
申请号:US13443368
申请日:2012-04-10
申请人: Kevin A. Geisner , Brian J. Mount , Stephen G. Latta , Daniel J. McCulloch , Kyungsuk David Lee , Ben J. Sugden , Jeffrey N. Margolis , Kathryn Stone Perez , Sheridan Martin Small , Mark J. Finocchio , Robert L. Crocco, JR.
发明人: Kevin A. Geisner , Brian J. Mount , Stephen G. Latta , Daniel J. McCulloch , Kyungsuk David Lee , Ben J. Sugden , Jeffrey N. Margolis , Kathryn Stone Perez , Sheridan Martin Small , Mark J. Finocchio , Robert L. Crocco, JR.
CPC分类号: G02B27/017 , G02B2027/0127 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06F3/011 , G06F3/013 , G06F3/165 , G06F3/167 , G06K9/00214 , G06K9/00335 , G06K9/00671 , G06K9/34 , G06T19/006 , H04S7/304 , H04S7/306 , H04S2400/11 , H04S2400/15 , H04S2420/03
摘要: Technology is described for providing realistic occlusion between a virtual object displayed by a head mounted, augmented reality display system and a real object visible to the user's eyes through the display. A spatial occlusion in a user field of view of the display is typically a three dimensional occlusion determined based on a three dimensional space mapping of real and virtual objects. An occlusion interface between a real object and a virtual object can be modeled at a level of detail determined based on criteria such as distance within the field of view, display size or position with respect to a point of gaze. Technology is also described for providing three dimensional audio occlusion based on an occlusion between a real object and a virtual object in the user environment.
摘要翻译: 描述了技术,用于在由头戴式显示器,增强现实显示系统显示的虚拟对象和通过显示器对用户的眼睛可见的真实物体之间提供逼真的遮挡。 显示器的用户视野中的空间遮挡通常是基于实际和虚拟物体的三维空间映射确定的三维遮挡。 可以以基于诸如视场内的距离,相对于凝视点的显示大小或位置的标准确定的细节级别来建模真实对象和虚拟对象之间的遮挡界面。 还描述了用于基于用户环境中的真实对象和虚拟对象之间的遮挡来提供三维音频遮挡的技术。
-
公开(公告)号:US20120124604A1
公开(公告)日:2012-05-17
申请号:US12945691
申请日:2010-11-12
CPC分类号: H04N21/4223 , H04N21/44213 , H04N21/44218 , H04N21/6582
摘要: A system for generating passive and anonymous feedback of multimedia content viewed by users is disclosed. The multimedia content may include recorded video content, video-on-demand content, television content, television programs, advertisements, commercials, music, movies, video clips, and other on-demand media content. One or more of the users in a field of view of a capture device connected to the computing device are identified. An engagement level of the users to multimedia content being viewed by the users is determined by tracking movements, gestures, postures and facial expressions performed by the users. A report of the response to viewed multimedia content is generated based on the movements, gestures, postures and facial expressions performed by the users. The report is provided to rating agencies, content providers and advertisers. In one embodiment, preview content and personalized content related to the viewed multimedia content is received from the content providers and advertisers based on the report. The preview content and personalized content are displayed to the users.
摘要翻译: 公开了一种用于生成用户观看的多媒体内容的被动和匿名反馈的系统。 多媒体内容可以包括记录的视频内容,视频点播内容,电视内容,电视节目,广告,广告,音乐,电影,视频剪辑和其他按需媒体内容。 识别连接到计算设备的捕获设备的视野中的一个或多个用户。 通过跟踪由用户执行的移动,手势,姿态和面部表情来确定用户正在观看的多媒体内容的参与级别。 基于用户执行的移动,手势,姿势和面部表情,生成对所查看的多媒体内容的响应的报告。 该报告提供给评级机构,内容提供商和广告商。 在一个实施例中,基于报告从内容提供商和广告商接收与所查看的多媒体内容相关的预览内容和个性化内容。 预览内容和个性化内容显示给用户。
-
公开(公告)号:US20120124456A1
公开(公告)日:2012-05-17
申请号:US12945664
申请日:2010-11-12
IPC分类号: G06F17/00
CPC分类号: G06Q30/02 , G06Q30/06 , G06Q30/0631 , H04N21/42203 , H04N21/4223 , H04N21/441 , H04N21/44218 , H04N21/4532 , H04N21/4661 , H04N21/4667 , H04N21/4668
摘要: A system and method are disclosed for delivering content customized to the specific user or users interacting with the system. The system includes one or more modules for recognizing an identity of a user. These modules may include for example a gesture recognition engine, a facial recognition engine, a body language recognition engine and a voice recognition engine. The user may also be carrying a mobile device such as a smart phone which identifies the user. One or more of these modules may cooperate to identify a user, and then customize the user's content based on the user's identity. In particular, the system receives user preferences indicating the content a user wishes to receive and the conditions under which it is to be received. Based on the user preferences and recognition of a user identity and/or other traits, the system presents content customized for a particular user.
摘要翻译: 公开了一种系统和方法,用于递送针对特定用户定制的内容或与系统交互的用户。 该系统包括用于识别用户身份的一个或多个模块。 这些模块可以包括例如手势识别引擎,面部识别引擎,身体语言识别引擎和语音识别引擎。 用户还可以携带识别用户的诸如智能电话的移动设备。 这些模块中的一个或多个可以协作以识别用户,然后基于用户的身份来定制用户的内容。 特别地,系统接收用户偏好,指示用户希望接收的内容以及要接收的内容。 基于用户偏好和用户身份和/或其他特征的识别,系统呈现针对特定用户定制的内容。
-
公开(公告)号:US09229231B2
公开(公告)日:2016-01-05
申请号:US13346674
申请日:2012-01-09
CPC分类号: G02B27/017 , G02B2027/0138 , G02B2027/014 , G06F3/013 , G06F3/017 , G06F3/0483 , G06F3/167 , G10L2015/228
摘要: The technology provides for updating printed content with personalized virtual data using a see-through, near-eye, mixed reality display device system. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. Virtual data is selected from available virtual data for the printed content selection based on user profile data, and the display device system displays the selected virtual data in a position registered to the position of the printed content selection. In some examples, a task related to the printed content item is determined based on physical action user input, and personalized virtual data is displayed registered to the printed content item in accordance with the task.
摘要翻译: 该技术提供使用透视,近眼,混合的现实显示设备系统来更新具有个性化虚拟数据的打印内容。 从显示装置上的照相机拍摄的图像数据识别出打印的内容项目,例如书籍或杂志,并且基于物理动作用户输入来识别打印内容项目内的打印内容选择的用户选择,例如眼睛 注视或手势。 基于用户简档数据从打印内容选择的可用虚拟数据中选择虚拟数据,并且显示设备系统将所选择的虚拟数据显示在登记在打印内容选择位置的位置。 在一些示例中,基于物理动作用户输入确定与打印的内容项相关的任务,并且根据任务将个性化虚拟数据显示登记到打印内容项。
-
-
-
-
-
-
-
-
-