-
公开(公告)号：US20130002813A1
公开(公告)日：2013-01-03
申请号：US13172633
申请日：2011-06-29
申请人： Benjamin I. Vaught , Alex Aben-Athar Kipman , Michael J. Scavezze , Arthur C. Tomlin , Relja Markovic , Darren Bennett , Stephen G. Latta
发明人： Benjamin I. Vaught , Alex Aben-Athar Kipman , Michael J. Scavezze , Arthur C. Tomlin , Relja Markovic , Darren Bennett , Stephen G. Latta
CPC分类号： H04N13/161 , H04N13/194 , H04N13/344 , H04N13/383 , H04N21/2187 , H04N21/274
摘要： Techniques are provided for viewing windows for video streams. A video stream from a video capture device is accessed. Data that describes movement or position of a person is accessed. A viewing window is placed in the video stream based on the data that describes movement or position of the person. The viewing window is provided to a display device in accordance with the placement of the viewing window in the video stream. Motion sensors can detect motion of the person carrying the video capture device in order to dampen the motion such that the video on the remote display does not suffer from motion artifacts. Sensors can also track the eye gaze of either the person carrying the mobile video capture device or the remote display device to enable control of the spatial region of the video stream shown at the display device.
摘要翻译： 提供技术来查看视频流的窗口。 来自视频采集设备的视频流被访问。 访问描述人的移动或位置的数据。 基于描述人的移动或位置的数据将观看窗口放置在视频流中。 根据观看窗口在视频流中的放置，将观看窗口提供给显示设备。 运动传感器可以检测携带视频捕获设备的人的运动，以便抑制运动，使得远程显示器上的视频不会受到运动伪像的影响。 传感器还可以跟踪携带移动视频捕获设备或远程显示设备的人的眼睛注视，以便能够控制显示设备上显示的视频流的空间区域。
-
公开(公告)号：US09182815B2
公开(公告)日：2015-11-10
申请号：US13313368
申请日：2011-12-07
CPC分类号： G06T19/006 , G02B27/0093 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/017 , G06K9/00671
摘要： The technology provides embodiments for making static printed content being viewed through a see-through, mixed reality display device system more dynamic with display of virtual data. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. A task in relation to the printed content selection can also be determined based on physical action user input. Virtual data for the printed content selection is displayed in accordance with the task. Additionally, virtual data can be linked to a work embodied in a printed content item. Furthermore, a virtual version of the printed material may be displayed at a more comfortable reading position and with improved visibility of the content.
摘要翻译： 该技术提供了通过具有虚拟数据的显示更动态的透明，混合现实显示设备系统来制作静态打印内容的实施例。 从显示装置上的照相机拍摄的图像数据识别出打印的内容项目，例如书籍或杂志，并且基于物理动作用户输入来识别打印内容项目内的打印内容选择的用户选择，例如眼睛 注视或手势。 关于印刷内容选择的任务也可以基于物理动作用户输入来确定。 根据任务显示打印内容选择的虚拟数据。 此外，虚拟数据可以链接到打印的内容项目中体现的作品。 此外，打印材料的虚拟版本可以以更舒适的阅读位置显示并且改善内容的可视性。
-
公开(公告)号：US09213163B2
公开(公告)日：2015-12-15
申请号：US13221662
申请日：2011-08-30
申请人： John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Kathryn Stone Perez , Alex Aben-Athar Kipman
发明人： John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Kathryn Stone Perez , Alex Aben-Athar Kipman
IPC分类号： G02B27/14 , G03H1/00 , G02F1/1335 , G03B21/26 , G09G5/00 , A61B3/14 , G02B7/12 , A61B3/113 , G02B27/01
CPC分类号： G02B7/12 , A61B3/113 , G02B27/017 , G02B2027/0127 , G02B2027/014 , G02B2027/0187
摘要： The technology provides for automatic alignment of a see-through near-eye, mixed reality device with an inter-pupillary distance (IPD). A determination is made as to whether a see-through, near-eye, mixed reality display device is aligned with an IPD of a user. If the display device is not aligned with the IPD, the display device is automatically adjusted. In some examples, the alignment determination is based on determinations of whether an optical axis of each display optical system positioned to be seen through by a respective eye is aligned with a pupil of the respective eye in accordance with an alignment criteria. The pupil alignment may be determined based on an arrangement of gaze detection elements for each display optical system including at least one sensor for capturing data of the respective eye and the captured data. The captured data may be image data, image and glint data, and glint data only.
摘要翻译： 该技术提供了透视近眼，混合现实设备与瞳孔间距离（IPD）的自动对准。 确定透视，近眼，混合现实显示设备是否与用户的IPD对准。 如果显示设备未与IPD对齐，则会自动调整显示设备。 在一些示例中，对准确定是基于根据对准标准确定位于通过各个眼睛看到的每个显示光学系统的光轴是否与各个眼睛的瞳孔对齐的确定。 可以基于每个显示光学系统的注视检测元件的布置来确定瞳孔对准，包括用于捕获各个眼睛的数据和捕获的数据的至少一个传感器。 捕获的数据可以仅是图像数据，图像和闪烁数据，以及闪烁数据。
-
公开(公告)号：US09229231B2
公开(公告)日：2016-01-05
申请号：US13346674
申请日：2012-01-09
CPC分类号： G02B27/017 , G02B2027/0138 , G02B2027/014 , G06F3/013 , G06F3/017 , G06F3/0483 , G06F3/167 , G10L2015/228
摘要： The technology provides for updating printed content with personalized virtual data using a see-through, near-eye, mixed reality display device system. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. Virtual data is selected from available virtual data for the printed content selection based on user profile data, and the display device system displays the selected virtual data in a position registered to the position of the printed content selection. In some examples, a task related to the printed content item is determined based on physical action user input, and personalized virtual data is displayed registered to the printed content item in accordance with the task.
摘要翻译： 该技术提供使用透视，近眼，混合的现实显示设备系统来更新具有个性化虚拟数据的打印内容。 从显示装置上的照相机拍摄的图像数据识别出打印的内容项目，例如书籍或杂志，并且基于物理动作用户输入来识别打印内容项目内的打印内容选择的用户选择，例如眼睛 注视或手势。 基于用户简档数据从打印内容选择的可用虚拟数据中选择虚拟数据，并且显示设备系统将所选择的虚拟数据显示在登记在打印内容选择位置的位置。 在一些示例中，基于物理动作用户输入确定与打印的内容项相关的任务，并且根据任务将个性化虚拟数据显示登记到打印内容项。
-
公开(公告)号：US09183807B2
公开(公告)日：2015-11-10
申请号：US13347576
申请日：2012-01-10
CPC分类号： G09G5/00 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/015 , G06F3/017 , G06F3/0346 , G06F3/0483 , G06F3/04842 , G06T19/006 , G09G2354/00 , G09G2380/14
摘要： The technology provides embodiments for displaying virtual data as printed content by a see-through, near-eye, mixed reality display device system. One or more literary content items registered to a reading object in a field of view of the display device system are displayed with print layout characteristics. Print layout characteristics from a publisher of each literary content item are selected if available. The reading object has a type like a magazine, book, journal or newspaper and may be a real object or a virtual object displayed by the display device system. The reading object type of the virtual object is based on a reading object type associated with a literary content item to be displayed. Virtual augmentation data registered to a literary content item is displayed responsive to detecting user physical action in image data. An example of a physical action is a page flipping gesture.
摘要翻译： 该技术提供了通过透视，近眼，混合现实显示设备系统将虚拟数据显示为打印内容的实施例。 在显示装置系统的视野中登记到读取对象的一个或多个文学内容项以打印布局特征显示。 选择每个文学内容项目的发布者的打印布局特征（如果可用）。 读取对象具有类似于杂志，书籍，日记或报纸的类型，并且可以是由显示设备系统显示的真实对象或虚拟对象。 虚拟对象的读取对象类型基于与要显示的文学内容项相关联的读取对象类型。 响应于检测到图像数据中的用户身体动作，显示登记到文学内容项目的虚拟增强数据。 物理动作的一个例子是翻页手势。
-
公开(公告)号：US20130050642A1
公开(公告)日：2013-02-28
申请号：US13221662
申请日：2011-08-30
申请人： John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Kathryn Stone Perez , Alex Aben-Athar Kipman
发明人： John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Kathryn Stone Perez , Alex Aben-Athar Kipman
IPC分类号： A61B3/11
CPC分类号： G02B7/12 , A61B3/113 , G02B27/017 , G02B2027/0127 , G02B2027/014 , G02B2027/0187
摘要： The technology provides for automatic alignment of a see-through near-eye, mixed reality device with an inter-pupillary distance (IPD). A determination is made as to whether a see-through, near-eye, mixed reality display device is aligned with an IPD of a user. If the display device is not aligned with the IPD, the display device is automatically adjusted. In some examples, the alignment determination is based on determinations of whether an optical axis of each display optical system positioned to be seen through by a respective eye is aligned with a pupil of the respective eye in accordance with an alignment criteria. The pupil alignment may be determined based on an arrangement of gaze detection elements for each display optical system including at least one sensor for capturing data of the respective eye and the captured data. The captured data may be image data, image and glint data, and glint data only.
摘要翻译： 该技术提供了透视近眼，混合现实设备与瞳孔间距离（IPD）的自动对准。 确定透视，近眼，混合现实显示设备是否与用户的IPD对准。 如果显示设备未与IPD对齐，则会自动调整显示设备。 在一些示例中，对准确定是基于根据对准标准确定位于通过各个眼睛看到的每个显示光学系统的光轴是否与各个眼睛的瞳孔对齐的确定。 可以基于每个显示光学系统的注视检测元件的布置来确定瞳孔对准，包括用于捕获各个眼睛的数据和捕获的数据的至少一个传感器。 捕获的数据可以仅是图像数据，图像和闪烁数据，以及闪烁数据。
-
27.发明申请公开(公告)号：US20130286178A1
公开(公告)日：2013-10-31
申请号：US13844453
申请日：2013-03-15
申请人： John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez
发明人： John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez
IPC分类号： G06F3/01
CPC分类号： G06F3/013 , A61B3/113 , G02B27/0093 , G02B27/017 , G02B27/2228 , G02B2027/0138 , G02B2027/014 , G02B2027/0187 , G06K9/00604
摘要： The technology provides various embodiments for gaze determination within a see-through, near-eye, mixed reality display device. In some embodiments, the boundaries of a gaze detection coordinate system can be determined from a spatial relationship between a user eye and gaze detection elements such as illuminators and at least one light sensor positioned on a support structure such as an eyeglasses frame. The gaze detection coordinate system allows for determination of a gaze vector from each eye based on data representing glints on the user eye, or a combination of image and glint data. A point of gaze may be determined in a three-dimensional user field of view including real and virtual objects. The spatial relationship between the gaze detection elements and the eye may be checked and may trigger a re-calibration of training data sets if the boundaries of the gaze detection coordinate system have changed.
摘要翻译： 该技术提供了在透视，近眼，混合现实显示设备内的凝视确定的各种实施例。 在一些实施例中，可以从用户眼睛和注视检测元件（例如照明器）和位于诸如眼镜框架的支撑结构上的至少一个光传感器之间的空间关系来确定注视检测坐标系的边界。 注视检测坐标系允许基于用户眼睛上的闪烁的数据，或图像和闪光数据的组合来确定来自每只眼睛的注视矢量。 注视点可以在包括实际和虚拟对象的三维用户视野中确定。 可以检查注视检测元件和眼睛之间的空间关系，并且如果注视检测坐标系的边界已经改变，则可以触发训练数据集的重新校准。
-
公开(公告)号：US08487838B2
公开(公告)日：2013-07-16
申请号：US13221739
申请日：2011-08-30
申请人： John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez
发明人： John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez
IPC分类号： G09G5/00
CPC分类号： G06F3/013 , A61B3/113 , G02B27/0093 , G02B27/017 , G02B27/2228 , G02B2027/0138 , G02B2027/014 , G02B2027/0187 , G06K9/00604
摘要： The technology provides various embodiments for gaze determination within a see-through, near-eye, mixed reality display device. In some embodiments, the boundaries of a gaze detection coordinate system can be determined from a spatial relationship between a user eye and gaze detection elements such as illuminators and at least one light sensor positioned on a support structure such as an eyeglasses frame. The gaze detection coordinate system allows for determination of a gaze vector from each eye based on data representing glints on the user eye, or a combination of image and glint data. A point of gaze may be determined in a three-dimensional user field of view including real and virtual objects. The spatial relationship between the gaze detection elements and the eye may be checked and may trigger a re-calibration of training data sets if the boundaries of the gaze detection coordinate system have changed.
-
29.发明申请ENHANCING AN OBJECT OF INTEREST IN A SEE-THROUGH, MIXED REALITY DISPLAY DEVICE 有权在一个完美的混合现实显示设备中增强兴趣的对象公开(公告)号：US20130050432A1
公开(公告)日：2013-02-28
申请号：US13221770
申请日：2011-08-30
申请人： Kathryn Stone Perez , Benjamin I. Vaught , John R. Lewis , Robert L. Crocco , Alex Aben-Athar Kipman
发明人： Kathryn Stone Perez , Benjamin I. Vaught , John R. Lewis , Robert L. Crocco , Alex Aben-Athar Kipman
CPC分类号： G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/017 , H04N13/279 , H04N13/344 , H04N13/383
摘要： Technology is disclosed for enhancing the experience of a user wearing a see-through, near eye mixed reality display device. Based on an arrangement of gaze detection elements on each display optical system for each eye of the display device, a respective gaze vector is determined and a current user focal region is determined based on the gaze vectors. Virtual objects are displayed at their respective focal regions in a user field of view for a natural sight view. Additionally, one or more objects of interest to a user may be identified. The identification may be based on a user intent to interact with the object. For example, the intent may be determined based on a gaze duration. Augmented content may be projected over or next to an object, real or virtual. Additionally, a real or virtual object intended for interaction may be zoomed in or out.
摘要翻译： 公开了用于增强佩戴透明近眼睛混合现实显示装置的用户体验的技术。 基于在显示装置的每个眼睛的每个显示光学系统上的注视检测元件的布置，确定相应的注视向量，并且基于注视向量来确定当前用户聚焦区域。 在用户视野中的虚拟对象在其各自的焦点区域处显示，用于自然视野。 另外，可以识别用户感兴趣的一个或多个对象。 识别可以基于用户与对象交互的意图。 例如，可以基于注视持续时间来确定意图。 增强的内容可以投射在对象的真实或虚拟的上方或旁边。 另外，可以放大或缩小用于交互的实际或虚拟对象。
-
30.发明授权Enhancing an object of interest in a see-through, mixed reality display device 有权在透明，混合的现实显示设备中增强感兴趣的对象公开(公告)号：US09323325B2
公开(公告)日：2016-04-26
申请号：US13221770
申请日：2011-08-30
申请人： Kathryn Stone Perez , Benjamin I. Vaught , John R. Lewis , Robert L. Crocco , Alex Aben-Athar Kipman
发明人： Kathryn Stone Perez , Benjamin I. Vaught , John R. Lewis , Robert L. Crocco , Alex Aben-Athar Kipman
CPC分类号： G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/017 , H04N13/279 , H04N13/344 , H04N13/383
摘要： Technology is disclosed for enhancing the experience of a user wearing a see-through, near eye mixed reality display device. Based on an arrangement of gaze detection elements on each display optical system for each eye of the display device, a respective gaze vector is determined and a current user focal region is determined based on the gaze vectors. Virtual objects are displayed at their respective focal regions in a user field of view for a natural sight view. Additionally, one or more objects of interest to a user may be identified. The identification may be based on a user intent to interact with the object. For example, the intent may be determined based on a gaze duration. Augmented content may be projected over or next to an object, real or virtual. Additionally, a real or virtual object intended for interaction may be zoomed in or out.
摘要翻译： 公开了用于增强佩戴透明近眼睛混合现实显示装置的用户体验的技术。 基于在显示装置的每个眼睛的每个显示光学系统上的注视检测元件的布置，确定相应的注视向量，并且基于注视向量来确定当前用户聚焦区域。 在用户视野中的虚拟物体在其各自的焦点区域处显示，用于自然视野。 另外，可以识别用户感兴趣的一个或多个对象。 识别可以基于用户与对象交互的意图。 例如，可以基于注视持续时间来确定意图。 增强的内容可以投射在对象的真实或虚拟的上方或旁边。 另外，可以放大或缩小用于交互的实际或虚拟对象。
-
-
-
-
-
-
-
-
-
搜索结果
50 条记录 (耗时 0.071 秒)
