-
公开(公告)号:US20110316853A1
公开(公告)日:2011-12-29
申请号:US12821249
申请日:2010-06-23
申请人: Avi Bar-Zeev , Christian F. Huitema , Alex Aben-Athar Kipman , Robert L. Crocco, JR. , John Allen Tardif , Eric G. Lang
发明人: Avi Bar-Zeev , Christian F. Huitema , Alex Aben-Athar Kipman , Robert L. Crocco, JR. , John Allen Tardif , Eric G. Lang
CPC分类号: G06T15/20 , G06F3/1454 , G09G2354/00 , H04N7/144
摘要: Described herein is a telepresence system where a real-time a virtual hologram of a user is displayed at a remote display screen and is rendered from a vantage point that is different than the vantage point from which images of the user are captured via a video camera. The virtual hologram is based at least in part upon data acquired from a sensor unit at the location of the user. The sensor unit includes a color video camera that captures 2-D images of the user including surface features of the user. The sensor unit also includes a depth sensor that captures 3-D geometry data indicative of the relative position of surfaces on the user in 3-D space. The virtual hologram is rendered to orientate the gaze of the eyes of the virtual hologram towards the eyes of a second user viewing the remote display screen.
摘要翻译: 这里描述了一种远程呈现系统,其中实时的用户的虚拟全息图被显示在远程显示屏幕处,并且是从与用户的图像经由摄像机捕获的有利位置不同的有利点呈现的 。 虚拟全息图至少部分地基于从用户位置处的传感器单元获取的数据。 传感器单元包括彩色摄像机,其捕获用户的2D图像,包括用户的表面特征。 传感器单元还包括深度传感器,其捕获指示用户在3D空间中的表面的相对位置的三维几何数据。 渲染虚拟全息图以将虚拟全息图的眼睛的视线朝向观看远程显示屏幕的第二用户的眼睛定向。
-
公开(公告)号:US08928659B2
公开(公告)日:2015-01-06
申请号:US12821249
申请日:2010-06-23
申请人: Avi Bar-Zeev , Christian F. Huitema , Alex Aben-Athar Kipman , Robert L. Crocco, Jr. , John Allen Tardif , Eric G. Lang
发明人: Avi Bar-Zeev , Christian F. Huitema , Alex Aben-Athar Kipman , Robert L. Crocco, Jr. , John Allen Tardif , Eric G. Lang
CPC分类号: G06T15/20 , G06F3/1454 , G09G2354/00 , H04N7/144
摘要: Described herein is a telepresence system where a real-time a virtual hologram of a user is displayed at a remote display screen and is rendered from a vantage point that is different than the vantage point from which images of the user are captured via a video camera. The virtual hologram is based at least in part upon data acquired from a sensor unit at the location of the user. The sensor unit includes a color video camera that captures 2-D images of the user including surface features of the user. The sensor unit also includes a depth sensor that captures 3-D geometry data indicative of the relative position of surfaces on the user in 3-D space. The virtual hologram is rendered to orientate the gaze of the eyes of the virtual hologram towards the eyes of a second user viewing the remote display screen.
摘要翻译: 这里描述了一种远程呈现系统,其中实时的用户的虚拟全息图被显示在远程显示屏幕处,并且是从与用户的图像经由摄像机捕获的有利位置不同的有利点呈现的 。 虚拟全息图至少部分地基于从用户位置处的传感器单元获取的数据。 传感器单元包括彩色摄像机,其捕获用户的2D图像,包括用户的表面特征。 传感器单元还包括深度传感器,其捕获指示用户在3D空间中的表面的相对位置的三维几何数据。 渲染虚拟全息图以将虚拟全息图的眼睛的视线朝向观看远程显示屏幕的第二用户的眼睛定向。
-
公开(公告)号:US20140368534A1
公开(公告)日:2014-12-18
申请号:US13921113
申请日:2013-06-18
申请人: Tom G. Salter , Ben J. Sugden , Daniel Deptford , Robert L. Crocco, JR. , Brian E. Keane , Laura K. Massey , Alex Aben-Athar Kipman , Peter Tobias Kinnebrew , Nicholas Ferianc Kamuda
发明人: Tom G. Salter , Ben J. Sugden , Daniel Deptford , Robert L. Crocco, JR. , Brian E. Keane , Laura K. Massey , Alex Aben-Athar Kipman , Peter Tobias Kinnebrew , Nicholas Ferianc Kamuda
IPC分类号: G02B27/01
CPC分类号: G02B27/017 , G06F3/011 , G06F3/012 , G06F3/017 , G06T19/006 , G06T2215/16 , G06T2219/024 , G09G2354/00
摘要: A see through head mounted display apparatus includes code performing a method of choosing and optimal viewing location and perspective for shared-view virtual objects rendered for multiple users in a common environment. Multiple objects and multiple users are taken into account in determining the optimal, common viewing location. The technology allows each user to have a common view if the relative position of the object in the environment.
摘要翻译: 透视头戴式显示装置包括执行在公共环境中为多个用户呈现的共享视图虚拟对象选择和优化观看位置和透视图的代码的代码。 在确定最佳的常见观看位置时,会考虑多个对象和多个用户。 如果对象在环境中的相对位置,则该技术允许每个用户具有共同的视图。
-
公开(公告)号:US20140347391A1
公开(公告)日:2014-11-27
申请号:US13901342
申请日:2013-05-23
申请人: Brian E. Keane , Ben J. Sugden , Robert L. Crocco, JR. , Daniel Deptford , Tom G. Salter , Laura K. Massey , Alex Aben-Athar Kipman , Peter Tobias Kinnebrew , Nicholas Ferianc Kamuda
发明人: Brian E. Keane , Ben J. Sugden , Robert L. Crocco, JR. , Daniel Deptford , Tom G. Salter , Laura K. Massey , Alex Aben-Athar Kipman , Peter Tobias Kinnebrew , Nicholas Ferianc Kamuda
IPC分类号: G06T19/00
CPC分类号: G06T19/006 , G06F3/011 , G06F3/04815 , G06F3/0487
摘要: A system and method are disclosed for displaying virtual objects in a mixed reality environment in a way that is optimal and most comfortable for a user to interact with the virtual objects. When a user is moving through the mixed reality environment, the virtual objects may remain world-locked, so that the user can move around and explore the virtual objects from different perspectives. When the user is motionless in the mixed reality environment, the virtual objects may rotate to face the user so that the user can easily view and interact with the virtual objects.
摘要翻译: 公开了一种系统和方法,用于以混合现实环境中的虚拟对象以对于用户与虚拟对象交互是最佳和最舒适的方式来显示虚拟对象。 当用户移动通过混合现实环境时,虚拟对象可能保持世界锁定,从而用户可以从不同的角度移动并探索虚拟对象。 当用户在混合现实环境中静止时,虚拟对象可以旋转以面对用户,使得用户可以容易地查看虚拟对象并与虚拟对象交互。
-
公开(公告)号:US20140368537A1
公开(公告)日:2014-12-18
申请号:US13921122
申请日:2013-06-18
申请人: Tom G. Salter , Ben J. Sugden , Daniel Deptford , Robert L. Crocco, JR. , Brian E. Keane , Laura K. Massey , Alex Aben-Athar Kipman , Peter Tobias Kinnebrew , Nicholas Ferianc Kamuda
发明人: Tom G. Salter , Ben J. Sugden , Daniel Deptford , Robert L. Crocco, JR. , Brian E. Keane , Laura K. Massey , Alex Aben-Athar Kipman , Peter Tobias Kinnebrew , Nicholas Ferianc Kamuda
IPC分类号: G06T19/00
CPC分类号: G06T19/006 , G02B27/017 , G02B2027/014 , G06F3/011
摘要: A system and method are disclosed for displaying virtual objects in a mixed reality environment including shared virtual objects and private virtual objects. Multiple users can collaborate together in interacting with the shared virtual objects. A private virtual object may be visible to a single user. In examples, private virtual objects of respective users may facilitate the users' collaborative interaction with one or more shared virtual objects.
摘要翻译: 公开了一种用于在包括共享虚拟对象和私有虚拟对象的混合现实环境中显示虚拟对象的系统和方法。 多个用户可以协同工作,与共享的虚拟对象进行交互。 私人虚拟对象可能对单个用户可见。 在示例中,各个用户的私有虚拟对象可以促进用户与一个或多个共享虚拟对象的协作交互。
-
公开(公告)号:US20150310665A1
公开(公告)日:2015-10-29
申请号:US14264534
申请日:2014-04-29
申请人: Ashraf Ayman Michail , Roger Sebastian Kevin Sylvan , Quentin Simon Charles Miller , Alex Aben-Athar Kipman
发明人: Ashraf Ayman Michail , Roger Sebastian Kevin Sylvan , Quentin Simon Charles Miller , Alex Aben-Athar Kipman
CPC分类号: G06T19/006 , G02B27/0093 , G02B27/0172 , G02B27/0179 , G02B2027/0134 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/0346 , G06F3/147 , G06K9/00604 , G06K9/00671 , G06T7/536 , G06T19/20 , G06T2207/20228 , G06T2207/30201 , G09G3/3266 , G09G5/346 , G09G2310/0235 , G09G2320/0261 , G09G2320/106
摘要: Embodiments are described herein for determining a stabilization plane to reduce errors that occur when a homographic transformation is applied to a scene including 3D geometry and/or multiple non-coplanar planes. Such embodiments can be used, e.g., when displaying an image on a head mounted display (HMD) device, but are not limited thereto. In an embodiment, a rendered image is generated, a gaze location of a user is determined, and a stabilization plane, associated with a homographic transformation, is determined based on the determined gaze location. This can involve determining, based on the user's gaze location, variables of the homographic transformation that define the stabilization plane. The homographic transformation is applied to the rendered image to thereby generate an updated image, and at least a portion of the updated image is then displayed.
摘要翻译: 本文描述了用于确定稳定平面以减少当将单色变换应用于包括3D几何和/或多个非共面的场景的场景时发生的误差的实施例。 这样的实施例可以用于例如在头戴式显示器(HMD)装置上显示图像时,但不限于此。 在一个实施例中,生成渲染图像,确定用户的注视位置,并且基于所确定的凝视位置来确定与同形变换相关联的稳定平面。 这可以涉及基于用户的注视位置确定定义稳定平面的同形变换的变量。 将同形变换应用于渲染图像,从而生成更新的图像,然后显示更新的图像的至少一部分。
-
公开(公告)号:US20150193984A1
公开(公告)日:2015-07-09
申请号:US14605701
申请日:2015-01-26
申请人: Avi Bar-Zeev , Bob Crocco , Alex Aben-Athar Kipman , John Lewis
发明人: Avi Bar-Zeev , Bob Crocco , Alex Aben-Athar Kipman , John Lewis
CPC分类号: G06T19/006 , G02B26/026 , G02B27/017 , G02B27/0172 , G02B2027/0118 , G02B2027/0178 , G02B2027/0187
摘要: An optical see-through head-mounted display device includes a see-through lens which combines an augmented reality image with light from a real-world scene, while an opacity filter is used to selectively block portions of the real-world scene so that the augmented reality image appears more distinctly. The opacity filter can be a see-through LCD panel, for instance, where each pixel of the LCD panel can be selectively controlled to be transmissive or opaque, based on a size, shape and position of the augmented reality image. Eye tracking can be used to adjust the position of the augmented reality image and the opaque pixels. Peripheral regions of the opacity filter, which are not behind the augmented reality image, can be activated to provide a peripheral cue or a representation of the augmented reality image. In another aspect, opaque pixels are provided at a time when an augmented reality image is not present.
摘要翻译: 光学透视头戴显示装置包括透视透镜,其将增强现实图像与来自真实世界场景的光组合,而不透明度滤光器用于选择性地阻挡现实世界场景的部分,使得 增强的现实形象更加明显。 不透明度滤光器可以是透视式LCD面板,例如,基于增强现实图像的尺寸,形状和位置,可以将LCD面板的每个像素选择性地控制为透射或不透明。 眼睛跟踪可用于调整增强现实图像和不透明像素的位置。 可以激活不在增强现实图像后面的不透明度滤光器的外围区域,以提供增强现实图像的外围提示或表示。 在另一方面,在增强现实图像不存在的时候提供不透明像素。
-
公开(公告)号:US08884984B2
公开(公告)日:2014-11-11
申请号:US12905952
申请日:2010-10-15
申请人: Jason Flaks , Avi Bar-Zeev , Jeffrey Neil Margolis , Chris Miles , Alex Aben-Athar Kipman , Andrew John Fuller , Bob Crocco, Jr.
发明人: Jason Flaks , Avi Bar-Zeev , Jeffrey Neil Margolis , Chris Miles , Alex Aben-Athar Kipman , Andrew John Fuller , Bob Crocco, Jr.
CPC分类号: G02B27/017 , G02B2027/0127 , G02B2027/014 , G06F3/005 , G06F3/012 , G06K9/00664 , G06T19/006
摘要: A system that includes a head mounted display device and a processing unit connected to the head mounted display device is used to fuse virtual content into real content. In one embodiment, the processing unit is in communication with a hub computing device. The system creates a volumetric model of a space, segments the model into objects, identifies one or more of the objects including a first object, and displays a virtual image over the first object on a display (of the head mounted display) that allows actual direct viewing of at least a portion of the space through the display.
摘要翻译: 使用包括头戴式显示装置和连接到头戴式显示装置的处理单元的系统将虚拟内容融合成实际内容。 在一个实施例中,处理单元与集线器计算设备通信。 该系统创建空间的体积模型,将模型分成对象,识别包括第一对象的一个或多个对象,并且在显示器(头戴式显示器)上的第一对象上显示虚拟图像,其允许实际 通过显示器直接观看空间的至少一部分。
-
公开(公告)号:US08863028B2
公开(公告)日:2014-10-14
申请号:US12724627
申请日:2010-03-16
CPC分类号: G09G5/363 , G06F3/14 , G06T15/503 , G09G5/14 , G09G2340/10 , G09G2340/12
摘要: A motion desktop, including a moving image, may be presented on a display screen of a processing device. Foreground items such as, for example, icons and associated text, or other information, may appear on a surface of the motion desktop. In embodiments consistent with the subject matter of this disclosure, foreground content may be rendered to a composing surface, which may be an alpha-enabled surface capable of presenting translucent items. A motion desktop module may render content for at least a portion of a background of the motion desktop to a respective shared memory, shared with a composer. The composer may periodically copy the rendered content from the shared memory to the composing surface, where the composer may compose and blend a scene from background and foreground content. The composed scene may then be presented as the motion desktop.
摘要翻译: 可以在处理装置的显示屏幕上呈现包括运动图像的运动桌面。 诸如例如图标和相关联的文本或其他信息的前景项目可以出现在运动桌面的表面上。 在与本公开的主题相一致的实施例中,前景内容可以呈现到组合表面,组合表面可以是能够呈现半透明项目的能够启用Alpha的表面。 运动桌面模块可以将运动桌面的背景的至少一部分的内容呈现给与作曲者共享的相应的共享存储器。 作曲者可以定期地将所渲染的内容从共享存储器复制到编曲曲面,其中作曲者可以从背景和前景内容组合和混合场景。 然后,组合场景可以被呈现为运动桌面。
-
公开(公告)号:US20140198017A1
公开(公告)日:2014-07-17
申请号:US13740165
申请日:2013-01-12
IPC分类号: G02B27/01
CPC分类号: G02B27/017 , G01C21/206 , G02B27/0093 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06F3/012
摘要: A see through display apparatus includes a see-through, head mounted display and sensors on the display which detect audible and visual data in a field of view of the apparatus. A processor cooperates with the display to provide information to a wearer of the device using a behavior-based real object mapping system. At least a global zone and an egocentric behavioral zone relative to the apparatus are established, and real objects assigned behaviors that are mapped to the respective zones occupied by the object. The behaviors assigned to the objects can be used by applications that provide services to the wearer, using the behaviors as the foundation for evaluation of the type of feedback to provide in the apparatus.
摘要翻译: 透视显示装置包括透视式,头戴式显示器和显示器上的传感器,其检测设备的视场中的可听和可视数据。 处理器与显示器协作以使用基于行为的真实对象映射系统向设备的佩戴者提供信息。 至少建立了相对于装置的全局区域和自我中心行为区域,并且真实对象分配映射到对象占据的各个区域的行为。 分配给对象的行为可以由为佩戴者提供服务的应用程序使用,使用该行为作为在设备中提供的反馈类型的评估的基础。
-
-
-
-
-
-
-
-
-