公开(公告)号：US20120093320A1

公开(公告)日：2012-04-19

申请号：US12903610

申请日：2010-10-13

申请人： Jason Flaks ,  Avi Bar-Zeev ,  John Tardif

发明人： Jason Flaks ,  Avi Bar-Zeev ,  John Tardif

IPC分类号： H04R5/00

CPC分类号： H04S7/304 ,  A63F13/213 ,  A63F13/54 ,  A63F2300/1012 ,  A63F2300/6081 ,  H04R27/00 ,  H04R2227/003 ,  H04S7/301 ,  H04S2400/11 ,  H04S2420/01

摘要： Techniques are provided for providing 3D audio, which may be used in augmented reality. A 3D audio signal may be generated based on sensor data collected from the actual room in which the listener is located and the actual position of the listener in the room. The 3D audio signal may include a number of components that are determined based on the collected sensor data and the listener's location. For example, a number of (virtual) sound paths between a virtual sound source and the listener may be determined The sensor data may be used to estimate materials in the room, such that the affect that those materials would have on sound as it travels along the paths can be determined In some embodiments, sensor data may be used to collect physical characteristics of the listener such that a suitable HRTF may be determined from a library of HRTFs.

摘要翻译： 提供了用于提供3D音频的技术，其可以用于增强现实。 可以基于从听众所在的实际房间收集的传感器数据和在房间中的听众的实际位置来生成3D音频信号。 3D音频信号可以包括基于收集的传感器数据和收听者的位置确定的多个组件。 例如，可以确定虚拟声源和收听者之间的多个（虚拟）声音路径。传感器数据可以用于估计房间中的材料，使得这些材料在行进时对声音的影响 可以确定路径。在一些实施例中，可以使用传感器数据来收集听众的物理特征，使得可以从HRTF库确定合适的HRTF。

公开(公告)号：US20120092328A1

公开(公告)日：2012-04-19

申请号：US12905952

申请日：2010-10-15

申请人： Jason Flaks ,  Avi Bar-Zeev ,  Jeffrey Neil Margolis ,  Chris Miles ,  Alex Aben-Athar Kipman ,  Andrew John Fuller ,  Bob Crocco, JR.

发明人： Jason Flaks ,  Avi Bar-Zeev ,  Jeffrey Neil Margolis ,  Chris Miles ,  Alex Aben-Athar Kipman ,  Andrew John Fuller ,  Bob Crocco, JR.

IPC分类号： G06T15/00

CPC分类号： G02B27/017 ,  G02B2027/0127 ,  G02B2027/014 ,  G06F3/005 ,  G06F3/012 ,  G06K9/00664 ,  G06T19/006

摘要： A system that includes a head mounted display device and a processing unit connected to the head mounted display device is used to fuse virtual content into real content. In one embodiment, the processing unit is in communication with a hub computing device. The system creates a volumetric model of a space, segments the model into objects, identifies one or more of the objects including a first object, and displays a virtual image over the first object on a display (of the head mounted display) that allows actual direct viewing of at least a portion of the space through the display.

摘要翻译： 使用包括头戴式显示装置和连接到头戴式显示装置的处理单元的系统将虚拟内容融合成实际内容。 在一个实施例中，处理单元与集线器计算设备通信。 该系统创建空间的体积模型，将模型分成对象，识别包括第一对象的一个​​或多个对象，并且在显示器（头戴式显示器）上的第一对象上显示虚拟图像，其允许实际 通过显示器直接观看空间的至少一部分。

公开(公告)号：US20100245376A1

公开(公告)日：2010-09-30

申请号：US12416035

申请日：2009-03-31

申请人： Avi Bar-Zeev ,  Blaise H. Aguera y Arcas ,  Eyal Ofek ,  Stephen L. Lawler ,  Pasquale DeMaio

发明人： Avi Bar-Zeev ,  Blaise H. Aguera y Arcas ,  Eyal Ofek ,  Stephen L. Lawler ,  Pasquale DeMaio

IPC分类号： G09G5/02 ,  G06T1/00

CPC分类号： G06T19/20 ,  G06T2219/2012 ,  G06T2219/2016 ,  G06T2219/2021 ,  G06T2219/2024

摘要： The claimed subject matter provides a system and/or a method that facilitates displaying virtual content within a virtual environment. A virtual environment can enable at least one user to connect in order to interact with a portion of virtual content. A collection of virtual content can be viewed from a user connected to and being present within the virtual environment. A filter component that can automatically adjust a displayable feature of a portion of the collection of virtual content based upon a relevancy to an index, wherein the adjustment of the displayable features provides at least one of an emphasis of the portion of the collection of virtual content or a de-emphasis of the portion of the collection of the virtual content.

摘要翻译： 所要求保护的主题提供了有助于在虚拟环境中显示虚拟内容的系统和/或方法。 虚拟环境可以使至少一个用户连接以便与一部分虚拟内容交互。 可以从连接到虚拟环境中并且存在于虚拟环境中的用户查看虚拟内容的集合。 一种过滤器组件，其可以基于与索引的相关性来自动调整所述虚拟内容集合的一部分的可显示特征，其中所述可显示特征的调整提供所述虚拟内容的所述部分集合中的至少一个 或虚拟内容的收集部分的去加重。

公开(公告)号：US09116220B2

公开(公告)日：2015-08-25

申请号：US12979140

申请日：2010-12-27

申请人： Shao Liu ,  Mark Finocchio ,  Avi Bar-Zeev ,  Jeffrey Margolis ,  Jason Flaks ,  Robert Crocco, Jr. ,  Alex Aben-Athar Kipman

发明人： Shao Liu ,  Mark Finocchio ,  Avi Bar-Zeev ,  Jeffrey Margolis ,  Jason Flaks ,  Robert Crocco, Jr. ,  Alex Aben-Athar Kipman

IPC分类号： H04J3/16 ,  G01S5/00 ,  G01S19/03 ,  A63F13/20 ,  A63F13/30 ,  G01D21/00 ,  G06F3/01 ,  G06F3/03 ,  G06F3/038 ,  H04J3/06 ,  H04W84/18

CPC分类号： G01S19/03 ,  A63F13/06 ,  A63F13/12 ,  A63F2300/10 ,  G01D21/00 ,  G01S5/0018 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/038 ,  H04J3/0667 ,  H04W84/18

摘要： Techniques are provided for synchronization of sensor signals between devices. One or more of the devices may collect sensor data. The device may create a sensor signal from the sensor data, which it may make available to other devices upon a publisher/subscriber model. The other devices may subscribe to sensor signals they choose. A device could be a provider or a consumer of the sensor signals. A device may have a layer of code between an operating system and software applications that processes the data for the applications. The processing may include such actions as synchronizing the data in a sensor signal to a local time clock, predicting future values for data in a sensor signal, and providing data samples for a sensor signal at a frequency that an application requests, among other actions.

摘要翻译： 提供技术用于设备之间的传感器信号的同步。 一个或多个设备可以收集传感器数据。 该设备可以从传感器数据创建传感器信号，这可以在发布者/订户模型上可用于其他设备。 其他设备可以订阅他们选择的传感器信号。 设备可以是传感器信号的提供者或消费者。 设备可以在处理用于应用的数据的操作系统和软件应用之间具有代码层。 处理可以包括将传感器信号中的数据同步到本地时钟的动作，预测传感器信号中的数据的未来值，以及提供应用请求的频率的传感器信号的数据采样以及其他动作。

公开(公告)号：US08941559B2

公开(公告)日：2015-01-27

申请号：US12887426

申请日：2010-09-21

申请人： Avi Bar-Zeev ,  Bob Crocco ,  Alex Aben-Athar Kipman ,  John Lewis

发明人： Avi Bar-Zeev ,  Bob Crocco ,  Alex Aben-Athar Kipman ,  John Lewis

IPC分类号： G09C5/00 ,  G06F3/038 ,  G06G5/00 ,  G02B27/14 ,  G02B26/02 ,  G02B27/01

CPC分类号： G06T19/006 ,  G02B26/026 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0118 ,  G02B2027/0178 ,  G02B2027/0187

摘要： An optical see-through head-mounted display device includes a see-through lens which combines an augmented reality image with light from a real-world scene, while an opacity filter is used to selectively block portions of the real-world scene so that the augmented reality image appears more distinctly. The opacity filter can be a see-through LCD panel, for instance, where each pixel of the LCD panel can be selectively controlled to be transmissive or opaque, based on a size, shape and position of the augmented reality image. Eye tracking can be used to adjust the position of the augmented reality image and the opaque pixels. Peripheral regions of the opacity filter, which are not behind the augmented reality image, can be activated to provide a peripheral cue or a representation of the augmented reality image. In another aspect, opaque pixels are provided at a time when an augmented reality image is not present.

摘要翻译： 光学透视头戴显示装置包括透视透镜，其将增强现实图像与来自真实世界场景的光组合，而不透明度滤光器用于选择性地阻挡现实世界场景的部分，使得 增强的现实形象更加明显。 不透明度滤光器可以是透视式LCD面板，例如，基于增强现实图像的尺寸，形状和位置，可以将LCD面板的每个像素选择性地控制为透射或不透明。 眼睛跟踪可用于调整增强现实图像和不透明像素的位置。 可以激活不在增强现实图像后面的不透明度滤光器的外围区域，以提供增强现实图像的外围提示或表示。 在另一方面，在增强现实图像不存在的时候提供不透明像素。

公开(公告)号：US08928659B2

公开(公告)日：2015-01-06

申请号：US12821249

申请日：2010-06-23

申请人： Avi Bar-Zeev ,  Christian F. Huitema ,  Alex Aben-Athar Kipman ,  Robert L. Crocco, Jr. ,  John Allen Tardif ,  Eric G. Lang

发明人： Avi Bar-Zeev ,  Christian F. Huitema ,  Alex Aben-Athar Kipman ,  Robert L. Crocco, Jr. ,  John Allen Tardif ,  Eric G. Lang

IPC分类号： G06T17/00 ,  G06F3/033 ,  G09G5/08 ,  G06T15/20 ,  H04N7/14 ,  G06F3/14

CPC分类号： G06T15/20 ,  G06F3/1454 ,  G09G2354/00 ,  H04N7/144

摘要： Described herein is a telepresence system where a real-time a virtual hologram of a user is displayed at a remote display screen and is rendered from a vantage point that is different than the vantage point from which images of the user are captured via a video camera. The virtual hologram is based at least in part upon data acquired from a sensor unit at the location of the user. The sensor unit includes a color video camera that captures 2-D images of the user including surface features of the user. The sensor unit also includes a depth sensor that captures 3-D geometry data indicative of the relative position of surfaces on the user in 3-D space. The virtual hologram is rendered to orientate the gaze of the eyes of the virtual hologram towards the eyes of a second user viewing the remote display screen.

摘要翻译： 这里描述了一种远程呈现系统，其中实时的用户的虚拟全息图被显示在远程显示屏幕处，并且是从与用户的图像经由摄像机捕获的有利位置不同的有利点呈现的 。 虚拟全息图至少部分地基于从用户位置处的传感器单元获取的数据。 传感器单元包括彩色摄像机，其捕获用户的2D图像，包括用户的表面特征。 传感器单元还包括深度传感器，其捕获指示用户在3D空间中的表面的相对位置的三维几何数据。 渲染虚拟全息图以将虚拟全息图的眼睛的视线朝向观看远程显示屏幕的第二用户的眼睛定向。

公开(公告)号：US20130103715A1

公开(公告)日：2013-04-25

申请号：US13279245

申请日：2011-10-21

申请人： Brian Beckman ,  Elad Gerson ,  Gur Kimchi ,  Avi Bar-Zeev ,  Selvi Chenai ,  Henricus Johannes Maria Meijer

发明人： Brian Beckman ,  Elad Gerson ,  Gur Kimchi ,  Avi Bar-Zeev ,  Selvi Chenai ,  Henricus Johannes Maria Meijer

IPC分类号： G06F17/30

CPC分类号： H04L67/02 ,  G06F9/4488 ,  G06F9/547 ,  G06F17/30498 ,  G06F17/30513 ,  H04L67/42

摘要： Embodiments enable the evaluation of injected queries within a monad. One or more operators with closures are received from a first process. The operators with closures represent one or more functions to be applied by a second process. The second process evaluates the received operators with closures to apply the functions within the monad. During evaluation, the second process converts the closures to simply typed closures. Further, the second process binds the converted closures within the monad to restrict execution of the functions. In some embodiments, the queries (e.g., sequences of one or more operators with closures) are composed using a set of query operators from the language integrated query (LINQ) framework encoded in uniform resource locators (URLs) in the representational state transfer (REST) style.

公开(公告)号：US20130013811A1

公开(公告)日：2013-01-10

申请号：US13618852

申请日：2012-09-14

申请人： Shao Liu ,  Avi Bar-Zeev ,  Alex Aben-Athar Kipman

发明人： Shao Liu ,  Avi Bar-Zeev ,  Alex Aben-Athar Kipman

IPC分类号： G06F15/16

CPC分类号： H04L69/02 ,  G06F1/12 ,  G06F1/14 ,  H04J3/0667 ,  H04L69/28

摘要： Technology is provided for synchronization of clock information between networked devices. One or more of the devices may include one or more applications needed access to data and a common time reference between devices. In one embodiment, the devices have applications utilizing data shared in a network environment with other devices, as well as having a reference to a local clock signal on each device. A device may have a layer of code between the operating system and software applications that processes the data and maintains a remote clock reference for one or more of the other devices on the network.

摘要翻译： 提供技术用于在网络设备之间同步时钟信息。 一个或多个设备可以包括需要对数据的访问的一个或多个应用以及设备之间的公共时间参考。 在一个实施例中，这些设备具有使用在网络环境中与其他设备共享的数据的应用，并且具有对每个设备上的本地时钟信号的引用。 设备可以在处理数据的操作系统和软件应用之间具有代码层，并且维护网络上的一个或多个其他设备的远程时钟参考。

公开(公告)号：US20120213212A1

公开(公告)日：2012-08-23

申请号：US13031033

申请日：2011-02-18

申请人： Richard Moore ,  Avi Bar-Zeev ,  Alex Aben-Athar Kipman ,  Andrew John Fuller ,  Rudy Jacobus Poot ,  Kathryn Stone Perez

发明人： Richard Moore ,  Avi Bar-Zeev ,  Alex Aben-Athar Kipman ,  Andrew John Fuller ,  Rudy Jacobus Poot ,  Kathryn Stone Perez

IPC分类号： H04W84/12 ,  H04N7/025 ,  H04N9/80

CPC分类号： H04N21/2187 ,  H04N5/77 ,  H04N9/8227 ,  H04N21/2743 ,  H04N21/42203 ,  H04N21/4223 ,  H04N21/4334 ,  H04N21/4788

摘要： A system and method for analyzing, summarizing, and transmitting life experiences captured using a life recorder is described. A life recorder is a recording device that continuously captures life experiences, including unanticipated life experiences, in video and/or audio recordings. In some embodiments, the video and/or audio recordings generated by a life recorder are automatically summarized, indexed, and stored for future use. By indexing and storing life recordings, a life recorder may search for and acquire life recordings generated by itself or another life recorder, thereby allowing life experiences to be shared minutes or even years later. In some embodiments, recordings generated by a life recorder may be analyzed in real-time and automatically pushed to one or more target devices. The ability to automatically and instantaneously push life recordings as live feeds to one or more target devices allows friends and family to experience one's life experience in real-time.

摘要翻译： 描述了一种用于分析，总结和传送使用生命记录器捕获的生活体验的系统和方法。 生命记录器是一种记录设备，可以在视频和/或录音中不断捕获生活体验，包括意外的生活体验。 在一些实施例中，由生命记录器生成的视频和/或音频记录被自动地汇总，索引并存储以备将来使用。 通过索引和存储生命记录，生命记录器可以搜索和获取自身或其他生命记录器生成的生命记录，从而允许在几分钟甚至几年之后共享生活体验。 在一些实施例中，寿命记录仪产生的记录可以被实时分析并自动推送到一个或多个目标设备。 将生活记录自动和即时推送到一个或多个目标设备的实时信息的能力允许朋友和家人实时体验自己的生活体验。

公开(公告)号：US20120159527A1

公开(公告)日：2012-06-21

申请号：US12970855

申请日：2010-12-16

申请人： Kathryn Stone Perez ,  Avi Bar-Zeev

发明人： Kathryn Stone Perez ,  Avi Bar-Zeev

IPC分类号： H04H60/33 ,  H04N7/173

CPC分类号： H04N21/42203 ,  H04N21/4223 ,  H04N21/4334 ,  H04N21/44218 ,  H04N21/8549

摘要： A method and system for generating time synchronized data streams based on a viewer's interaction with a multimedia content stream is provided. A viewer's interactions with a multimedia content stream being viewed by the viewer are recorded. The viewer's interactions include comments provided by the viewer, while viewing the multimedia content stream. Comments include text messages, audio messages, video feeds, gestures or facial expressions provided by the viewer. A time synchronized commented data stream is generated based on the viewer's interactions. The time synchronized commented data stream includes the viewer's interactions time stamped relative to a virtual start time at which the multimedia content stream is rendered to the viewer. One or more time synchronized data streams are rendered to the viewer, via an audiovisual device, while the viewer views a multimedia content stream.

摘要翻译： 提供了一种用于基于观看者与多媒体内容流的交互来生成时间同步数据流的方法和系统。 记录观众与观看者正在观看的多媒体内容流的相互作用。 观看者的互动包括观看者提供的评论，同时观看多媒体内容流。 评论包括观众提供的短信，音频消息，视频馈送，手势或面部表情。 基于观众的相互作用生成时间同步的注释数据流。 时间同步的注释数据流包括相对于将多媒体内容流呈现给观看者的虚拟开始时间标记的观看者的交互。 当观看者观看多媒体内容流时，一个或多个时间同步的数据流经由视听设备被呈现给观看者。