公开(公告)号：US20170285916A1

公开(公告)日：2017-10-05

申请号：US15085677

申请日：2016-03-30

申请人： Yan Xu ,  Maha El Choubassi ,  Ronald T. Azuma ,  Oscar Nestares

发明人： Yan Xu ,  Maha El Choubassi ,  Ronald T. Azuma ,  Oscar Nestares

IPC分类号： G06F3/0484 ,  G06T11/00 ,  G06T7/00 ,  G06T3/00 ,  G06T5/00

CPC分类号： G06F3/04845 ,  G06F3/04842 ,  G06F3/04883 ,  G06T11/60 ,  G06T2200/04 ,  H04N5/2226 ,  H04N5/2621 ,  H04N5/272 ,  H04N5/445

摘要： Embodiments of a system and method for applying camera effects to an image are generally described herein. A method may include receiving, at a device, information including an image and depth data of pixels of the image, generating a set of candidate regions of interest in the image, receiving a user selection of a region of interest of the set of candidate regions of interest, and generating a camera effect for the image using the region of interest and the depth data. The method may include outputting an augmented image, outputting information, outputting a video, or the like.

公开(公告)号：US07796155B1

公开(公告)日：2010-09-14

申请号：US11019991

申请日：2004-12-20

申请人： Howard Neely, III ,  Ronald T. Azuma ,  Jerry Isdale ,  Mike Daily

发明人： Howard Neely, III ,  Ronald T. Azuma ,  Jerry Isdale ,  Mike Daily

IPC分类号： G06F17/00 ,  G06T1/00 ,  G06T15/00 ,  G06T17/00

CPC分类号： G06K9/00771 ,  A63F2300/636 ,  A63F2300/69 ,  A63F2300/8011 ,  G06T19/006 ,  G06T2219/024

摘要： A real-time, group interactive, augmented-reality system for monitoring an area, suitable for enhancing the enjoyment of entertainment events, is presented. The system comprises a sensor data acquisition system for receiving sensor data, in real-time, from a plurality of data acquisition sensors disposed about an area to be monitored, and a plurality of display centers communicatively coupled with the data acquisition system for receiving sensor data therefrom. A display center includes an user input, a data acquisition sensor selector, an interaction interface for communicating in real-time with users of other display centers, an interface for connecting a display device, and a local display device augmenting system, which are configured to allow a user to interactively augment in real-time his/her local display of events with user-inputted doodles, user requested information and statistics, and user selected viewing angles. The system allows users to interactively share the locally augmented-reality display with users of other display centers.

摘要翻译： 介绍了一个实时，集体互动，增强现实系统，用于监控一个适合于增加娱乐活动享受度的区域。 该系统包括传感器数据采集系统，用于实时地从设置在待监视区域上的多个数据采集传感器接收传感器数据，以及与数据采集系统通信耦合的多个显示中心，用于接收传感器数据 由此。 显示中心包括用户输入，数据采集传感器选择器，用于与其他显示中心的用户实时通信的交互界面，用于连接显示设备的接口和本地显示设备增强系统，其被配置为 允许用户通过用户输入的涂鸦，用户请求的信息和统计信息以及用户选择的视角来实时地实时地增加事件的本地显示。 该系统允许用户与其他显示中心的用户交互地共享本地增强现实显示。

公开(公告)号：US20100060447A1

公开(公告)日：2010-03-11

申请号：US12208694

申请日：2008-09-11

申请人： Timothy C. Clausner ,  Ronald T. Azuma

发明人： Timothy C. Clausner ,  Ronald T. Azuma

IPC分类号： G08B23/00 ,  G08B21/18

CPC分类号： G05B19/042 ,  G05B2219/24102

摘要： Methods and apparatus for generating, by a computer processor, a first status indicator and a second status indicator, generating a first attention value to indicate an amount of attention a user should devote to the first status indicator, and a second attention value to indicate an amount of attention the user should devote to the second status indicator, and outputting the first and second attention values to enable display for the user. The attention values may be generated based on reliability factors of the status indicators and on probability of failure of a control system.

摘要翻译： 用于由计算机处理器生成第一状态指示符和第二状态指示符的生成第一注意值以指示用户应该投入到第一状态指示符的注意量的方法和装置，以及指示第一注意值 用户应该注意到第二状态指示器的注意力，并输出第一和第二注意力值以使用户能够显示。 可以基于状态指示符的可靠性因素和控制系统的故障概率来生成注意力值。

公开(公告)号：US06577976B1

公开(公告)日：2003-06-10

申请号：US09397899

申请日：1999-09-17

申请人： Bruce Hoff ,  Ronald T. Azuma

发明人： Bruce Hoff ,  Ronald T. Azuma

IPC分类号： G01C1738

CPC分类号： G01C25/00 ,  G01C17/38

摘要： A method for dynamic auto-calibration of a multi-sensor tracking system and apparatus incorporating it therein are presented. The method and apparatus utilize information from complementary sensors, filtered by a simultaneously running filter that combines the sensor data into an estimate of the state of the monitored system to iteratively tune the bias estimate. To track a dynamic system, complimentary or redundant sensors may be combined with a model of the system so that the uncertainty in the estimated state of the dynamic system is less than the noise in the individual sensors. In addition to noise, the sensors may have bias, which has the same value whenever the system is in a particular state. While estimating the actual value of the state, the present invention allows the estimator to determine the bias. The present invention, in its most general embodiment requires complex computations. However, significant simplifications have also been developed, which reduce the necessary computational power to a manageable level. The present invention has been reduced to practice in the context of a head-tracking system employing a plurality of sensors to determine the orientation of a human head.

摘要翻译： 提出了一种用于动态自动校准多传感器跟踪系统的方法及其中包含的其中的装置。 该方法和装置利用来自互补传感器的信息，由同时运行的滤波器滤波，该滤波器将传感器数据组合成对所监视系统的状态的估计，以迭代地调整偏差估计。 为了跟踪动态系统，互补或冗余传感器可以与系统的模型组合，使得动态系统的估计状态的不确定性小于各个传感器中的噪声。 除了噪声之外，传感器可能具有偏置，每当系统处于特定状态时，其具有相同的值。 在估计状态的实际值的同时，本发明允许估计器确定偏差。 本发明在其最一般实施例中需要复杂的计算。 然而，也已经开发了显着的简化，其将必要的计算能力降低到可管理的水平。 本发明已经被减少到在采用多个传感器来确定人头的取向的头跟踪系统的上下文中进行实践。

公开(公告)号：US10284816B2

公开(公告)日：2019-05-07

申请号：US14665939

申请日：2015-03-23

申请人： Ronald T. Azuma

发明人： Ronald T. Azuma

IPC分类号： G06T17/20 ,  H04N7/15 ,  H04N7/14 ,  H04N13/388 ,  G02B27/22

摘要： A mechanism is described for facilitating true three-dimensional (3D) virtual imaging on computing devices. A method of embodiments, as described herein, includes computing a virtual 3D model corresponding to an object. The method may further include computing and projecting, based the virtual 3D model, a unified surface image of the object via a dynamic 3D shape component, and generating and rendering a virtual image of the object based on the unified surface image such that the virtual image is capable of floating in air.

公开(公告)号：US08335751B1

公开(公告)日：2012-12-18

申请号：US12589052

申请日：2009-10-15

申请人： Michael J. Daily ,  Deepak Khosla ,  Ronald T. Azuma

发明人： Michael J. Daily ,  Deepak Khosla ,  Ronald T. Azuma

IPC分类号： G06F15/18 ,  G06F17/00 ,  G06F17/20 ,  G06E1/00 ,  G06E3/00 ,  G06G7/00 ,  G06K9/62

CPC分类号： G06N3/0427 ,  G06K9/00973 ,  G06K9/6263 ,  G06N3/08

摘要： A system for intelligent goal-directed search in large volume visual imagery using a cognitive-neural subsystem is disclosed. The system comprises an imager, a display, a display processor, a cognitive-neural subsystem, a system controller, and operator controls. The cognitive-neural subsystem comprises a cognitive module, a neural module, and an adaptation module. The cognitive module is configured to extract a set of regions of interest from the image using a cognitive algorithm. The neural module is configured to refine the set of regions of interest using a neural processing algorithm. The adaptation module is configured to bias the cognitive algorithm with information gained from the neural module to improve future searches. The system functions in a plurality of operating modes, including: batch mode, semi-interactive mode, real-time mode, and roaming mode.

摘要翻译： 公开了一种使用认知神经子系统进行大容量视觉图像智能目标导向搜索的系统。 该系统包括成像器，显示器，显示处理器，认知神经子系统，系统控制器和操作者控制。 认知神经子系统包括认知模块，神经模块和适配模块。 认知模块被配置为使用认知算法从图像中提取一组感兴趣的区域。 神经模块被配置为使用神经处理算法来细化感兴趣区域集合。 适配模块被配置为利用从神经模块获得的信息来偏差认知算法以改进未来搜索。 该系统以多种操作模式运行，包括批量模式，半交互模式，实时模式和漫游模式。

公开(公告)号：US07120875B2

公开(公告)日：2006-10-10

申请号：US10282397

申请日：2002-10-29

申请人： Michael J. Daily ,  Ronald T. Azuma ,  Howard E. Neely, III ,  Gerald B. Isdale

发明人： Michael J. Daily ,  Ronald T. Azuma ,  Howard E. Neely, III ,  Gerald B. Isdale

IPC分类号： G06F3/00 ,  H04N5/228 ,  G06K9/00

CPC分类号： G06F3/0346 ,  G06F3/0325

摘要： An apparatus and method is disclosed for enabling accurate registration of virtual information upon real objects in selected environments from the perspective of a moveable observation platform having a position and an orientation within an observation space positioned within the environment, the position and orientation defining the registration of the virtual information within the observation space within the environment, which may comprise: a plurality of at least three tracking fiducials selectively each respectively located in fixed predetermined locations in the observation space; the observation platform including a position sensor apparatus adapted to sense an estimated position of the observation platform in the observation space and a heading sensor apparatus adapted to sense an estimated heading of the observation platform within the observation space; the observation platform further including a wide view fiducial detection apparatus mounted on the observation platform and adapted to detect the relative direction from the observation platform to each of the plurality of tracking fiducials, a heading error detection apparatus adapted to detect the difference between the estimated heading and the present heading based upon the observed relative directions to the respective tracking fiducials, and forming a corrected heading from the estimated heading and the detected heading error.

摘要翻译： 公开了一种装置和方法，用于在具有在位于环境内的观察空间内的位置和取向的可移动观察平台的视角下，在选定环境中的真实物体上精确地登记虚拟信息，该位置和取向限定了 环境内的观察空间内的虚拟信息，其可以包括：选择性地分别位于观察空间中的固定预定位置的多个至少三个跟踪基准; 所述观察平台包括适于感测所述观察平台在所述观察空间中的估计位置的位置传感器装置和适于感测所述观察平台在所述观察空间内的估计航向的航向传感器装置; 所述观察平台还包括安装在所述观察平台上的适用于检测从所述观察平台到所述多个跟踪基准中的每一个的相对方向的宽视角基准检测装置，所述方位误差检测装置适于检测所述估计方向 并且基于所观察到的相对于相应跟踪基准的相对方向，并且从估计的标题和检测到的方位误差形成校正的标题。

公开(公告)号：US08488877B1

公开(公告)日：2013-07-16

申请号：US12592836

申请日：2009-12-02

申请人： Yuri Owechko ,  Swarup Medasani ,  Ronald T. Azuma ,  Jim Nelson

发明人： Yuri Owechko ,  Swarup Medasani ,  Ronald T. Azuma ,  Jim Nelson

IPC分类号： G06K9/00

CPC分类号： G06K9/00201 ,  G06K9/00704

摘要： Described is a system for object recognition in colorized point clouds. The system includes an implicit geometry engine that is configured to receive three-dimensional (3D) colorized cloud point data regarding a 3D object of interest and to convert the cloud point data into implicit representations. The engine also generates geometric features. A geometric grammar block is included to generate object cues and recognize geometric objects using geometric tokens and grammars based on object taxonomy. A visual attention cueing block is included to generate object cues based on 3D geometric properties. Finally, an object recognition block is included to perform a local search for objects using cues from the cueing block and the geometric grammar block and to classify the 3D object of interest as a particular object upon a classifier reaching a predetermined threshold.

摘要翻译： 描述了在彩色点云中的对象识别系统。 该系统包括隐式几何引擎，其被配置为接收关于感兴趣的3D对象的三维（3D）着色浊点数据，并将该浊点数据转换为隐含表示。 引擎还生成几何特征。 包含几何语法块以生成对象提示，并使用基于对象分类法的几何令牌和语法来识别几何对象。 包括视觉注意提示块，以根据3D几何属性生成对象提示。 最后，包括对象识别块，以使用来自提示块和几何语法块的提示来执行对象的本地搜索，并且在分类器达到预定阈值时将感兴趣的3D对象分类为特定对象。

公开(公告)号：US08081088B2

公开(公告)日：2011-12-20

申请号：US12208694

申请日：2008-09-11

申请人： Timothy C. Clausner ,  Ronald T. Azuma

发明人： Timothy C. Clausner ,  Ronald T. Azuma

IPC分类号： G08B21/00

CPC分类号： G05B19/042 ,  G05B2219/24102

摘要： Methods and apparatus for generating, by a computer processor, a first status indicator and a second status indicator, generating a first attention value to indicate an amount of attention a user should devote to the first status indicator, and a second attention value to indicate an amount of attention the user should devote to the second status indicator, and outputting the first and second attention values to enable display for the user. The attention values may be generated based on reliability factors of the status indicators and on probability of failure of a control system.

摘要翻译： 用于由计算机处理器生成第一状态指示符和第二状态指示符的生成第一注意值以指示用户应该投入到第一状态指示符的注意量的方法和装置，以及指示第一注意值 用户应该注意到第二状态指示器的注意力，并输出第一和第二注意力值以使用户能够显示。 可以基于状态指示符的可靠性因素和控制系统的故障概率来生成注意力值。

公开(公告)号：US07599789B2

公开(公告)日：2009-10-06

申请号：US11420079

申请日：2006-05-24

申请人： Jon N. Leonard ,  Howard E. Neely, III ,  Ronald T. Azuma ,  Michael J. Daily

发明人： Jon N. Leonard ,  Howard E. Neely, III ,  Ronald T. Azuma ,  Michael J. Daily

IPC分类号： G01C21/26

CPC分类号： G01C21/005 ,  G01C21/20 ,  G01S5/16 ,  G01S19/18

摘要： A beacon-augmented pose estimation system includes positionable beacons that can determine their own 3-D geospatial coordinates and transmit those coordinates back to the pose object. An imaging sensor images the field-of-view of the pose object to provide 2-D image coordinates for any of the beacons in the FOV. A pose object controller processes the sets of 3-D geospatial coordinates and 2-D image coordinates to refine a pose estimate of the pose object. The positionable beacons may include both static beacons that are pre-positioned and mobile beacons that are command-guided to position themselves in the pose object's likely or actual FOV.

摘要翻译： 信标增强姿态估计系统包括可以确定自身的三维地理空间坐标并将这些坐标传回给姿态对象的定位信标。 成像传感器对姿态对象的视场进行成像，以为FOV中的任何信标提供2-D图像坐标。 姿态对象控制器处理三维地理空间坐标和二维图像坐标的集合，以细化姿态对象的姿态估计。 可定位的信标可以包括预先定位的静态信标和被命令引导的移动信标，以将其定位在姿势对象的可能或实际的FOV中。