Method and apparatus for intelligent and automatic sensor control using multimedia database system
    3.
    发明授权
    Method and apparatus for intelligent and automatic sensor control using multimedia database system 有权
    使用多媒体数据库系统进行智能和自动传感器控制的方法和装置

    公开(公告)号:US08614741B2

    公开(公告)日:2013-12-24

    申请号:US10403443

    申请日:2003-03-31

    IPC分类号: H04N7/18

    摘要: Techniques for intelligent and automatic control of sensors for capturing data associated with real time events. Preferably, the sensors are associated with a multimedia database system. For example, a technique for controlling one or more sensors used to capture data associated with an event comprises the following steps/operations. First, sensor data captured in accordance with the event is processed. Then, the one or more sensors are automatically controlled based on information pertaining to the continual activity of at least one of one or more objects and one or more persons associated with the event in real time obtained using at least a portion of the processed data captured in accordance with the event.

    摘要翻译: 用于智能和自动控制用于捕获与实时事件相关的数据的传感器的技术。 优选地,传感器与多媒体数据库系统相关联。 例如,用于控制用于捕获与事件相关联的数据的一个或多个传感器的技术包括以下步骤/操作。 首先,处理根据事件捕获的传感器数据。 然后,一个或多个传感器被自动控制,该信息是基于与使用至少一部分被处理数据捕获的实时获得的实时相关联的一个或多个对象和一个或多个与事件相关联的一个或多个人的持续活动的信息来自动控制的 按照事件。

    Instantly indexed databases for multimedia content analysis and retrieval
    4.
    发明授权
    Instantly indexed databases for multimedia content analysis and retrieval 有权
    即时索引的数据库,用于多媒体内容分析和检索

    公开(公告)号:US07203693B2

    公开(公告)日:2007-04-10

    申请号:US10167534

    申请日:2002-06-12

    IPC分类号: G06F17/30

    摘要: Techniques for indexing multimedia data substantially concurrently or contemporaneously with its capture to convert a real world event into an accessible database in real time are provided. The present invention introduces a new paradigm of converting a real world event in real time into a rich multimedia database by processing data from multiple sensors observing the event. Real time analysis of the sensor data, coupled with domain knowledge, results in instant indexing of multimedia data at capture time itself. This yields the semantic information to answer complex queries about the content, and the ability to extract portions of data that correspond to complex actions performed in the real world.

    摘要翻译: 提供了与其捕获同时或同时索引多媒体数据以将实际世界事件实时转换为可访问数据库的技术。 本发明通过处理来自观察事件的多个传感器的数据,引入了将现实世界事件实时转换为丰富的多媒体数据库的新范例。 传感器数据的实时分析结合领域知识,导致捕获时间本身对多媒体数据的即时索引。 这产生语义信息以回答有关内容的复杂查询,以及提取与现实世界中执行的复杂动作相对应的数据部分的能力。

    Method and apparatus for finding feature correspondences between images captured in real-world environments
    6.
    发明授权
    Method and apparatus for finding feature correspondences between images captured in real-world environments 有权
    用于查找在现实环境中捕获的图像之间的特征对应的方法和装置

    公开(公告)号:US07356164B2

    公开(公告)日:2008-04-08

    申请号:US10452019

    申请日:2003-05-30

    IPC分类号: G06K9/00 G06K9/32 G06K15/10

    CPC分类号: G06K9/6203 G06T7/33

    摘要: Techniques for computing a globally consistent set of image feature correspondences across a wide range of viewpoints suitable for interactive walkthroughs and visualizations. The inventive approach takes advantage of the redundancy inherent in a dense set of images captured in a plane (or in higher dimensions, e.g., images captured in a volume, images captured over time, etc). The technique may detect features in a set of source images and track the features to neighboring images. When features track to the same position in the same image, they are flagged as potential correspondences. Among the potential correspondences, the technique selects the maximal set using a greedy graph-labeling algorithm (e.g., best-first order). Only correspondences that produce a globally consistent labeling are selected. After globalization is done, a set of features common to a group of images can be quickly found and used to warp and combine the images to produce an interpolated novel view of the environment.

    摘要翻译: 用于计算适用于交互式演练和可视化的广泛视点范围内的全局一致的图像特征对应的技术。 本发明的方法利用在平面中捕获的密集图像(或更高维度,例如,在体积中捕获的图像,随时间捕获的图像等)中固有的冗余的冗余。 该技术可以检测一组源图像中的特征并将特征跟踪到相邻图像。 当特征跟踪到相同图像中的相同位置时,它们被标记为潜在的对应关系。 在潜在对应中,该技术使用贪心图标签算法(例如,最佳顺序)来选择最大集合。 仅选择产生全局一致标签的通信。 在完成全球化之后,可以快速找到一组图像所共有的特征,并将其用于扭曲和组合图像以产生环境的内插小说视图。

    Method and apparatus for computing error-bounded position and orientation of panoramic cameras in real-world environments
    7.
    发明授权
    Method and apparatus for computing error-bounded position and orientation of panoramic cameras in real-world environments 有权
    用于在现实环境中计算全景摄像机的误差位置和方位的方法和装置

    公开(公告)号:US08896660B2

    公开(公告)日:2014-11-25

    申请号:US10449929

    申请日:2003-05-30

    摘要: Techniques for computing error-bounded position and orientation (pose) of a panoramic camera in real-world environments. Such environments may include large interior spaces (e.g., buildings) A space may include multiple rooms. For example, a technique for capturing images associated with an environment includes the following steps/operations. First, respective placements of fiducials in the environment are determined so as to satisfy at least one constraint. Images are captured, with an image capture device (e.g., camera), associated with the environment with the fiducials placed therein. A pose estimation of the image capture device is then determined based on projections of the fiducials in the captured images. The pose estimation may be optimized so as to obtain an optimal pose per image. Also, the fiducial placements may be optimized so as to obtain optimal fiducial placements. Then at least one constraint may include a constraint associated with the number of visible fiducials, a constraint associated with a distance from a viewpoint to a fiducial, and/or a constraint associated with an angle subtended by pairs of fiducials.

    摘要翻译: 在现实环境中计算全景摄像机的误差位置和方向(姿态)的技术。 这样的环境可以包括大的内部空间(例如,建筑物)。空间可以包括多个房间。 例如,用于捕获与环境相关联的图像的技术包括以下步骤/操作。 首先,确定环境中基准的各自的布置以便满足至少一个约束。 拍摄与被放置在其中的基准相关联的环境的图像拍摄装置(例如,照相机)的图像。 然后基于拍摄图像中的基准的投影来确定图像拍摄装置的姿态估计。 可以优化姿态估计,以获得每个图像的最佳姿势。 此外,可以优化基准位置以获得最佳的基准位置。 然后,至少一个约束可以包括与可见基准的数量相关联的约束,与从视点到基准的距离相关联的约束和/或与由基准对成对的角度相关联的约束。

    Method and apparatus for compressing and decompressing images captured from viewpoints throughout N-dimensional space
    8.
    发明授权
    Method and apparatus for compressing and decompressing images captured from viewpoints throughout N-dimensional space 失效
    用于在整个N维空间中从视点压缩和解压缩图像的方法和装置

    公开(公告)号:US07313285B2

    公开(公告)日:2007-12-25

    申请号:US10452314

    申请日:2003-05-30

    IPC分类号: G06K9/36 G06K9/46

    摘要: Techniques for compressing and decompressing images captured from viewpoints throughout an n-dimensional space. As opposed to conventional approaches, these techniques exploit image coherence over the entire n-dimensional space, providing quick access to images along arbitrary contiguous viewpoint paths during computer graphics applications. This is accomplished by combining a hierarchical data structure with a compression methodology. Such techniques provide for generating and arranging reference images and residual images into a spatial image hierarchy such as a binary tree structure. Images and residuals may be encoded using intra-image compression. A captured image is extracted via a sequence of image warping and addition operations.

    摘要翻译: 用于压缩和解压缩在整个n维空间中从视点捕获的图像的技术。 与传统方法相反,这些技术利用整个n维空间的图像一致性,在计算机图形应用期间沿着任意连续的视点路径快速访问图像。 这是通过将分层数据结构与压缩方法相结合来实现的。 这样的技术提供了将参考图像和残留图像生成并排列到诸如二叉树结构之类的空间图像层级中。 可以使用图像内压缩对图像和残差进行编码。 通过图像翘曲和加法操作的序列提取捕获的图像。

    Method and system for creating interactive walkthroughs of real-world environment from set of densely captured images
    9.
    发明授权
    Method and system for creating interactive walkthroughs of real-world environment from set of densely captured images 有权
    用于从一组紧密捕获的图像创建现实世界环境的交互式演练的方法和系统

    公开(公告)号:US07126603B2

    公开(公告)日:2006-10-24

    申请号:US10452020

    申请日:2003-05-30

    IPC分类号: G06T15/10 G06K9/36

    CPC分类号: G06T15/205

    摘要: Techniques for creating interactive walkthroughs or visualizations of real-world environments. Such environments for which interactive walkthroughs may be created may comprise large interior spaces (e.g., buildings), wherein a space may comprise multiple rooms. The interactive walkthroughs may be photorealistic and rendered from arbitrary viewpoints at interactive rates. In one aspect of the invention, a technique for generating a visualization representative of an environment comprises the following steps. A dense set of image data is captured from the environment. The captured image data is compressed for storage. A portion of the compressed image data may then be decompressed so as to render a visualization representative of the environment from a selected novel viewpoint. Another portion of the image data may be prefetched and decompressed such that captured image data surrounding the selected novel viewpoint is available to be rendered. The visualization of the environment may then be rendered from the selected novel viewpoint.

    摘要翻译: 用于创建现实环境的交互式演练或可视化的技术。 可以创建交互式演练的这种环境可以包括大的内部空间(例如,建筑物),其中空间可以包括多个房间。 互动演练可能是照片写实的,并以互动率从任意观点呈现。 在本发明的一个方面,一种用于生成表示环境的可视化的技术包括以下步骤。 从环境中捕获一组密集的图像数据。 捕获的图像数据被压缩以便存储。 然后可以对压缩图像数据的一部分进行解压缩,以便从选定的新观点呈现代表环境的可视化。 图像数据的另一部分可以被预取和解压缩,使得围绕所选择的新视点的捕获图像数据可用于呈现。 然后可以从所选择的新观点呈现环境的可视化。