Method and system for reconstructing 3D interactive walkthroughs of real-world environments
    1.
    发明授权
    Method and system for reconstructing 3D interactive walkthroughs of real-world environments 有权
    重建现实世界环境的3D交互式演练的方法和系统

    公开(公告)号:US06831643B2

    公开(公告)日:2004-12-14

    申请号:US10122337

    申请日:2002-04-16

    IPC分类号: G06T1500

    摘要: An omnidirectional video camera captures images of the environment while moving along several intersecting paths forming an irregular grid. These paths define the boundaries of a set of image loops within the environment. For arbitrary viewpoints within each image loop, a 4D plenoptic function may be reconstructed from the group of images captured at the loop boundary. For an observer viewpoint, a strip of pixels is extracted from an image in the loop in front of the observer and paired with a strip of pixels extracted from another image on the opposite side of the image loop. A new image is generated for an observer viewpoint by warping pairs of such strips of pixels according to the 4D plenoptic function, blending each pair, and then stitching the resulting strips of pixels together.

    摘要翻译: 全方向摄像机在沿着形成不规则格栅的几个相交路径移动的同时拍摄环境的图像。 这些路径定义了环境中一组图像循环的边界。 对于每个图像循环中的任意视点,可以从在循环边界处捕获的图像组重建4D全视角函数。 对于观察者观点,从观察者前面的循环中的图像中提取像素条,并与从图像环的相对侧的另一图像提取的像素条配对。 通过根据4D全息函数对这样的像素条对进行扭曲来对观察者视点生成新图像,混合每对,然后将所得到的像素条拼接在一起。

    Method and system for reconstructing 3D interactive walkthroughs of real-world environments

    公开(公告)号:US07027049B2

    公开(公告)日:2006-04-11

    申请号:US10840402

    申请日:2004-05-07

    IPC分类号: G06T15/20

    摘要: An omnidirectional video camera captures images of the environment while moving along several intersecting paths forming an irregular grid. These paths define the boundaries of a set of image loops within the environment. For arbitrary viewpoints within each image loop, a 4D plenoptic function may be reconstructed from the group of images captured at the loop boundary. For an observer viewpoint, a strip of pixels is extracted from an image in the loop in front of the observer and paired with a strip of pixels extracted from another image on the opposite side of the image loop. A new image is generated for an observer viewpoint by warping pairs of such strips of pixels according to the 4D plenoptic function, blending each pair, and then stitching the resulting strips of pixels together.

    Acoustic modeling apparatus and method using accelerated beam tracing techniques
    3.
    发明授权
    Acoustic modeling apparatus and method using accelerated beam tracing techniques 有权
    声波建模装置和采用加速光束跟踪技术的方法

    公开(公告)号:US07146296B1

    公开(公告)日:2006-12-05

    申请号:US09634764

    申请日:2000-08-07

    IPC分类号: G06F17/50 H03G3/00

    CPC分类号: H04S7/00

    摘要: An acoustic modeling system and an acoustic modeling method use beam tracing techniques that accelerate computation of significant acoustic reverberation paths in a distributed virtual environment. The acoustic modeling system and method perform a priority-driven beam tracing to construct a beam tree data structure representing “early” reverberation paths between avatar locations by performing a best-first traversal of a cell adjacency graph that represents the virtual environment. To further accelerate reverberation path computations, the acoustic modeling system and method according to one embodiment perform a bi-directional beam tracing algorithm that combines sets of beams traced from pairs of avatar locations to efficiently find viable acoustic reverberation paths.

    摘要翻译: 声学建模系统和声学建模方法使用波束跟踪技术来加速分布式虚拟环境中重要声学混响路径的计算。 声学建模系统和方法执行优先级驱动的波束跟踪,以通过执行代表虚拟环境的单元相邻图的最佳优先遍历来构建表示化身位置之间的“早期”混响路径的波束树数据结构。 为了进一步加速混响路径计算,根据一个实施例的声学建模系统和方法执行双向波束跟踪算法,其组合从对象位置对中追踪的波束组合,以有效地找到可行的声学混响路径。

    Acoustic modeling system and method using pre-computed data structures for beam tracing and path generation
    4.
    发明授权
    Acoustic modeling system and method using pre-computed data structures for beam tracing and path generation 失效
    声学建模系统和使用预先计算的数据结构进行光束跟踪和路径生成的方法

    公开(公告)号:US06751322B1

    公开(公告)日:2004-06-15

    申请号:US09165312

    申请日:1998-10-02

    IPC分类号: H03G300

    CPC分类号: H04S3/00

    摘要: A system and method for acoustic modeling partitions an input 3D spatial model into convex cells, and constructs a cell adjacency data structure representing the neighbor relationships between adjacent cells. For each sound source located in the spatial environment, convex pyramidal beams are traced through the input spatial model via recursive depth-first traversal of the cell-adjacency graph. During beam tracing, a beam tree data structure is constructed to encode propagation paths, which may include specular reflection, transmission, diffuse reflection, and diffraction events, from the source location to regions of the input spatial model. The beam tree data structure is then accessed for real-time computation and auralization of propagation paths to an arbitrary receiver location.

    摘要翻译: 用于声学建模的系统和方法将输入3D空间模型分割成凸小区,并且构建表示相邻小区之间的邻居关系的小区邻接数据结构。 对于位于空间环境中的每个声源,凸金字塔束通过输入空间模型通过细胞邻接图的递归深度优先遍历来跟踪。 在光束跟踪期间,构造波束树数据结构以对从输入空间模型的源位置到区域的传播路径进行编码,其可以包括镜面反射,透射,漫反射和衍射事件。 然后访问光束树数据结构,用于实时计算和传播路径到任意接收器位置的声音。

    Method and apparatus for deriving novel sports statistics from real time tracking of sporting events
    5.
    发明授权
    Method and apparatus for deriving novel sports statistics from real time tracking of sporting events 失效
    从实时追踪体育赛事中得出新体育统计数据的方法和装置

    公开(公告)号:US06441846B1

    公开(公告)日:2002-08-27

    申请号:US09100948

    申请日:1998-06-22

    IPC分类号: H04N718

    摘要: A method and apparatus for deriving performance statistics from real time tracking of a sporting event. The method according to the present invention includes a step of obtaining a spatio-temporal trajectory corresponding to the motion of an athlete and based on real time tracking of the athlete. The trajectory is then broken down so that performance information corresponding to the motion of the athlete (such as speed, distance covered, acceleration, etc.) can be derived with respect to time. The information so obtained can be stored in a database or the like for later retrieval or can be used to graphically supplement a video broadcast of a sporting event. The apparatus includes a device for obtaining the trajectory, a computational device for obtaining the performance information based on the obtained trajectory, and a statistical device for compiling the performance information. In particular, the spatio-temporal trajectory may be obtained by an operation on a video image of the sporting event, in which motion regions in the image are identified, and feature points on the regions are tracked as they move, thereby defining feature paths. The feature paths, in turn, are associated in clusters, which clusters generally correspond to the motion of some portion of the athlete (e.g., arms, legs, etc.). The collective plurality of clusters corresponds with the motion of the athlete as a whole.

    摘要翻译: 一种用于从体育赛事的实时跟踪中导出性能统计数据的方法和装置。 根据本发明的方法包括获得与运动员的运动相对应的时空轨迹并且基于运动员的实时跟踪的步骤。 然后将轨迹分解,使得可以相对于时间导出与运动员的运动相对应的性能信息(例如速度,距离被覆盖,加速度等)。 如此获得的信息可以存储在数据库等中以供稍后检索,或者可以用于图形地补充体育赛事的视频广播。 该装置包括用于获得轨迹的装置,用于基于获得的轨迹获得演奏信息的计算装置,以及用于编译演奏信息的统计装置。 特别地,空间 - 时间轨迹可以通过对运动事件的视频图像的操作来获得,其中识别图像中的运动区域,并且区域上的特征点在它们移动时被跟踪,从而定义特征路径。 特征路径依次与群集相关联,群集通常对应于运动员的某些部分(例如,臂,腿等)的运动。 集体多个群体与运动员整体运动相对应。

    Method and apparatus for determination and visualization of player field
coverage in a sporting event
    6.
    发明授权
    Method and apparatus for determination and visualization of player field coverage in a sporting event 失效
    用于在体育赛事中确定和可视化球员场地覆盖的方法和装置

    公开(公告)号:US6141041A

    公开(公告)日:2000-10-31

    申请号:US100943

    申请日:1998-06-22

    摘要: A method and apparatus for deriving an occupancy map reflecting an athlete's coverage of a playing area based on real time tracking of a sporting event. The method according to the present invention includes a step of obtaining a spatio-temporal trajectory corresponding to the motion of an athlete and based on real time tracking of the athlete. The trajectory is then mapped over the geometry of the playing area to determine a playing area occupancy map indicating the frequency with which the athlete occupies certain areas of the playing area, or the time spent by the athlete in certain areas of the playing area. The occupancy map is preferably color coded to indicate different levels of occupancy in different areas of the playing area, and the color coded map is then overlaid onto an image (such as a video image) of the playing area. The apparatus according to the present invention includes a device for obtaining the trajectory of an athlete, a computational device for obtaining the occupancy map based on the obtained trajectory and the geometry of the playing area, and devices for transforming the map the a camera view, generating a color (or other visually differentiable) coded version of the occupancy map, and overlaying the color coded map on a video image of the playing area. In particular, the spatio-temporal trajectory may be obtained by an operation on a video image of the sporting event, in which motion regions in the image are identified, and feature points on the regions are tracked as they move, thereby defining feature paths. The feature paths, in turn, are associated in clusters, which clusters generally correspond to the motion of some portion of the athlete (e.g., arms, legs, etc.). The collective plurality of clusters (i.e., the trajectory) corresponds with the motion of the athlete as a whole.

    摘要翻译: 一种用于基于体育赛事的实时跟踪导出反映运动员对运动区域的覆盖范围的占用地图的方法和装置。 根据本发明的方法包括获得与运动员的运动相对应的时空轨迹并且基于运动员的实时跟踪的步骤。 然后将轨迹映射到游戏区域的几何形状,以确定指示运动员占据运动区域的某些区域的频率或运动员在运动区域的某些区域中花费的时间的游戏区域占有率图。 占用率图优选地进行颜色编码,以指示在播放区域的不同区域中的不同占用水平,然后将彩色编码的地图叠加到播放区域的图像(例如视频图像)上。 根据本发明的装置包括用于获得运动员的轨迹的装置,用于基于获得的轨迹和游戏区域的几何形状来获得占用图的计算装置,以及用于将照相机视图变换为地图的装置, 生成占据地图的颜色(或其他视觉上可区分的)编码版本,并且将彩色编码地图重叠在播放区域的视频图像上。 特别地,空间 - 时间轨迹可以通过对运动事件的视频图像的操作来获得,其中识别图像中的运动区域,并且区域上的特征点在它们移动时被跟踪,从而定义特征路径。 特征路径依次与群集相关联,群集通常对应于运动员的某些部分(例如,臂,腿等)的运动。 集体多个群集(即,轨迹)对应于整个运动员的运动。

    Color Decomposition in Histology
    7.
    发明申请
    Color Decomposition in Histology 有权
    组织学颜色分解

    公开(公告)号:US20140314301A1

    公开(公告)日:2014-10-23

    申请号:US14356661

    申请日:2012-11-09

    IPC分类号: G06T7/40 G06T7/00 G06K9/00

    摘要: The method according to the invention generates a color decomposition of histological tissue image data into density maps, where each density map corresponds to the portion of the original image data that contains one stain/tissue combination. After a microscope captures histological tissue image data from a tissue sample that has been stained with at least one stain, the said stain or stains being light absorbent, the method derives from the histological tissue image data a color mixing matrix with the columns of the matrix being color reference vectors. From this mixing matrix the method derives a density map, when the mixing matrix is well-conditioned, by applying a pseudo-inverse of the mixing matrix to the optical density data, and when the mixing matrix is medially-conditioned, by applying a piece-wise pseudo-inverse of the mixing matrix to the optical density data. The method according to the invention also generates stain/tissue combination efficacy measures.

    摘要翻译: 根据本发明的方法将组织学组织图像数据的颜色分解生成密度图,其中每个密度图对应于包含一个染色/组织组合的原始图像数据的部分。 在显微镜拍摄来自已经用至少一个染色剂染色的组织样品的组织学组织图像数据之后,所述染色剂或染色剂是吸光剂,该方法从组织学组织图像数据得到颜色混合矩阵与基质列 作为颜色参考矢量。 从该混合矩阵中,该方法得到密度图,当混合矩阵条件良好时,通过将混合矩阵的伪反相应用于光密度数据,并且当混合矩阵被中间调节时,通过应用一个 将混合矩阵的逆逆向到光密度数据。 根据本发明的方法还产生染色/组织组合功效测量。

    Acoustic modeling apparatus and method using accelerated beam tracing techniques
    8.
    发明授权
    Acoustic modeling apparatus and method using accelerated beam tracing techniques 有权
    声波建模装置和采用加速光束跟踪技术的方法

    公开(公告)号:US08214179B2

    公开(公告)日:2012-07-03

    申请号:US11561368

    申请日:2006-11-17

    IPC分类号: G06F17/50 H03G3/00

    CPC分类号: H04S7/00

    摘要: An acoustic modeling system and an acoustic modeling method use beam tracing techniques that accelerate computation of significant acoustic reverberation paths in a distributed virtual environment. The acoustic modeling system and method perform a priority-driven beam tracing to construct a beam tree data structure representing “early” reverberation paths between avatar locations by performing a best-first traversal of a cell adjacency graph that represents the virtual environment. To further accelerate reverberation path computations, the acoustic modeling system and method according to one embodiment perform a bi-directional beam tracing algorithm that combines sets of beams traced from pairs of avatar locations to efficiently find viable acoustic reverberation paths.

    摘要翻译: 声学建模系统和声学建模方法使用波束跟踪技术来加速分布式虚拟环境中重要声学混响路径的计算。 声学建模系统和方法执行优先级驱动的波束跟踪,以通过执行代表虚拟环境的单元相邻图的最佳优先遍历来构建表示化身位置之间的“早期”混响路径的波束树数据结构。 为了进一步加速混响路径计算,根据一个实施例的声学建模系统和方法执行双向波束跟踪算法,其组合从对象位置对中追踪的波束组合,以有效地找到可行的声学混响路径。

    Method and apparatus for tracking position of a ball in real time
    9.
    发明授权
    Method and apparatus for tracking position of a ball in real time 失效
    实时跟踪球位置的方法和装置

    公开(公告)号:US06233007B1

    公开(公告)日:2001-05-15

    申请号:US09102071

    申请日:1998-06-22

    IPC分类号: H04N718

    摘要: A method and apparatus for tracking objects used in connection with athletic activities or sporting events, especially, balls, pucks, and the like. The method includes the steps of differencing present and previous frames of a video image including the, for example, ball to obtain motion regions, converting the motion regions to HSV color space, extracting the region corresponding to the ball based on empirical color data about the ball, obtaining a motion vector based on the motion of the ball region from a previous frame to the current frame, and updating the ball trajectory based on the newest motion vector obtained. The method also preferably includes a step of identifying completed trajectories based on preset constraints. The method is preferably expanded on by using at least one pair of cameras to provide a three-dimensional trajectory, and sometimes preferable expanded on by using a plurality of cameras, especially a plurality of pairs of cameras. An apparatus according to the present invention includes at least one camera connected to a computer which operates to difference previous and current frames, compute the ball track, convert ball regions to HSV color space and output the tracking and video information. In a case where one or more pairs of cameras are used, the computer is preferably also provided with a stereo matching device or module for matching the tracking results from respective cameras and/or respective pairs of cameras.

    摘要翻译: 用于跟踪与运动活动或体育赛事特别是球,冰球等相关的物体的追踪方法和装置。 该方法包括以下步骤:对包括例如球的视频图像的当前帧和先前帧进行区分以获得运动区域,将运动区域转换为HSV颜色空间,基于关于球体的经验色彩数据提取与球对应的区域 基于球区域从前一帧到当前帧的运动获得运动矢量,并且基于获得的最新运动矢量来更新球轨迹。 该方法还优选地包括基于预设约束来识别完成轨迹的步骤。 优选地,通过使用至少一对照相机来扩展该方法以提供三维轨迹,并且有时优选地通过使用多个照相机,特别是多对照相机进行展开。 根据本发明的装置包括连接到计算机的至少一个照相机,其操作以区分先前和当前帧,计算球轨道,将球区域转换为HSV颜色空间并输出跟踪和视频信息。 在使用一对或多对相机的情况下,计算机还优选地还设置有用于匹配来自各个相机和/或相应的相机对的跟踪结果的立体匹配装置或模块。