Scene reflectance functions under natural illumination
    51.
    发明授权
    Scene reflectance functions under natural illumination 失效
    自然光照下的场景反射功能

    公开(公告)号:US07218324B2

    公开(公告)日:2007-05-15

    申请号:US10871908

    申请日:2004-06-18

    IPC分类号: G06T15/50

    CPC分类号: G06T15/506 G06T7/40 G06T15/50

    摘要: A method and system estimates a reflectance function of an arbitrary scene. The scene is illuminated under various lighting condition. For each lighting condition there is an associated illumination image and an observed image. Multiple, non-overlapping kernels are determined for each pixel in a reflectance image from the pairs of illumination and observed images. A weight is then determined for each kernel to estimate the reflectance function represented as the reflectance image.

    摘要翻译: 方法和系统估计任意场景的反射函数。 场景在各种照明条件下照亮。 对于每个照明条件,存在相关联的照明图像和观察图像。 针对来自照明对和观察图像的反射率图像中的每个像素确定多个不重叠的内核。 然后确定每个核的权重以估计表示为反射率图像的反射函数。

    Three-dimensional scene reconstruction from labeled two-dimensional images
    52.
    发明授权
    Three-dimensional scene reconstruction from labeled two-dimensional images 失效
    标记二维图像的三维场景重建

    公开(公告)号:US07142726B2

    公开(公告)日:2006-11-28

    申请号:US10391998

    申请日:2003-03-19

    IPC分类号: G06K9/00 G06K9/36 G06T17/00

    摘要: A method constructs three-dimensional (3D) models of a scene from a set of two-dimensional (2D) input images. The 3D model can then be used to reconstruct the scene from arbitrary viewpoints. A user segments and labels a set of corresponding polygonal regions in each image using conventional photo-editing tools. The invention constructs the model so that the model has a maximum volume that is consistent with the set of labeled regions in the input images. The method according to the invention directly constructs the polygonal model.

    摘要翻译: 一种方法从一组二维(2D)输入图像构建场景的三维(3D)模型。 然后可以使用3D模型从任意视点重建场景。 用户使用传统的照片编辑工具在每个图像中分割和标记一组相应的多边形区域。 本发明构建模型,使得模型具有与输入图像中的标记区域集合一致的最大体积。 根据本发明的方法直接构造多边形模型。

    Apparatus and method for acquiring and combining images of a scene with multiple optical characteristics at multiple resolutions
    53.
    发明申请
    Apparatus and method for acquiring and combining images of a scene with multiple optical characteristics at multiple resolutions 审中-公开
    用于以多个分辨率获取和组合具有多个光学特性的场景的图像的装置和方法

    公开(公告)号:US20060221209A1

    公开(公告)日:2006-10-05

    申请号:US11092375

    申请日:2005-03-29

    IPC分类号: H01L27/00 H04N5/262 G06K9/32

    摘要: A camera system acquires multiple optical characteristics at multiple resolutions of a scene. The camera system includes multiple optical elements arranged as a tree having a multiple of nodes connected by edges. the nodes represent optical elements sharing a single optical center, and the edges representing light paths between the nodes. The tree has the following structure: a single root node acquiring a plenoptic field originating from a scene; nodes with a single child node represent filters, lenses, apertures, and shutters; nodes with multiple child nodes represent beam splitters and leaf nodes represent imaging sensors. Furthermore, a length of the light paths from the roof node to each leaf nodes can be equal.

    摘要翻译: 相机系统以场景的多个分辨率获取多个光学特性。 相机系统包括被布置成具有通过边缘连接的多个节点的树的多个光学元件。 节点表示共享单个光学中心的光学元件,并且边缘表示节点之间的光路径。 树具有以下结构:单个根节点获取源自场景的全视场; 具有单个子节点的节点表示滤波器,透镜,孔径和快门; 具有多个子节点的节点表示分束器,叶节点表示成像传感器。 此外,从屋顶节点到每个叶节点的光路的长度可以相等。

    Rendering deformable and animated surface reflectance fields
    54.
    发明申请
    Rendering deformable and animated surface reflectance fields 失效
    渲染可变形和动画表面反射场

    公开(公告)号:US20060028474A1

    公开(公告)日:2006-02-09

    申请号:US10912724

    申请日:2004-08-05

    IPC分类号: G06T15/70 G06T13/00

    CPC分类号: G06T13/20 G06T15/50

    摘要: A method renders a model of an object by first acquiring, in an acquisition space, a reflectance field of the object. The reflectance field includes a set of reflectance images of the object and a point model of the object. The model is deformed in an object space to generate a deformed model. For each point of the deformed model in the object space, the set of the reflectance images is queried in the acquisition space to obtain reflectance coefficients for each point. Each point of the deformed model is then shaded according to the corresponding reflectance coefficients to generate an image of the object reflecting the deforming.

    摘要翻译: 一种方法通过首先在采集空间中获取对象的反射场,从而呈现对象的模型。 反射场包括物体的一组反射图像和物体的点模型。 模型在对象空间中变形以生成变形模型。 对于对象空间中变形模型的每个点,在采集空间中查询反射率图像的集合,以获得每个点的反射系数。 然后根据相应的反射系数对变形模型的每个点进行遮蔽,以产生反映变形的物体的图像。

    Method for encoding and decoding free viewpoint videos
    55.
    发明申请
    Method for encoding and decoding free viewpoint videos 失效
    免费观看视频的编码和解码方法

    公开(公告)号:US20050117019A1

    公开(公告)日:2005-06-02

    申请号:US10723035

    申请日:2003-11-26

    IPC分类号: H04N13/00 H04N5/232 H04N7/18

    摘要: A system encodes videos acquired of a moving object in a scene by multiple fixed cameras. Camera calibration data of each camera are first determined. The camera calibration data of each camera are associated with the corresponding video. A segmentation mask for each frame of each video is determined. The segmentation mask identifies only foreground pixels in the frame associated with the object. A shape encoder then encodes the segmentation masks, a position encoder encodes a position of each pixel, and a color encoder encodes a color of each pixel. The encoded data can be combined into a single bitstream and transferred to a decoder. At the decoder, the bitstream is decoded to an output video having an arbitrary user selected viewpoint. A dynamic 3D point model defines a geometry of the moving object. Splat sizes and surface normals used during the rendering can be explicitly determined by the encoder, or explicitly by the decoder.

    摘要翻译: 系统通过多个固定摄像机对场景中的移动物体所获取的视频进行编码。 首先确定每个摄像机的摄像机校准数据。 每个摄像机的摄像机校准数据与相应的视频相关联。 确定每个视频的每个帧的分割掩码。 分割掩码仅识别与对象相关联的帧中的前景像素。 然后,形状编码器对分割掩模进行编码,位置编码器对每个像素的位置进行编码,并且颜色编码器对每个像素的颜色进行编码。 编码数据可以组合成单个比特流并传送到解码器。 在解码器处,比特流被解码为具有任意用户选择的视点的输出视频。 动态3D点模型定义了移动物体的几何形状。 在渲染期间使用的Splat尺寸和表面法线可以由编码器显式确定,或者由解码器显式确定。

    Rendering compressed surface reflectance fields of 3D objects
    56.
    发明授权
    Rendering compressed surface reflectance fields of 3D objects 失效
    渲染3D物体的压缩表面反射场

    公开(公告)号:US06803910B2

    公开(公告)日:2004-10-12

    申请号:US10185352

    申请日:2002-06-27

    IPC分类号: G06T1700

    摘要: A method models a three-dimensional object with a compressed surface reflectance field. Images of the object are acquired with multiple cameras for multiple viewpoints under different lighting conditions. The images are stored in a matrix Mr representing a surface reflectance field for the three-dimensional object. The matrix Mr is factorized into principle components pck and coefficients cfk. The principal components pck are stored in a matrix Mpc. The matrix Mpc is then factorized into principle components pcm and coefficients cfk which can be stored for each vertex V of a model of the three-dimensional object. The corresponding values of the principle components pcm, coefficients cfk, and coefficients cfk, respectively represent a compression of a surface map, which can be rendered from arbitrary viewpoints and under arbitrary lighting conditions.

    摘要翻译: 一种用压缩表面反射场对三维物体建模的方法。 在不同的照明条件下,通过多个摄像机获取对象的图像以获得多个视点。 图像被存储在表示三维物体的表面反射场的矩阵Mr中。 矩阵Mr被分解为主成分pck和系数cfk。 主要组件pck存储在矩阵Mpc中。 然后将矩阵Mpc分解为主要分量pcm和可以为三维物体的模型的每个顶点V存储的系数cfk。 原理分量pcm,系数cfk和系数cfk的相应值分别表示可以从任意视点和任意照明条件下呈现的表面图的压缩。

    Method for generating graphical object represented as surface elements
    57.
    发明授权
    Method for generating graphical object represented as surface elements 失效
    用于生成表示为表面元素的图形对象的方法

    公开(公告)号:US06498607B1

    公开(公告)日:2002-12-24

    申请号:US09240279

    申请日:1999-01-29

    IPC分类号: G06T1720

    CPC分类号: G06T17/20

    摘要: Provided is a method for representing a graphic object in a memory. A surface of the object is partitioned into a plurality of cells having a grid resolution related to an image plane resolution. Each cell is bounded by eight grid points related to the image plane resolution. A single zero-dimensional surface element is stored in the memory for each cell located on the surface of the object. The surface elements in adjacent cells are connected by links, and attributes of the portion of the object contained in the cell are assigned to each surface element and each link.

    摘要翻译: 提供了一种用于在存储器中表示图形对象的方法。 对象的表面被划分成具有与图像平面分辨率相关的网格分辨率的多个单元格。 每个单元格由与图像平面分辨率相关的八个网格点限定。 单个零维表面元素存储在位于对象表面上的每个单元的存储器中。 相邻小区中的表面元素通过链接连接,并且包含在单元中的对象的部分的属性被分配给每个表面元素和每个链接。

    Method for rendering graphical objects represented as surface elements
    58.
    发明授权
    Method for rendering graphical objects represented as surface elements 失效
    用于渲染表示为表面元素的图形对象的方法

    公开(公告)号:US06448968B1

    公开(公告)日:2002-09-10

    申请号:US09240640

    申请日:1999-01-29

    IPC分类号: G06T1720

    CPC分类号: G06T17/00

    摘要: Provided is a method for modeling a representation of a graphic object. A surface of the object is partitioned into a plurality of cells having a grid resolution related to an image plane resolution. A single zero-dimensional surface element is stored in the memory for each cell located on the surface of the object. The surface elements in adjacent cells are conected by links, and attributes of the portion of the object contained in the cell are assinged to each surface element and each link. The location of the attributed surface elements can be moved according to forces acting on the object.

    摘要翻译: 提供了一种用于对图形对象的表示进行建模的方法。 对象的表面被划分成具有与图像平面分辨率相关的网格分辨率的多个单元格。 单个零维表面元素存储在位于对象表面上的每个单元的存储器中。 相邻单元格中的表面元素由链接分割,并且包含在单元格中的对象的部分的属性被分配给每个表面元素和每个链接。 归属表面元件的位置可以根据作用在物体上的力而移动。

    Rendering objects having multiple volumes and embedded geometries using minimal depth information
    59.
    发明授权
    Rendering objects having multiple volumes and embedded geometries using minimal depth information 有权
    使用最少的深度信息渲染具有多个卷和嵌入几何的对象

    公开(公告)号:US06353677B1

    公开(公告)日:2002-03-05

    申请号:US09219061

    申请日:1998-12-22

    IPC分类号: G06K900

    CPC分类号: G06T15/40

    摘要: A method renders an object including multiple volumes and polygons. The method casts a ray through the object for each pixel of an image. Each rays is partitioned into segments according to surfaces of each volume. Color and opacity values are accumulated for each segment of each ray. Starting depths of each segment are merged and sorted, in an ascending order, into a combined depth list. Consecutive pairs of starting depths are taken to perform the following steps until done. A front clip plane and a back clip plane are defined for each pair of starting depths. Polygons between the front clip plane and a next volume surface are composited, voxels between the front clip plane and the back clip plane are composited, and polygons between the next volume surface and the back clip plane are composited.

    摘要翻译: 一种方法呈现包括多个卷和多边形的对象。 该方法通过对象为图像的每个像素投射光线。 每根光线根据每个卷的表面划分成多个段。 颜色和不透明度值是针对每个光线的每个片段累积的。 每个段的起始深度按升序合并并排序成一个组合的深度列表。 采取连续的起始深度对来执行以下步骤直到完成。 为每对起始深度定义前夹平面和后夹平面。 复合前夹片平面与下一个体积表面之间的多边形,前夹片平面和后夹平面之间的体素被合成,下一个体积表面和后夹平面之间的多边形被合成。

    Apparatus and method for real-time volume visualization
    60.
    发明授权
    Apparatus and method for real-time volume visualization 失效
    用于实时体积可视化的装置和方法

    公开(公告)号:US5594842A

    公开(公告)日:1997-01-14

    申请号:US301205

    申请日:1994-09-06

    IPC分类号: G06T15/00 G06T17/00

    CPC分类号: G06T15/005

    摘要: A method and apparatus for providing real-time processing of voxels and real-time volume visualization of objects and scenes in a highly parallel and pipelined manner using a three dimensional (3-D) skewed memory, a modular fast bus, two dimensional (2-D) skewed buffers, 3-D interpolation and shading of data points, and a ray projection cone. The method and apparatus permit investigation and viewing of real-time static (3-D) and dynamic (4-D) high resolution volumetric data sets such as those found in medical imaging, biology, non-destructive quality assurance, scientific visualization, computer aided design (CAD), flight simulation, realistic graphics and the like. The method and apparatus implement ray-casting, a powerful volume rendering technique. Viewing rays are cast from the viewing position into a cubic frame buffer. At evenly spaced sample points along each viewing ray, the data is tri-linearly interpolated using values of surrounding voxels. Central differences of voxels around the sample points yield a gradient which is used as a surface normal approximation. Using the gradient and the interpolated sample values, a local shading model is applied and a sample opacity is assigned. Finally, ray samples along the ray are composited into pixel values and provided to a display device to produce an image.

    摘要翻译: 一种使用三维(3-D)偏移存储器,模块化快速总线,二维(2)的以高度并行和流水线的方式提供体素的体
    现象处理和物体和场景的实时容积可视化的方法和装置 -D)倾斜缓冲器,数据点的3-D内插和阴影,以及射线投影锥。 该方法和装置允许调查和观察实时静态(3-D)和动态(4-D)高分辨率体积数据集,例如在医学成像,生物学,非破坏性质量保证,科学可视化,计算机 辅助设计(CAD),飞行模拟,逼真的图形等。 该方法和设备实现射线投射,强大的体积渲染技术。 观看光线从观看位置投射到立方体帧缓冲区中。 在沿着每个观察射线的均匀间隔的采样点处,使用周围体素的值对数据进行三线性内插。 样本点周围体素的中心差异产生一个梯度,用作表面法线近似。 使用渐变和内插样本值,应用局部阴影模型,并分配样本不透明度。 最后,将沿着射线的射线样本合成为像素值,并提供给显示装置以产生图像。