SYSTEM AND METHOD FOR STEREO MATCHING OF IMAGES
    1.
    发明申请
    SYSTEM AND METHOD FOR STEREO MATCHING OF IMAGES 审中-公开
    用于立体匹配图像的系统和方法

    公开(公告)号:US20100220932A1

    公开(公告)日:2010-09-02

    申请号:US12664471

    申请日:2007-06-20

    IPC分类号: G06K9/62

    CPC分类号: G06K9/6297 G06K9/00 G06T7/593

    摘要: A system and method for stereo matching of at least two images, e.g., a stereoscopic image pair, employing a global optimization function, e.g., a belief propagation function, that utilizes dynamic programming as a preprocessing step are provided. The system and method of the present disclosure provide for acquiring a first image and a second image from a scene, estimating the disparity of at least one point in the first image with at least one corresponding point in the second image, and minimizing the estimated disparity using a belief propagation function, e.g., a global optimization function, wherein the belief propagation function is initialized with a result of a deterministic matching function, e.g., dynamic programming, applied to the first and second image to speed up the belief propagation function. The system and method further generates a disparity map from the estimated disparity and converts the disparity map into a depth map.

    摘要翻译: 提供了一种用于利用动态规划作为预处理步骤的全局优化功能(例如置信传播功能)的至少两个图像(例如立体图像对)的立体匹配的系统和方法。 本公开的系统和方法提供从场景获取第一图像和第二图像,利用第二图像中的至少一个对应点估计第一图像中的至少一个点的差异,并且将估计的视差最小化 使用置信传播函数,例如全局优化函数,其中利用确定性匹配函数(例如,动态规划)的结果初始化置信传播函数,应用于第一和第二图像以加速置信传播函数。 系统和方法还从估计的视差产生视差图,并将视差图转换成深度图。

    System and method for recovering three-dimensional particle systems from two-dimensional images
    2.
    发明授权
    System and method for recovering three-dimensional particle systems from two-dimensional images 有权
    从二维图像中恢复三维粒子系统的系统和方法

    公开(公告)号:US08619073B2

    公开(公告)日:2013-12-31

    申请号:US12447029

    申请日:2006-10-27

    IPC分类号: G06T15/00

    摘要: A system and method for recovering three-dimensional (3D) particle systems from two-dimensional (2D) images are provided. The system and method of the present invention provide for identifying a fuzzy object in a two-dimensional (2D) image; selecting a particle system from a plurality of predetermined particle systems, the selected particle system relating to a predefined fuzzy object; generating at least one particle of the selected particle system; simulating the at least one particle to update states of the at least one particle; rendering the selected particle system; comparing the rendered particle system to the identified fuzzy object in the 2D image; and storing the selected particle system if the comparison result is within an acceptable threshold, wherein the stored particle system represents the recovered geometry of the fuzzy object.

    摘要翻译: 提供了一种用于从二维(2D)图像中恢复三维(3D)粒子系统的系统和方法。 本发明的系统和方法提供用于识别二维(2D)图像中的模糊对象; 从多个预定粒子系统中选择粒子系统,所选粒子系统与预定义的模糊对象相关; 产生所选择的粒子系统的至少一个粒子; 模拟所述至少一个粒子以更新所述至少一个粒子的状态; 渲染选定的粒子系统; 将渲染的粒子系统与2D图像中识别的模糊对象进行比较; 以及如果所述比较结果在可接受的阈值内,则存储所选择的粒子系统,其中所述存储的粒子系统表示所述模糊对象的恢复的几何形状。

    Method and system for subframe accurate synchronization
    3.
    发明授权
    Method and system for subframe accurate synchronization 有权
    子帧准确同步的方法和系统

    公开(公告)号:US08483540B2

    公开(公告)日:2013-07-09

    申请号:US12312362

    申请日:2006-12-12

    IPC分类号: H04N5/932 H04N5/935

    摘要: A method, apparatus and system for synchronizing between two recording modes includes identifying a common event in the two recording modes. The event in time is recognized for a higher accuracy mode of the two modes. The event is predicted in a lower accuracy mode of the two modes by determining a time when the event occurred between frames in the lower accuracy mode. The event in the higher accuracy mode is synchronized to the lower accuracy mode to provide sub-frame accuracy alignment between the two modes. In one embodiment of the invention, the common event includes the closing of a clap slate, and the two modes include audio and video recording modes.

    摘要翻译: 用于在两种记录模式之间同步的方法,装置和系统包括识别两种记录模式中的公共事件。 对于两种模式的更高精度模式,识别出时间上的事件。 通过确定在较低精度模式中的帧之间发生事件的时间,在两种模式的较低精度模式中预测该事件。 在较高精度模式下的事件与较低精度模式同步,以提供两种模式之间的子帧精度对准。 在本发明的一个实施例中,公共事件包括拍子拍板的关闭,并且两种模式包括音频和视频记录模式。

    SYSTEM AND METHOD FOR COMPOSITING 3D IMAGES
    4.
    发明申请
    SYSTEM AND METHOD FOR COMPOSITING 3D IMAGES 审中-公开
    用于组合3D图像的系统和方法

    公开(公告)号:US20110181591A1

    公开(公告)日:2011-07-28

    申请号:US12514855

    申请日:2006-11-20

    IPC分类号: G06T15/50 G06T15/00

    摘要: A system and method for compositing 3D images that combines parts of or at least a portion of two or more images having 3D properties to create a 3D image. The system and method of the present disclosure provides for acquiring at least two three-dimensional (3D) images, obtaining metadata (e.g., lighting, geometry, and object information) relating to the at least two 3D images, mapping the metadata of the at least two 3D images into a single 3D coordinate system, and compositing a portion of each of the at least two 3D images into a single 3D image. The single 3D image can be rendered into a desired format (e.g., stereo image pair). The system and method can associate the rendered output with relevant metadata (e.g., interocular distance for stereo image pairs).

    摘要翻译: 一种用于合成3D图像的系统和方法,其组合具有3D属性的两个或更多个图像的部分或至少一部分以创建3D图像。 本公开的系统和方法提供获取至少两个三维(3D)图像,获得与所述至少两个3D图像相关的元数据(例如,照明,几何和对象信息),映射所述at 将至少两个3D图像转换成单个3D坐标系,并将所述至少两个3D图像中的每一个的一部分合成为单个3D图像。 单个3D图像可以被渲染成期望的格式(例如,立体图像对)。 系统和方法可以将渲染的输出与相关元数据(例如,立体图像对的眼间距离)相关联。

    SYSTEM AND METHOD FOR RECOVERING THREE-DIMENSIONAL PARTICLE SYSTEMS FROM TWO-DIMENSIONAL IMAGES
    5.
    发明申请
    SYSTEM AND METHOD FOR RECOVERING THREE-DIMENSIONAL PARTICLE SYSTEMS FROM TWO-DIMENSIONAL IMAGES 有权
    从二维图像恢复三维粒子系统的系统和方法

    公开(公告)号:US20100315410A1

    公开(公告)日:2010-12-16

    申请号:US12447029

    申请日:2006-10-27

    IPC分类号: G06T15/00

    摘要: A system and method for recovering three-dimensional (3D) particle systems from two-dimensional (2D) images are provided. The system and method of the present invention provide for identifying a fuzzy object in a two-dimensional (2D) image; selecting a particle system from a plurality of predetermined particle systems, the selected particle system relating to a predefined fuzzy object; generating at least one particle of the selected particle system; simulating the at least one particle to update states of the at least one particle; rendering the selected particle system; comparing the rendered particle system to the identified fuzzy object in the 2D image; and storing the selected particle system if the comparison result is within an acceptable threshold, wherein the stored particle system represents the recovered geometry of the fuzzy object.

    摘要翻译: 提供了一种用于从二维(2D)图像中恢复三维(3D)粒子系统的系统和方法。 本发明的系统和方法提供用于识别二维(2D)图像中的模糊对象; 从多个预定粒子系统中选择粒子系统,所选粒子系统与预定义的模糊对象相关; 产生所选择的粒子系统的至少一个粒子; 模拟所述至少一个粒子以更新所述至少一个粒子的状态; 渲染选定的粒子系统; 将渲染的粒子系统与2D图像中识别的模糊对象进行比较; 以及如果所述比较结果在可接受的阈值内,则存储所选择的粒子系统,其中所述存储的粒子系统表示所述模糊对象的恢复的几何形状。

    METHOD AND SYSTEM FOR SUBFRAME ACCURATE SYNCHRONIZATION
    6.
    发明申请
    METHOD AND SYSTEM FOR SUBFRAME ACCURATE SYNCHRONIZATION 有权
    用于子帧精确​​同步的方法和系统

    公开(公告)号:US20100054696A1

    公开(公告)日:2010-03-04

    申请号:US12312362

    申请日:2006-12-12

    IPC分类号: H04N7/087 G10L15/00 G06K9/00

    摘要: A method, apparatus and system for synchronizing between two recording modes includes identifying a common event in the two recording modes. The event in time is recognized for a higher accuracy mode of the two modes. The event is predicted in a lower accuracy mode of the two modes by determining a time when the event occurred between frames in the lower accuracy mode. The event in the higher accuracy mode is synchronized to the lower accuracy mode to provide sub-frame accuracy alignment between the two modes. In one embodiment of the invention, the common event includes the closing of a clap slate, and the two modes include audio and video recording modes.

    摘要翻译: 用于在两种记录模式之间同步的方法,装置和系统包括识别两种记录模式中的公共事件。 对于两种模式的更高精度模式,识别出时间上的事件。 通过确定在较低精度模式中的帧之间发生事件的时间,在两种模式的较低精度模式中预测该事件。 在较高精度模式下的事件与较低精度模式同步,以提供两种模式之间的子帧精度对准。 在本发明的一个实施例中,公共事件包括拍子拍板的关闭,并且两种模式包括音频和视频记录模式。

    METHOD AND SYSTEM FOR MODELING LIGHT
    7.
    发明申请
    METHOD AND SYSTEM FOR MODELING LIGHT 有权
    用于建模光的方法和系统

    公开(公告)号:US20100049488A1

    公开(公告)日:2010-02-25

    申请号:US12515340

    申请日:2006-11-20

    IPC分类号: G06G7/48 G06T15/50

    CPC分类号: G06T15/506

    摘要: A method and system for modeling light in time and space are provided. The method and system of the present disclosure collect light readings, e.g., on a motion picture set, at different positions and times to build a light model to be used for visual effects (VFX) compositing. The light model represents the light distribution across space and/or time for a predetermined physical space. Using the light model, the lighting can then be predicted or interpolated at intermediate or other positions and/or times for which no specific light readings were obtained. The light models can be used for rendering objects (e.g., natural or CG elements) in a scene as if they were in that space.

    摘要翻译: 提供了一种用于在时间和空间上对光进行建模的方法和系统。 本公开的方法和系统在不同的位置和时间收集例如运动图像集上的光读数,以构建要用于视觉效果(VFX)合成的光模型。 光模型表示预定物理空间的空间和/或时间的光分布。 使用光模型,然后可以在没有获得特定光读数的中间或其他位置和/或时间预测或内插照明。 光模型可用于在场景中渲染对象(例如,自然或CG元素),就像它们在该空间中一样。

    SYSTEM AND METHOD FOR MODEL FITTING AND REGISTRATION OF OBJECTS FOR 2D-TO-3D CONVERSION
    8.
    发明申请
    SYSTEM AND METHOD FOR MODEL FITTING AND REGISTRATION OF OBJECTS FOR 2D-TO-3D CONVERSION 审中-公开
    用于2D到3D转换的对象的模型配置和注册的系统和方法

    公开(公告)号:US20090322860A1

    公开(公告)日:2009-12-31

    申请号:US12514636

    申请日:2006-11-17

    IPC分类号: H04N13/02

    摘要: A system and method is provided for model fitting and registration of objects for 2D-to-3D conversion of images to create stereoscopic images. The system and method of the present disclosure provides for acquiring at least one two-dimensional (2D) image, identifying at least one object of the at least one 2D image, selecting at least one 3D model from a plurality of predetermined 3D models, the selected 3D model relating to the identified at least one object, registering the selected 3D model to the identified at least one object, and creating a complementary image by projecting the selected 3D model onto an image plane different than the image plane of the at least one 2D image. The registering process can be implemented using geometric approaches or photometric approaches.

    摘要翻译: 提供了一种用于模型拟合和对准用于图像的2D到3D转换以创建立体图像的对象的系统和方法。 本公开的系统和方法提供了获取至少一个二维(2D)图像,识别至少一个2D图像的至少一个对象,从多个预定3D模型中选择至少一个3D模型, 与所识别的至少一个对象相关的所选3D模型,将所选择的3D模型注册到所识别的至少一个对象,以及通过将所选择的3D模型投影到不同于至少一个对象的图像平面的图像平面上来创建补充图像 2D图像。 注册过程可以使用几何方法或光度法来实现。

    Method and System for Color Correction Using Thre-Dimensional Information
    9.
    发明申请
    Method and System for Color Correction Using Thre-Dimensional Information 有权
    使用三维信息进行颜色校正的方法和系统

    公开(公告)号:US20090303247A1

    公开(公告)日:2009-12-10

    申请号:US12308137

    申请日:2006-06-09

    IPC分类号: G09G5/02

    摘要: A system and method for the color correction of an image using three-dimensional, geometrical information of the capture environment of the image includes determining geometrical properties of at least a portion of the image and modifying a look of at least the portion of the image by altering a value of at least one of the determined geometrical properties and using image formation theory. In one embodiment of the present invention, the geometrical properties of the image include at least one of light properties, surface color, reflectance properties, and scene geometry of the at least one portion of the image. In accordance with the present invention, the geometrical properties of the image are alternatively determined by using sensing devices, by inferring the geometrical properties from the image itself, or by user input.

    摘要翻译: 使用图像的捕获环境的三维几何信息对图像进行颜色校正的系统和方法包括确定图像的至少一部分的几何特性并且通过以下方式修改图像的至少部分的外观: 改变所确定的几何特性中的至少一个的值并使用图像形成理论。 在本发明的一个实施例中,图像的几何特性包括图像的至少一部分的光性质,表面颜色,反射率特性和场景几何形状中的至少一个。 根据本发明,通过使用感测装置,通过从图像本身推断几何特性或通过用户输入来替代地确定图像的几何特性。

    Method and system for color correction using three-dimensional information
    10.
    发明授权
    Method and system for color correction using three-dimensional information 有权
    使用三维信息进行颜色校正的方法和系统

    公开(公告)号:US09508190B2

    公开(公告)日:2016-11-29

    申请号:US12308137

    申请日:2006-06-09

    IPC分类号: G06T15/50 G06T15/20

    摘要: A system and method for the color correction of an image using three-dimensional, geometrical information of the capture environment of the image includes determining geometrical properties of at least a portion of the image and modifying a look of at least the portion of the image by altering a value of at least one of the determined geometrical properties and using image formation theory. In one embodiment of the present invention, the geometrical properties of the image include at least one of light properties, surface color, reflectance properties, and scene geometry of the at least one portion of the image. In accordance with the present invention, the geometrical properties of the image are alternatively determined by using sensing devices, by inferring the geometrical properties from the image itself, or by user input.

    摘要翻译: 使用图像的捕获环境的三维几何信息对图像进行颜色校正的系统和方法包括确定图像的至少一部分的几何特性并且通过以下方式修改图像的至少部分的外观: 改变所确定的几何特性中的至少一个的值并使用图像形成理论。 在本发明的一个实施例中,图像的几何特性包括图像的至少一部分的光性质,表面颜色,反射率特性和场景几何形状中的至少一个。 根据本发明,通过使用感测装置,通过从图像本身推断几何特性或通过用户输入来替代地确定图像的几何特性。