公开(公告)号：US20110069064A1

公开(公告)日：2011-03-24

申请号：US12994894

申请日：2008-05-28

申请人： Dong-Qing Zhang ,  Izzat Izzat ,  Youngshik Yoon

发明人： Dong-Qing Zhang ,  Izzat Izzat ,  Youngshik Yoon

IPC分类号： G06T15/00

CPC分类号： G06T7/593 ,  G06T7/579 ,  G06T2207/10012 ,  G06T2207/10021

摘要： A system and method for spatiotemporal depth extraction of images with forward and backward depth prediction are provided. The system and method of the present disclosure provide for acquiring a plurality of frames, generating a first depth map of a current frame in the plurality of frames based on a depth map of a previous frame in the plurality of frames, generating a second depth map of the current frame in the plurality of frames based on a depth map of a subsequent frame in the plurality of frames, and processing the first depth map and the second depth map to produce a third depth map for the current frame.

摘要翻译： 提供了一种具有前向和后向深度预测的图像时空深度提取的系统和方法。 本公开的系统和方法提供获取多个帧，基于多个帧中的先前帧的深度图生成多个帧中的当前帧的第一深度图，生成第二深度图 基于所述多个帧中的后续帧的深度图，并且处理所述第一深度图和所述第二深度图以产生所述当前帧的第三深度图。

公开(公告)号：US09659382B2

公开(公告)日：2017-05-23

申请号：US12994894

申请日：2008-05-28

申请人： Dong-Qing Zhang ,  Izzat Izzat ,  Youngshik Yoon

发明人： Dong-Qing Zhang ,  Izzat Izzat ,  Youngshik Yoon

IPC分类号： G06T7/593 ,  G06T7/579

CPC分类号： G06T7/593 ,  G06T7/579 ,  G06T2207/10012 ,  G06T2207/10021

摘要： A system and method for spatiotemporal depth extraction of images with forward and backward depth prediction are provided. The system and method of the present disclosure provide for acquiring a plurality of frames, generating a first depth map of a current frame in the plurality of frames based on a depth map of a previous frame in the plurality of frames, generating a second depth map of the current frame in the plurality of frames based on a depth map of a subsequent frame in the plurality of frames, and processing the first depth map and the second depth map to produce a third depth map for the current frame.

公开(公告)号：US08422766B2

公开(公告)日：2013-04-16

申请号：US12999728

申请日：2008-06-24

申请人： Dong-Qing Zhang ,  Izzat Izzat ,  Youngshik Yoon

发明人： Dong-Qing Zhang ,  Izzat Izzat ,  Youngshik Yoon

IPC分类号： G06K9/00

CPC分类号： G06T7/593 ,  G06T7/579 ,  G06T2207/10012 ,  G06T2207/10021

摘要： A system and method for spatiotemporal depth extraction of images are provided. The system and method provide for acquiring a sequence of images from a scene, the sequence including a plurality of successive frames of images, estimating the disparity of at least one point in a first image with at least one corresponding point in a second image for at least one frame, estimating motion of the at least one point in the first image, estimating the disparity of the at least one next successive frame based on the estimated disparity of at least one previous frame in a forward direction of the sequence, wherein the estimate disparity is compensated with the estimated motion, and minimizing the estimated disparity of each of the plurality of successive frames based on the estimated disparity of at least one previous frame in a backward direction of the sequence.

摘要翻译： 提供了一种用于图像时空深度提取的系统和方法。 该系统和方法提供从场景获取图像序列，该序列包括多个连续的图像帧，用第二图像中的至少一个对应点估计第一图像中的至少一个点的视差，以便在 估计所述第一图像中的至少一个点的运动，基于所述序列的向前方向上的至少一个先前帧的所估计的视差来估计所述至少一个下一个连续帧的视差，其中所述估计 基于所估计的运动的向后方向上的至少一个先前帧的估计的视差来估计运动，并且使多个连续帧中的每一个的估计的视差最小化。

公开(公告)号：US20110085727A1

公开(公告)日：2011-04-14

申请号：US12737137

申请日：2008-06-13

申请人： Youngshik Yoon ,  Izzat Izzat ,  Dong-Qing Zhang

发明人： Youngshik Yoon ,  Izzat Izzat ,  Dong-Qing Zhang

IPC分类号： G06K9/00 ,  G03B35/08 ,  G02B27/22

CPC分类号： G06K9/00 ,  G03B35/18 ,  G06T1/0028 ,  H04N13/10

摘要： A system and method for marking a stereoscopic film with colors are provided. The system and method provides for marking a left image with a mark and a right image with a mark having complementary colors, wherein upon viewing, the marks are not visible under certain conditions. The system and method provide for acquiring a stereoscopic image, the stereoscopic image including a first image and a second image, applying a first mark to the first image in a predetermined location, the first mark having a first color, and applying a second mark to the second image in substantially the same predetermined location as in the first image, the second mark having a second color that is different than the first color of the first mark, wherein when viewed in three-dimensional mode, the first mark and the second mark combine into a single mark of one color.

摘要翻译： 提供了一种用于用彩色标记立体薄膜的系统和方法。 该系统和方法提供用标记和具有补色标记的右图像标记左图像，其中在观看时，标记在某些条件下是不可见的。 所述系统和方法提供用于获取立体图像，所述立体图像包括第一图像和第二图像，在预定位置对所述第一图像应用第一标记，所述第一标记具有第一颜色，并且将第二标记应用于 所述第二图像在与所述第一图像基本相同的预定位置中，所述第二标记具有与所述第一标记的所述第一颜色不同的第二颜色，其中当以三维模式观看时，所述第一标记和所述第二标记 结合成一种颜色的单一标记。

公开(公告)号：US08520934B2

公开(公告)日：2013-08-27

申请号：US12737137

申请日：2008-06-13

申请人： Youngshik Yoon ,  Izzat Izzat ,  Dong-Qing Zhang

发明人： Youngshik Yoon ,  Izzat Izzat ,  Dong-Qing Zhang

IPC分类号： G06K9/00

CPC分类号： G06K9/00 ,  G03B35/18 ,  G06T1/0028 ,  H04N13/10

摘要： A system and method for marking a stereoscopic film with colors are provided. The system and method provides for marking a left image with a mark and a right image with a mark having complementary colors, wherein upon viewing, the marks are not visible under certain conditions. The system and method provide for acquiring a stereoscopic image, the stereoscopic image including a first image and a second image, applying a first mark to the first image in a predetermined location, the first mark having a first color, and applying a second mark to the second image in substantially the same predetermined location as in the first image, the second mark having a second color that is different than the first color of the first mark, wherein when viewed in three-dimensional mode, the first mark and the second mark combine into a single mark of one color.

摘要翻译： 提供了一种用于用彩色标记立体薄膜的系统和方法。 该系统和方法提供用标记和具有补色标记的右图像标记左图像，其中在观看时，标记在某些条件下是不可见的。 所述系统和方法提供用于获取立体图像，所述立体图像包括第一图像和第二图像，在预定位置对所述第一图像应用第一标记，所述第一标记具有第一颜色，并且将第二标记应用于 所述第二图像在与所述第一图像基本相同的预定位置中，所述第二标记具有与所述第一标记的所述第一颜色不同的第二颜色，其中当以三维模式观看时，所述第一标记和所述第二标记 结合成一种颜色的单一标记。

公开(公告)号：US20110110583A1

公开(公告)日：2011-05-12

申请号：US12999728

申请日：2008-06-24

申请人： Dong-Qing Zhang ,  Izzat Izzat ,  Youngshik Yoon

发明人： Dong-Qing Zhang ,  Izzat Izzat ,  Youngshik Yoon

IPC分类号： G06T7/00

CPC分类号： G06T7/593 ,  G06T7/579 ,  G06T2207/10012 ,  G06T2207/10021

摘要： A system and method for spatiotemporal depth extraction of images are provided. The system and method provide for acquiring a sequence of images from a scene, the sequence including a plurality of successive frames of images, estimating the disparity of at least one point in a first image with at least one corresponding point in a second image for at least one frame, estimating motion of the at least one point in the first image, estimating the disparity of the at least one next successive frame based on the estimated disparity of at least one previous frame in a forward direction of the sequence, wherein the estimate disparity is compensated with the estimated motion, and minimizing the estimated disparity of each of the plurality of successive frames based on the estimated disparity of at least one previous frame in a backward direction of the sequence.

摘要翻译： 提供了一种用于图像时空深度提取的系统和方法。 该系统和方法提供从场景获取图像序列，该序列包括多个连续的图像帧，用第二图像中的至少一个对应点估计第一图像中的至少一个点的视差，以便在 估计所述第一图像中的至少一个点的运动，基于所述序列的向前方向上的至少一个先前帧的所估计的视差来估计所述至少一个下一个连续帧的视差，其中所述估计 基于所估计的运动的向后方向上的至少一个先前帧的估计的视差来估计运动，并且使多个连续帧中的每一个的估计的视差最小化。

公开(公告)号：US20100208994A1

公开(公告)日：2010-08-19

申请号：US12658464

申请日：2010-02-09

申请人： Ning Yao ,  Izzat Izzat ,  Tao Zhang ,  Dong-Qing Zhang

发明人： Ning Yao ,  Izzat Izzat ,  Tao Zhang ,  Dong-Qing Zhang

IPC分类号： G06K9/34

CPC分类号： G06T5/005 ,  G06T7/11 ,  G06T7/162 ,  G06T2207/10024 ,  G06T2207/10028

摘要： Various implementations relate to improving depth maps. This may be done, for example, by identifying bad depth values and modifying those values. The values may represent, for example, holes and/or noise. According to a general aspect, a segmentation is determined based on an intensity image. The intensity image is associated with a corresponding depth image that includes depth values for corresponding locations in the intensity image. The segmentation is applied to the depth image to segment the depth image into multiple regions. A depth value is modified in the depth image based on the segmentation. A two-stage iterative procedure may be used to improve the segmentation and then modify bad depth values in the improved segmentation, and iterating until a desired level of smoothness is achieved. Both stages may be based, for example, on average depth values in a segment.

摘要翻译： 各种实现涉及改进深度图。 这可以通过例如识别不良深度值和修改这些值来完成。 这些值可以表示例如孔和/或噪声。 根据一般方面，基于强度图像来确定分割。 强度图像与包括强度图像中相应位置的深度值的对应深度图像相关联。 分割应用于深度图像，将深度图像分割成多个区域。 基于分割，在深度图像中修改深度值。 可以使用两阶段迭代程序来改进分割，然后在改进的分割中修改不良深度值，并且迭代直到实现所需的平滑度。 这两个阶段可以基于例如一段中的平均深度值。

公开(公告)号：US20100220932A1

公开(公告)日：2010-09-02

申请号：US12664471

申请日：2007-06-20

申请人： Dong-Qing Zhang ,  Izzat Izzat ,  Ana Belen Benitez

发明人： Dong-Qing Zhang ,  Izzat Izzat ,  Ana Belen Benitez

IPC分类号： G06K9/62

CPC分类号： G06K9/6297 ,  G06K9/00 ,  G06T7/593

摘要： A system and method for stereo matching of at least two images, e.g., a stereoscopic image pair, employing a global optimization function, e.g., a belief propagation function, that utilizes dynamic programming as a preprocessing step are provided. The system and method of the present disclosure provide for acquiring a first image and a second image from a scene, estimating the disparity of at least one point in the first image with at least one corresponding point in the second image, and minimizing the estimated disparity using a belief propagation function, e.g., a global optimization function, wherein the belief propagation function is initialized with a result of a deterministic matching function, e.g., dynamic programming, applied to the first and second image to speed up the belief propagation function. The system and method further generates a disparity map from the estimated disparity and converts the disparity map into a depth map.

摘要翻译： 提供了一种用于利用动态规划作为预处理步骤的全局优化功能（例如置信传播功能）的至少两个图像（例如立体图像对）的立体匹配的系统和方法。 本公开的系统和方法提供从场景获取第一图像和第二图像，利用第二图像中的至少一个对应点估计第一图像中的至少一个点的差异，并且将估计的视差最小化 使用置信传播函数，例如全局优化函数，其中利用确定性匹配函数（例如，动态规划）的结果初始化置信传播函数，应用于第一和第二图像以加速置信传播函数。 系统和方法还从估计的视差产生视差图，并将视差图转换成深度图。

公开(公告)号：US09057942B2

公开(公告)日：2015-06-16

申请号：US13138206

申请日：2009-01-29

申请人： Youngshik Yoon ,  Izzat Izzat

发明人： Youngshik Yoon ,  Izzat Izzat

IPC分类号： H04N13/02 ,  G03B35/00 ,  H04N13/00 ,  G03B35/10

CPC分类号： G03B35/00 ,  G03B35/10 ,  H04N13/10 ,  H04N13/239

摘要： A stereoscopic 3-D imaging apparatus has a camera and a wedged optical component attachable to the front of the camera. The wedged optical component is rotatable around the front of the camera using a rotating device, and the rotating device controls the rotation speed of the wedged optical component. The camera is capable of capturing stereoscopic 3-D images, resulting in lower costs and a simple capture process.

摘要翻译： 立体三维成像设备具有相机和可连接到照相机前部的楔形光学部件。 楔形光学部件使用旋转装置可绕相机的前部旋转，并且旋转装置控制楔形光学部件的旋转速度。 相机能够拍摄立体三维图像，从而降低成本并简化拍摄过程。

公开(公告)号：US20110044531A1

公开(公告)日：2011-02-24

申请号：US12741872

申请日：2007-11-09

申请人： Dong-Qing Zhang ,  Izzat Izzat

发明人： Dong-Qing Zhang ,  Izzat Izzat

IPC分类号： G06K9/40

CPC分类号： G06T5/002 ,  G06T5/50 ,  G06T7/11 ,  G06T7/593 ,  G06T2207/10012 ,  G06T2207/10028 ,  H04N13/128

摘要： A system and method for extracting depth information from at least two images employing region-based filtering for reducing artifacts are provided. The present disclosure provides a post-processing algorithm or function for reducing the artifacts generated by scanline Dynamic Programming (DP) or other similar methods. The system and method provides for acquiring a first image and a second image from a scene, estimating the disparity of at least one point in the first image with at least one corresponding point in the second image to generate a disparity map, segmenting at least one of the first or second images into at least one region, and filtering the disparity map based on the segmented regions. Furthermore, anisotropic filters are employed, which have a great smoothing effect along the vertical direction than that of the horizontal direction, and therefore, reduce stripe artifacts without significantly blurring the depth boundaries.

摘要翻译： 提供了一种用于从至少两个图像中提取深度信息的系统和方法，该系统和方法采用基于区域的滤波来减少伪影。 本公开提供了用于减少由扫描线动态编程（DP）或其他类似方法产生的伪影的后处理算法或功能。 该系统和方法提供从场景获取第一图像和第二图像，用第二图像中的至少一个对应点估计第一图像中的至少一个点的差异，以生成视差图，分割至少一个 将第一或第二图像分解成至少一个区域，并且基于分割区域对视差图进行滤波。 此外，采用各向异性过滤器，其沿着垂直方向具有比水平方向更好的平滑效果，因此减少条纹伪影而不会明显模糊深度边界。