公开(公告)号：US08553972B2

公开(公告)日：2013-10-08

申请号：US12830822

申请日：2010-07-06

申请人： Ji Won Kim ,  Gangyu Ma ,  Haitao Wang ,  Xiying Wang ,  Ji Yeun Kim ,  Yong Ju Jung

发明人： Ji Won Kim ,  Gangyu Ma ,  Haitao Wang ,  Xiying Wang ,  Ji Yeun Kim ,  Yong Ju Jung

IPC分类号： G06K9/00 ,  G06K9/32 ,  H04N13/00

CPC分类号： G06T7/50 ,  G06T2207/10016 ,  G06T2207/20221 ,  G06T2207/30196

摘要： Disclosed are an apparatus, a method and a computer-readable medium automatically generating a depth map corresponding to each two-dimensional (2D) image in a video. The apparatus includes an image acquiring unit to acquire a plurality of 2D images that are temporally consecutive in an input video, a saliency map generator to generate at least one saliency map corresponding to a current 2D image among the plurality of 2D images based on a Human Visual Perception (HVP) model, a saliency-based depth map generator, a three-dimensional (3D) structure matching unit to calculate matching scores between the current 2D image and a plurality of 3D typical structures that are stored in advance, and to determine a 3D typical structure having a highest matching score among the plurality of 3D typical structures to be a 3D structure of the current 2D image, a matching-based depth map generator; a combined depth map generator to combine the saliency-based depth map and the matching-based depth map and to generate a combined depth map, and a spatial and temporal smoothing unit to spatially and temporally smooth the combined depth map.

摘要翻译： 公开了一种自动生成与视频中的每个二维（2D）图像相对应的深度图的装置，方法和计算机可读介质。 该装置包括：图像获取单元，用于获取在输入视频中在时间上连续的多个2D图像，显着图生成器，用于基于人类生成与多个2D图像中的当前2D图像相对应的至少一个显着图 视觉感知（HVP）模型，基于显着性的深度图生成器，三维（3D）结构匹配单元，用于计算当前2D图像与预先存储的多个3D典型结构之间的匹配分数，并且确定 在所述多个3D典型结构中具有最高匹配分数以作为当前2D图像的3D结构的3D典型结构，基于匹配的深度图生成器; 组合深度图生成器，用于组合基于显着性的深度图和基于匹配的深度图并生成组合深度图，以及空间和时间平滑单元，以空间和时间平滑组合的深度图。

公开(公告)号：US20110026808A1

公开(公告)日：2011-02-03

申请号：US12830822

申请日：2010-07-06

申请人： Ji Won KIM ,  Gangyu Ma ,  Haitao Wang ,  Xiying Wang ,  Ji Yeun Kim ,  Yong Ju Jung

发明人： Ji Won KIM ,  Gangyu Ma ,  Haitao Wang ,  Xiying Wang ,  Ji Yeun Kim ,  Yong Ju Jung

IPC分类号： G06T7/00

CPC分类号： G06T7/50 ,  G06T2207/10016 ,  G06T2207/20221 ,  G06T2207/30196

摘要： Disclosed are an apparatus, a method and a computer-readable medium automatically generating a depth map corresponding to each two-dimensional (2D) image in a video. The apparatus includes an image acquiring unit to acquire a plurality of 2D images that are temporally consecutive in an input video, a saliency map generator to generate at least one saliency map corresponding to a current 2D image among the plurality of 2D images based on a Human Visual Perception (HVP) model, a saliency-based depth map generator, a three-dimensional (3D) structure matching unit to calculate matching scores between the current 2D image and a plurality of 3D typical structures that are stored in advance, and to determine a 3D typical structure having a highest matching score among the plurality of 3D typical structures to be a 3D structure of the current 2D image, a matching-based depth map generator; a combined depth map generator to combine the saliency-based depth map and the matching-based depth map and to generate a combined depth map, and a spatial and temporal smoothing unit to spatially and temporally smooth the combined depth map.

摘要翻译： 公开了一种自动生成与视频中的每个二维（2D）图像相对应的深度图的装置，方法和计算机可读介质。 该装置包括：图像获取单元，用于获取在输入视频中在时间上连续的多个2D图像，显着图生成器，用于基于人类生成与多个2D图像中的当前2D图像相对应的至少一个显着图 视觉感知（HVP）模型，基于显着性的深度图生成器，三维（3D）结构匹配单元，用于计算当前2D图像与预先存储的多个3D典型结构之间的匹配分数，并且确定 在所述多个3D典型结构中具有最高匹配分数以作为当前2D图像的3D结构的3D典型结构，基于匹配的深度图生成器; 组合深度图生成器，用于组合基于显着性的深度图和基于匹配的深度图并生成组合深度图，以及空间和时间平滑单元，以空间和时间平滑组合的深度图。