公开(公告)号：US20130162768A1

公开(公告)日：2013-06-27

申请号：US13543179

申请日：2012-07-06

申请人： Wen-Nung LIE ,  Hsiang-Yun Huang ,  Wei-Chih Chen

发明人： Wen-Nung LIE ,  Hsiang-Yun Huang ,  Wei-Chih Chen

IPC分类号： H04N13/00

CPC分类号： H04N13/264 ,  G06K9/00765 ,  G06T7/579 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20021

摘要： A 2D video to 3D video conversion system includes a video content analysis unit, a depth estimation unit, a post-processing unit, and a stereoscopic video generation unit. The video content analysis unit can analyze a 2D video datum and extract useful information including motion and color from the 2D video datum for depth estimation. The depth estimation unit is adapted for receiving the useful information, calculating motion cue and contrast cue for initial depth estimation, and generating an initial depth map. The post-processing unit is adapted for correcting the initial depth map in spatial domain and temporal domain to increase accuracy in spatial domain and depth continuity between adjacent time instances and for processing the caption in the video to generate a final depth map. The stereoscopic video generation unit is adapted for synthesizing 3D video datum from the final depth map and 2D video datum.

摘要翻译： 2D视频到3D视频转换系统包括视频内容分析单元，深度估计单元，后处理单元和立体视频生成单元。 视频内容分析单元可以分析2D视频数据，并从2D视频数据中提取包括运动和颜色的有用信息以进行深度估计。 深度估计单元适于接收有用信息，计算用于初始深度估计的运动提示和对比度提示，以及生成初始深度图。 后处理单元适于在空间域和时域中校正初始深度图，以增加相邻时间实例之间的空间域精度和深度连续性，并用于处理视频中的字幕以生成最终深度图。 立体视频生成单元适于从最终深度图和2D视频数据合成3D视频数据。

公开(公告)号：US20120194642A1

公开(公告)日：2012-08-02

申请号：US13019156

申请日：2011-02-01

申请人： WEN-NUNG LIE ,  CHUN-YU CHEN

发明人： WEN-NUNG LIE ,  CHUN-YU CHEN

IPC分类号： H04N13/00

CPC分类号： G06T5/003 ,  G06T2207/10021 ,  G06T2207/20021 ,  G06T2207/20201 ,  H04N2013/0081

摘要： A motion picture depth information processing system for processing depth information of a plurality of frames in a motion picture segment, each of which has corresponding color information, is composed of a buffer, a motion estimation unit, a motion compensation unit, and an adaptive post-filtering unit. The system can carry out motion estimation by referring to the color information of the frames to obtain a motion vector for each block in a frame and depth motion compensation based on the aforementioned motion vectors to get an initial depth map for each frame in the segment, then do a post-processing via the adaptive post-filtering unit to get a refined depth map of every frame, and finally generate more definite depth information for the whole motion picture segment, thus reducing geometrical texturing burrs, which are commonly known in the depth processing prior art technology.

摘要翻译： 一种运动图像深度信息处理系统，用于处理每个具有相应颜色信息的运动图像段中的多个帧的深度信息，由缓冲器，运动估计单元，运动补偿单元和自适应柱 过滤单元。 该系统可以通过参考帧的颜色信息来执行运动估计，以基于上述运动矢量获得帧中每个块的运动矢量和深度运动补偿，以获得该段中的每个帧的初始深度图， 然后通过自适应后置滤波单元进行后处理以获得每帧的精细深度图，并且最终为整个运动图像段生成更确定的深度信息，从而减少几何纹理毛刺，其在深度中是公知的 处理现有技术。

公开(公告)号：US20100188584A1

公开(公告)日：2010-07-29

申请号：US12510428

申请日：2009-07-28

申请人： Kai-Che Liu ,  Wen-Chao Chen ,  Jinn-Cherng Yang ,  Wen-Nung Lie ,  Guo-Shiang Lin ,  Cheng-Ying Yeh

发明人： Kai-Che Liu ,  Wen-Chao Chen ,  Jinn-Cherng Yang ,  Wen-Nung Lie ,  Guo-Shiang Lin ,  Cheng-Ying Yeh

IPC分类号： H04N5/14

CPC分类号： G06T7/50 ,  G06T2207/10016

摘要： A depth calculating method is provided for calculating corresponding depth data in response to frame data, which includes macroblocks. The depth calculating method includes the following steps. First, a type of video is decided according to a video content. A motion vector is obtained from decompressed video information and is modified according to a shot change detection and camera motion data. Then, multiple pieces of macroblock motion parallax data respectively corresponding to the macroblocks are found according to motion vector data of the modified macroblocks. Thereafter, the depth data corresponding to the frame data is calculated according to the pieces of macroblock motion parallax data, variance data, contrast data and texture gradient data.

摘要翻译： 提供深度计算方法，用于响应于包括宏块的帧数据来计算相应的深度数据。 深度计算方法包括以下步骤。 首先，根据视频内容来决定一种视频。 从解压缩的视频信息获得运动矢量，并根据镜头变化检测和相机运动数据进行修改。 然后，根据修改的宏块的运动矢量数据，找到分别对应于宏块的多个宏块运动视差数据。 此后，根据宏块运动视差数据，方差数据，对比度数据和纹理梯度数据计算与帧数据相对应的深度数据。

公开(公告)号：US20100002764A1

公开(公告)日：2010-01-07

申请号：US12346505

申请日：2008-12-30

申请人： Wen-Nung Lie ,  Jui-Chiu Chiang ,  Lien-Ming Liu

发明人： Wen-Nung Lie ,  Jui-Chiu Chiang ,  Lien-Ming Liu

IPC分类号： H04N7/26 ,  H04N13/00

CPC分类号： H04N19/107 ,  H04N19/137 ,  H04N19/156 ,  H04N19/176 ,  H04N19/597 ,  H04N19/61

摘要： A method for generating candidate encoding modes for an extended-channel video data subset of a stereo video data set includes the steps of: generating, for each macroblock of each frame of the extended-channel video data subset, a forward time difference image feature parameter set with reference to pixel values of pixels of the macroblock and a corresponding macroblock of a corresponding preceding frame; generating, for each macroblock, a plurality of first output values that respectively correspond to a plurality of predetermined possible block partition sizes with reference to the forward time difference image feature parameter set; and selecting, for each macroblock, a first number of candidate block partition sizes from the possible block partition sizes based on the first output values The candidate encoding modes include combinations of the first number of candidate block partition sizes and at least a part of a plurality of predetermined possible block estimation directions.

摘要翻译： 一种用于产生用于立体视频数据集的扩展频道视频数据子集的候选编码模式的方法包括以下步骤：为扩展频道视频数据子集的每一帧的每个宏块生成前向​​时差图像特征参数 参考宏块的像素的像素值和对应的前一帧的对应宏块进行设置; 针对每个宏块产生分别对应于所述正向时差图像特征参数集合的多个预定可能块分区大小的多个第一输出值; 以及基于所述第一输出值，从所述可能的块分区大小为每个宏块选择第一数量的候选块分区大小。所述候选编码模式包括所述第一数量的候选块分区大小和至少一部分多个 的预定可能的块估计方向。

公开(公告)号：US20130031107A1

公开(公告)日：2013-01-31

申请号：US13435647

申请日：2012-03-30

申请人： Jen-Yi PAN ,  Oscal Tzyh-Chiang Chen ,  Wen-Nung Lie

发明人： Jen-Yi PAN ,  Oscal Tzyh-Chiang Chen ,  Wen-Nung Lie

IPC分类号： G06F17/30

CPC分类号： G06F16/435

摘要： A personalized ranking method of audio and/or video data on Internet includes the steps of locating a plurality of audio and/or video data corresponding to at least one keyword; deciding a user index by the user or picking a history behavior index if the user does not decide the user index; capturing characteristics from the aforesaid downloaded audio and/or video data according to the user index or the history behavior; comparing the captured characteristics with a user profile or a history behavior for similarity to get a similarity score; ranking the audio and/or video data according to the corresponding similarity scores to get a ranking outcome of the audio and/or video data.

摘要翻译： 互联网上的音频和/或视频数据的个性化排序方法包括：对应于至少一个关键字的多个音频和/或视频数据的定位步骤; 如果用户不决定用户索引，则由用户决定用户索引或挑选历史行为索引; 根据用户索引或历史行为从上述下载的音频和/或视频数据捕获特征; 将捕获的特征与用户简档或历史行为进行比较以获得相似性以获得相似性得分; 根据相应的相似度分数对音频和/或视频数据进行排序，以获得音频和/或视频数据的排名结果。

公开(公告)号：US09167232B2

公开(公告)日：2015-10-20

申请号：US13543179

申请日：2012-07-06

申请人： Wen-Nung Lie ,  Hsiang-Yun Huang ,  Wei-Chih Chen

发明人： Wen-Nung Lie ,  Hsiang-Yun Huang ,  Wei-Chih Chen

IPC分类号： H04N13/02 ,  G06K9/00 ,  G06T7/00

CPC分类号： H04N13/264 ,  G06K9/00765 ,  G06T7/579 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20021

摘要： A 2D video to 3D video conversion system includes a video content analysis unit, a depth estimation unit, a post-processing unit, and a stereoscopic video generation unit. The video content analysis unit can analyze a 2D video datum and extract useful information including motion and color from the 2D video datum for depth estimation. The depth estimation unit is adapted for receiving the useful information, calculating motion cue and contrast cue for initial depth estimation, and generating an initial depth map. The post-processing unit is adapted for correcting the initial depth map in spatial domain and temporal domain to increase accuracy in spatial domain and depth continuity between adjacent time instances and for processing the caption in the video to generate a final depth map. The stereoscopic video generation unit is adapted for synthesizing 3D video datum from the final depth map and 2D video datum.

摘要翻译： 2D视频到3D视频转换系统包括视频内容分析单元，深度估计单元，后处理单元和立体视频生成单元。 视频内容分析单元可以分析2D视频数据，并从2D视频数据中提取包括运动和颜色的有用信息以进行深度估计。 深度估计单元适于接收有用信息，计算用于初始深度估计的运动提示和对比度提示，以及生成初始深度图。 后处理单元适于在空间域和时域中校正初始深度图，以增加相邻时间实例之间的空间域精度和深度连续性，并用于处理视频中的字幕以生成最终深度图。 立体视频生成单元适于从最终深度图和2D视频数据合成3D视频数据。