公开(公告)号：US09118912B2

公开(公告)日：2015-08-25

申请号：US13508562

申请日：2010-12-08

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang ,  Jesus Barcons-Palau

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang ,  Jesus Barcons-Palau

IPC: H04N7/26 ,  H04N19/103 ,  H04N19/172 ,  H04N19/115 ,  H04N19/14 ,  H04N19/154 ,  H04N19/20 ,  H04N19/176 ,  H04N19/147 ,  H04N19/46 ,  H04N19/124 ,  H04N19/137 ,  H04N19/167 ,  H04N19/85 ,  H04N19/177

CPC classification number: H04N19/103 ,  H04N19/115 ,  H04N19/124 ,  H04N19/137 ,  H04N19/14 ,  H04N19/147 ,  H04N19/154 ,  H04N19/167 ,  H04N19/172 ,  H04N19/176 ,  H04N19/177 ,  H04N19/20 ,  H04N19/46 ,  H04N19/85

Abstract: A method of object-aware video coding is provided that comprises the steps of: receiving a video sequence having a plurality of frames; selecting at least two frames; determing total area of at least one object of interest in each of the at least two frames; comparing the total area to a threshold area; classifying each of the at least two frames as being a low object weighted frame or a high object weighted frame, low object weighted frames being frames having the total area exceeding the threshold area and high object weighted frames being frame having the total area not exceeding the threshold area; and encoding each low object weighted frame according to one encoding mode and encoding each high object weighted frame according to a different encoding mode.

Abstract translation: 提供了一种对象感知视频编码方法，包括以下步骤：接收具有多个帧的视频序列; 选择至少两个帧; 确定所述至少两个帧中的每一个中的至少一个感兴趣对象的总面积; 将总面积与阈值区域进行比较; 将至少两个帧中的每一个分类为低对象加权帧或高对象加权帧，低对象加权帧是具有超过阈值区域的总区域的帧，并且高对象加权帧是具有不超过阈值区域的总区域的帧 阈值面积 并根据一个编码模式对每个低对象加权帧进行编码，并根据不同的编码模式对每个高对象加权帧进行编码。

公开(公告)号：US09117261B2

公开(公告)日：2015-08-25

申请号：US11667816

申请日：2005-11-08

Applicant: Joan Llach ,  Cristina Gomila ,  Jeffrey Allen Cooper ,  Jill MacDonald Boyce

Inventor： Joan Llach ,  Cristina Gomila ,  Jeffrey Allen Cooper ,  Jill MacDonald Boyce

IPC: H04N7/12 ,  G06T5/00 ,  H04N19/159 ,  H04N19/46 ,  H04N19/117 ,  H04N19/85

CPC classification number: G06T5/002 ,  G06T2207/10016 ,  G06T2207/20204 ,  H04N19/117 ,  H04N19/159 ,  H04N19/46 ,  H04N19/85

Abstract: There are provided methods and apparatus for film grain SEI message insertion for bit-accurate simulation in a video system. A method for simulating film grain in an ordered sequence includes the steps of providing film grain supplemental information corresponding to a plurality of intra coded pictures, and providing additional film grain supplemental information corresponding to inter coded pictures between consecutive intra coded pictures, in decode order. The inter coded pictures are selected based upon display order.

Abstract translation: 提供了用于在视频系统中进行位精确模拟的胶片颗粒SEI消息插入方法和装置。 一种用于以有序序列模拟胶片颗粒的方法包括以解码顺序提供与多个帧内编码图像相对应的胶片颗粒补充信息以及在连续帧内编码图像之间提供对应于帧间编码图像的附加胶片颗粒补充信息的步骤。 基于显示顺序选择帧间编码图像。

公开(公告)号：US08639056B2

公开(公告)日：2014-01-28

申请号：US13376920

申请日：2010-06-28

Applicant: Jiefu Zhai ,  Joan Llach

Inventor： Jiefu Zhai ,  Joan Llach

IPC: G06K9/40

CPC classification number: G06T5/009 ,  G06T5/50 ,  G06T2207/20016 ,  G06T2207/20208

Abstract: A method according to the invention enhances contrast of an image by accessing an original image, and establishing, assigning, or initializing pixel values and pixel coordinates of pixels of the image. Then, a Laplacian pyramid having an integral number of levels is generated for the image. A contrast boost pyramid is generated and applied to the Laplacian pyramid to obtain a modified Laplacian pyramid wherein values in the levels of the Laplacian pyramid are enhanced. An enhanced image is then constructed from the modified Laplacian pyramid.

Abstract translation: 根据本发明的方法通过访问原始图像来增强图像的对比度，并且建立，分配或初始化图像的像素的像素值和像素坐标。 然后，为图像生成具有整数级别的拉普拉斯金字塔。 生成对比度增强金字塔并将其应用于拉普拉斯金字塔，以获得改进的拉普拉斯金字塔，其中拉普拉斯金字塔的水平值增加。 然后从修改的拉普拉斯金字塔构建增强图像。

公开(公告)号：US20130259318A1

公开(公告)日：2013-10-03

申请号：US13991567

申请日：2010-12-08

Applicant: Timothy Alan Barrett ,  Pierre Hughes Routhier ,  Joan Llach ,  Ben Crosey

Inventor： Timothy Alan Barrett ,  Pierre Hughes Routhier ,  Joan Llach ,  Ben Crosey

IPC: G06T7/00

CPC classification number: G06T7/00 ,  G06K9/46 ,  G06T15/00 ,  G06T15/20 ,  G06T2200/08 ,  G06T2200/16 ,  H04N13/261 ,  H04N13/30

Abstract: Automatic determination of the complexity associated with converting image content from 2-dimensions to 3-dimensions commences by first determining how many different scenes exist within the image content. Each scene then undergoes analysis to determine its complexity based on the motion, texture and occlusion within the scene. The scene complexities are added to the scene transition complexity and the total gets weighted to yield an overall indication of the complexity of converting of image content from 2-dimensions to 3-dimensions.

Abstract translation: 通过首先确定图像内容中存在多少不同场景，自动确定将图像内容从二维转换为三维的相关开始。 然后每个场景进行分析以根据场景内的运动，纹理和遮挡来确定其复杂性。 场景复杂性被添加到场景转换复杂性，并且总体被加权以产生将图像内容从二维转换为三维的复杂性的总体指示。

公开(公告)号：US08472526B2

公开(公告)日：2013-06-25

申请号：US11667846

申请日：2005-09-26

Applicant: Cristina Gomila ,  Joan Llach ,  Jeffrey Allen Cooper

Inventor： Cristina Gomila ,  Joan Llach ,  Jeffrey Allen Cooper

IPC: H04N11/02

CPC classification number: G06T5/10 ,  G06T5/002 ,  G06T2207/10016 ,  G06T2207/20052 ,  G06T2207/20204 ,  H04N19/46 ,  H04N19/467 ,  H04N19/85

Abstract: The simulation of film grain in a video image occurs by first creating a block (i.e., a matrix array) of transformed coefficients for a set of cut frequencies fHL, fVL, fHH and fVH associated with a desired grain pattern. (The cut frequencies fHL, fVL, fHH and fVH represent cut-off frequencies, in two dimensions, of a filter that characterizes the desired film grain pattern). The block of transformed coefficients undergoes an inverse transform to yield a bit-accurate film grain sample and the bit accurate sample undergoes scaling to enable blending with a video signal to simulate film grain in the signal.

Abstract translation: 视频图像中的胶片颗粒的模拟通过首先为与期望的颗粒图案相关联的一组切割频率fHL，fVL，fHH和fVH创建变换系数的块（即，矩阵阵列）而发生。 （切割频率fHL，fVL，fHH和fVH表示二维特征所需胶片颗粒图案的滤光片的截止频率）。 变换后的系数块进行逆变换以产生位精确的胶片颗粒样品，并且比特精确的样本进行缩放以使得能够与视频信号混合以模拟信号中的胶片颗粒。

公开(公告)号：US20120314023A1

公开(公告)日：2012-12-13

申请号：US13580165

申请日：2010-10-08

Applicant: Jesus Barcons-Palau ,  Joan Llach

Inventor： Jesus Barcons-Palau ,  Joan Llach

IPC: H04N13/00

CPC classification number: H04N13/139 ,  H04N5/2624 ,  H04N13/161 ,  H04N13/30

Abstract: A method, apparatus and system are provided for the visual inspection of a three-dimensional video stream as it is being re-encoded into a second video format. A portion of a frame of a decoded three-dimensional video stream and a corresponding portion of a frame of the three-dimensional video stream having been re-encoded are arranged into a combined video frame such that the video frame portions appear together in the combined video frame. A boundary between the video frame portions in the combined video frame is manipulated such that a change of disparity on the boundary between the video frame portions, and any overlap between the combined video frame portions, are not visible.

Abstract translation: 提供了一种方法，装置和系统，用于在三维视频流被重新编码为第二视频格式时的目视检查。 解码的三维视频流的帧的一部分和已被重新编码的三维视频流的帧的对应部分被布置成组合视频帧，使得视频帧部分在组合中一起出现 视频帧。 操作组合视频帧中的视频帧部分之间的边界，使得视频帧部分之间的边界上的视差的变化以及组合的视频帧部分之间的任何重叠是不可见的。

公开(公告)号：US20120237130A1

公开(公告)日：2012-09-20

申请号：US13395887

申请日：2010-09-14

Applicant: Zhe Wang ,  Jiefu Zhai ,  Joan Llach

Inventor： Zhe Wang ,  Jiefu Zhai ,  Joan Llach

IPC: G06K9/64 ,  G06K9/36

CPC classification number: G06T5/009 ,  G06T2207/10016 ,  G06T2207/20092 ,  G06T2207/20208

Abstract: A user interactive video tone mapping method is provided that can be used for the tone reproduction of high dynamic range (HDR) content on low dynamic range (LDR) displays. The method comprises the steps of selecting a frame of a video sequence; providing a user interface for a user to manually apply scribble marks to the frame; manually applying N scribble marks to the frame, N being a whole number of value 1 or in greater; and tone mapping the video sequence responsive to the scribble marks.

Abstract translation: 提供了可用于低动态范围（LDR）显示器上的高动态范围（HDR）内容的色调再现的用户交互式视频色调映射方法。 该方法包括以下步骤：选择视频序列的帧; 提供用户界面以便用户手动地将涂鸦标记应用于所述框架; 手动将N个涂抹标记应用到框架中，N为值1或更大的整数; 并且响应于涂鸦标记对视频序列进行色调映射。

公开(公告)号：US20120082397A1

公开(公告)日：2012-04-05

申请号：US13376920

申请日：2010-06-28

Applicant: Jiefu Zhai ,  Joan Llach

Inventor： Jiefu Zhai ,  Joan Llach

IPC: G06K9/40

CPC classification number: G06T5/009 ,  G06T5/50 ,  G06T2207/20016 ,  G06T2207/20208

Abstract: A method according to the invention enhances contrast of an image by accessing an original image, and establishing, assigning, or initializing pixel values and pixel coordinates of pixels of the image. Then, a Laplacian pyramid having an integral number of levels is generated for the image. A contrast boost pyramid is generated and applied to the Laplacian pyramid to obtain a modified Laplacian pyramid wherein values in the levels of the Laplacian pyramid are enhanced. An enhanced image is then constructed from the modified Laplacian pyramid.

Abstract translation: 根据本发明的方法通过访问原始图像来增强图像的对比度，并且建立，分配或初始化图像的像素的像素值和像素坐标。 然后，为图像生成具有整数级别的拉普拉斯金字塔。 生成对比度增强金字塔并将其应用于拉普拉斯金字塔，以获得改进的拉普拉斯金字塔，其中拉普拉斯金字塔的水平值增加。 然后从修改的拉普拉斯金字塔构建增强图像。

公开(公告)号：US20110148858A1

公开(公告)日：2011-06-23

申请号：US12737873

申请日：2009-08-28

Applicant: Zefeng Ni ,  Dong Tian ,  Sitaram Bhagavathy ,  Joan Llach

Inventor： Zefeng Ni ,  Dong Tian ,  Sitaram Bhagavathy ,  Joan Llach

IPC: H04N13/00

CPC classification number: H04N13/128 ,  H04N13/111 ,  H04N2213/003 ,  H04N2213/005

Abstract: Several implementations relate to view synthesis with heuristic view merging for 3D Video (3DV) applications. According to one aspect, a first candidate pixel from a first warped reference view and a second candidate pixel from a second warped reference view are assessed based on at least one of a backward synthesis process to assess a quality of the first and second candidate pixels, a hole distribution around the first and second candidate pixels, or on an amount of energy around the first and second candidate pixels above a specified frequency. The assessing occurs as part of merging at least the first and second warped reference views into a signal synthesized view. Based on the assessing, a result is determined for a given target pixel in the single synthesized view. The result may be determining a value for the given target pixel, or marking the given target pixel as a hole.

Abstract translation: 几个实现涉及用于3D视频（3DV）应用的启发式视图合并的视图合成。 根据一个方面，基于评估第一和第二候选像素的质量的后向合成过程中的至少一个来评估来自第一翘曲参考视图的第一候选像素和来自第二翘曲参考视图的第二候选像素， 围绕第一和第二候选像素的孔分布，或者围绕指定频率之上的第一和第二候选像素周围的能量量。 评估是将至少第一和第二翘曲参考视图合并为信号合成视图的一部分。 基于评估，在单个合成视图中为给定目标像素确定结果。 结果可能是确定给定目标像素的值，或将给定的目标像素标记为孔。

公开(公告)号：US20100329554A1

公开(公告)日：2010-12-30

申请号：US12803370

申请日：2010-06-25

Applicant: Jiefu Zhai ,  Joan Llach ,  Zhe Wang

Inventor： Jiefu Zhai ,  Joan Llach ,  Zhe Wang

IPC: G06K9/36 ,  G06K9/00

CPC classification number: H04N5/202 ,  G09G3/2003 ,  G09G2340/0428 ,  G09G2340/06

Abstract: A method for tone mapping high dynamic range images for display on low dynamic range displays wherein high dynamic range images are first accessed. The high dynamic range images are divided the into different regions such that each region is represented by a matrix, where each element of the matrix is a weight or probability of a pixel value. An exposure of each region is determined or calculated by estimating an anchor point in each region such that most pixels in each region are mapped to mid grey and the anchor points are adjusted to a key of the images to preserve overall brightness. The regions are then placed or mapped to zones and exposure values are applied to the regions responsive to the weight or probability. The regions are fused together to obtain a final tone mapped image.

Abstract translation: 一种用于将高动态范围图像进行色调映射以在低动态范围显示器上显示的方法，其中首先访问高动态范围图像。 高动态范围图像被划分成不同的区域，使得每个区域由矩阵表示，其中矩阵的每个元素是像素值的权重或概率。 通过估计每个区域中的锚点来确定或计算每个区域的曝光，使得每个区域中的大多数像素被映射到中间灰色，并且将锚点调整为图像的关键以保持整体亮度。 然后将区域放置或映射到区域，并且响应于重量或概率将曝光值应用于区域。 将这些区域融合在一起以获得最终的色调映射图像。