公开(公告)号：US09813707B2

公开(公告)日：2017-11-07

申请号：US13522024

申请日：2011-01-21

Applicant: Dong-Qing Zhang ,  Sitaram Bhagavathy ,  Joan Llach

Inventor： Dong-Qing Zhang ,  Sitaram Bhagavathy ,  Joan Llach

IPC: H04N7/12 ,  H04N19/105 ,  H04N7/54 ,  H04N19/146 ,  H04N19/152 ,  H04N19/149 ,  H04N19/154 ,  H04N7/01 ,  H04N19/139 ,  H04N19/46 ,  H04N19/14 ,  H04N19/94 ,  H04N19/59

CPC classification number: H04N19/105 ,  H04N7/0125 ,  H04N7/54 ,  H04N19/139 ,  H04N19/14 ,  H04N19/146 ,  H04N19/149 ,  H04N19/152 ,  H04N19/154 ,  H04N19/46 ,  H04N19/59 ,  H04N19/94

Abstract: Methods and apparatuses for data pruning for video compression using example-based super resolution are provided. A method and apparatus for encoding is provided in which patches of video are extracted from input video, grouped together using a clustering method, and representative patches are packed into patch frames. The original video is downsized and sent either along with, or in addition to, the patch frames. At a decoder, the method and apparatus provided extract patches from the patch frames and create a patch library. The regular video frames are upsized and the low resolution patches are replaced by patches from the patch library by searching the library using the patches in the decoded regular frames as keywords. If there are no appropriate patches, no replacement is made. A post processing procedure is used to enhance the spatiotemporal smoothness of the recovered video.

公开(公告)号：US09336578B2

公开(公告)日：2016-05-10

申请号：US13395887

申请日：2010-09-14

Applicant: Zhe Wang ,  Jiefu Zhai ,  Joan Llach

Inventor： Zhe Wang ,  Jiefu Zhai ,  Joan Llach

IPC: G06T5/00

CPC classification number: G06T5/009 ,  G06T2207/10016 ,  G06T2207/20092 ,  G06T2207/20208

Abstract: A user interactive video tone mapping method is provided that can be used for the tone reproduction of high dynamic range (HDR) content on low dynamic range (LDR) displays. The method comprises the steps of selecting a frame of a video sequence; providing a user interface for a user to manually apply scribble marks to the frame; manually applying N scribble marks to the frame, N being a whole number of value 1 or greater; and tone mapping the video sequence responsive to the scribble marks.

Abstract translation: 提供了可用于低动态范围（LDR）显示器上的高动态范围（HDR）内容的色调再现的用户交互式视频色调映射方法。 该方法包括以下步骤：选择视频序列的帧; 提供用户界面以便用户手动地将涂鸦标记应用于所述框架; 手动将N个涂抹标记施加到框架上，N为1或更大的整数; 并且响应于涂鸦标记对视频序列进行色调映射。

公开(公告)号：US08977109B2

公开(公告)日：2015-03-10

申请号：US13516228

申请日：2010-12-10

Applicant: Jesus Barcons-Palau ,  Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang

Inventor： Jesus Barcons-Palau ,  Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang

IPC: G11B27/00 ,  H04N5/93 ,  G06K9/00 ,  G06K9/03 ,  G06T7/20

CPC classification number: G06K9/00711 ,  G06K9/00335 ,  G06K9/00724 ,  G06K9/033 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/30228 ,  G06T2207/30241

Abstract: A method and associated apparatus for using a trajectory-based technique to detect a moving object in a video sequence at incorporates human interaction through a user interface. The method comprises steps of identifying and evaluating sets of connected components in a video frame, filtering the list of connected components by comparing features of the connected components to predetermined criteria, identifying candidate trajectories across multiple frames, evaluating the candidate trajectories to determine a selected trajectory, eliminating incorrect trajectories through use of the interface and processing images in said video sequence responsive to the evaluating and eliminating steps.

Abstract translation: 一种用于使用基于轨迹的技术来检测视频序列中的移动对象的方法和相关联的装置，其通过用户界面并入人类交互。 该方法包括以下步骤：识别和评估视频帧中的连接分量集合，通过将所连接分量的特征与预定标准进行比较来过滤所连接分量的列表，识别跨多个帧的候选轨迹，评估候选轨迹以确定所选择的轨迹 通过使用界面消除不正确的轨迹，并响应于评估和消除步骤来处理所述视频序列中的图像。

公开(公告)号：US08483288B2

公开(公告)日：2013-07-09

申请号：US11284378

申请日：2005-11-21

Applicant: Jeffrey Allen Cooper ,  Cristina Gomila ,  Joan Llach

Inventor： Jeffrey Allen Cooper ,  Cristina Gomila ,  Joan Llach

IPC: H04N7/12

CPC classification number: G06T5/002 ,  G06T2207/20204 ,  H04N19/423 ,  H04N19/61 ,  H04N19/80

Abstract: The present invention provides a method, apparatus and system for film grain cache splitting for film grain simulation. In one embodiment of the present invention a method for storing film grain patterns includes storing at least a first portion of film grain patterns in an internal memory and storing at least a second portion of the film grain patterns in an external memory. That is, in the present invention a method for film grain cache splitting for film grain simulation includes splitting the storage of film grain patterns between an internal cache and an external memory. In one embodiment of the present invention, the internal cache is integrated into an integrated circuit chip of a decoder.

Abstract translation: 本发明提供了一种胶片颗粒高速缓冲分割用于胶片颗粒模拟的方法，装置和系统。 在本发明的一个实施例中，用于存储胶片颗粒图案的方法包括将至少第一部分胶片颗粒图案存储在内部存储器中，并将胶片颗粒图案的至少第二部分存储在外部存储器中。 也就是说，在本发明中，用于胶片颗粒模拟的胶片颗粒高速缓存分割的方法包括分割内部高速缓存和外部存储器之间的胶片颗粒图案的存储。 在本发明的一个实施例中，内部高速缓存集成到解码器的集成电路芯片中。

公开(公告)号：US20130028330A1

公开(公告)日：2013-01-31

申请号：US13576848

申请日：2011-02-01

Applicant: Dong-Qing Zhang ,  Joan Llach ,  Sitaram Bhagavathy

Inventor： Dong-Qing Zhang ,  Joan Llach ,  Sitaram Bhagavathy

IPC: H04N7/26

CPC classification number: H04N19/105 ,  G06T1/00 ,  H04N19/139 ,  H04N19/14 ,  H04N19/59 ,  H04N19/593 ,  H04N19/94

Abstract: Methods and apparatus are provided for reducing vector quantization error through patch shifting. A method generates, from an input video sequence, one of more high resolution replacement patches, the one or more high resolution replacement patches for replacing one or more low resolution patches during a reconstruction of the input video sequence. This generating step generates the one or more high resolution replacement patches using data corresponding to a patch spatial shifting process, the patch spatial shifting process for reducing jittery artifacts caused by a motion-induced vector quantization error in the one or more high resolution replacement patches, the data for at least deriving a patch size of the one or more high resolution replacement patches such that the one or more high resolution replacement patches are generated to have the patch size greater than a patch size of the one or more low resolution patches in order to be suitable for use in the patch spatial shifting process.

Abstract translation: 提供了通过补片移位来减少矢量量化误差的方法和装置。 一种方法从输入视频序列生成更多高分辨率替换贴片之一，该一个或多个高分辨率替换贴片用于在重建输入视频序列期间替换一个或多个低分辨率贴片。 该生成步骤使用与贴片空间移位处理对应的数据来生成一个或多个高分辨率替换贴片，该贴片空间移位处理用于减少由一个或多个高分辨率替换贴片中的运动引起的矢量量化误差引起的抖动伪像， 所述数据用于至少导出所述一个或多个高分辨率替换补丁的补丁大小，使得生成所述一个或多个高分辨率替换补丁以使所述补丁大小大于所述一个或多个低分辨率补丁的补丁大小顺序 适用于贴片空间位移过程。

公开(公告)号：US20120314029A1

公开(公告)日：2012-12-13

申请号：US13579670

申请日：2010-02-19

Applicant: Jill MacDonald Boyce ,  Kumar Ramaswamy ,  Joan Llach

Inventor： Jill MacDonald Boyce ,  Kumar Ramaswamy ,  Joan Llach

IPC: H04N13/00

CPC classification number: H04N13/156 ,  H04N13/183 ,  H04N13/261 ,  H04N13/293

Abstract: A method for inserting a logo into a stereo video image to generate an overlaid stereo image, the method comprising: detecting presence of stereo pictures in the video image and, when stereo pictures are detected, determining the 3D format of said stereo pictures, said 3D format being a stereo spatially multiplexed format; generating a stereo logo comprising stereo spatially multiplexed logo pictures including a representation of the logo, said stereo spatially multiplexed logo pictures being arranged in said 3D format; and combining the stereo logo and the video image to generate the overlaid stereo image in said 3D format.

Abstract translation: 一种用于将标识插入到立体视频图像中以产生重叠立体图像的方法，所述方法包括：检测所述视频图像中的立体图像的存在，并且当检测到立体图像时，确定所述立体图像的3D格式，所述3D 格式是立体空间复用格式; 生成立体声标志，其包括立体空间多路复用的徽标图像，包括标识的表示，所述立体空间复用的标志图像以所述3D格式排列; 以及组合立体标志和视频图像以产生所述3D格式的叠加立体图像。

公开(公告)号：US20120229604A1

公开(公告)日：2012-09-13

申请号：US13509049

申请日：2009-11-18

Applicant: Jill MacDonald Boyce ,  Kumar Ramaswamy ,  Joan Llach

Inventor： Jill MacDonald Boyce ,  Kumar Ramaswamy ,  Joan Llach

IPC: H04N13/00 ,  H04N13/04

CPC classification number: H04N19/597 ,  H04N13/161 ,  H04N13/194 ,  H04N13/243

Abstract: Methods and systems for delivering three-dimensional content over a network are disclosed. In accordance with the methods and systems, disparity adjustment of three-dimensional video streams can be made by enabling a receiver to dynamically select among several pairs of left & right views in accordance with user-preferences. Further, Multi-view Video Coding methods and systems are disclosed in which the dynamic selection and adjustment is facilitated by configuring dependencies of enhancement views to reference only base views.

Abstract translation: 公开了一种通过网络传送三维内容的方法和系统。 根据方法和系统，可以通过使接收机能够根据用户偏好在多对左右视图中动态地选择三维视频流的视差调整。 此外，公开了多视图视频编码方法和系统，其中通过将增强视图的依赖性配置为仅引用基本视图来促进动态选择和调整。

公开(公告)号：US20120224629A1

公开(公告)日：2012-09-06

申请号：US13508562

申请日：2010-12-08

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang ,  Jesus Barcons-Palau

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang ,  Jesus Barcons-Palau

IPC: H04N7/26

CPC classification number: H04N19/103 ,  H04N19/115 ,  H04N19/124 ,  H04N19/137 ,  H04N19/14 ,  H04N19/147 ,  H04N19/154 ,  H04N19/167 ,  H04N19/172 ,  H04N19/176 ,  H04N19/177 ,  H04N19/20 ,  H04N19/46 ,  H04N19/85

Abstract: A method of object-aware video coding is provided that comprises the steps of: receiving a video sequence having a plurality of frames; selecting at least two frames; determing total area of at least one object of interest in each of the at least two frames; comparing the total area to a threshold area; classifying each of the at least two frames as being a low object weighted frame or a high object weighted frame, low object weighted frames being frames having the total area exceeding the threshold area and high object weighted frames being frame having the total area not exceeding the threshold area; and encoding each low object weighted frame according to one encoding mode and encoding each high object weighted frame according to a different encoding mode.

Abstract translation: 提供了一种对象感知视频编码方法，包括以下步骤：接收具有多个帧的视频序列; 选择至少两个帧; 确定所述至少两个帧中的每一个中的至少一个感兴趣对象的总面积; 将总面积与阈值区域进行比较; 将至少两个帧中的每一个分类为低对象加权帧或高对象加权帧，低对象加权帧是具有超过阈值区域的总区域的帧，并且高对象加权帧是具有不超过阈值区域的总区域的帧 阈值面积 并根据一个编码模式对每个低对象加权帧进行编码，并根据不同的编码模式对每个高对象加权帧进行编码。

公开(公告)号：US08204334B2

公开(公告)日：2012-06-19

申请号：US12308914

申请日：2006-06-29

Applicant: Sitaram Bhagavathy ,  Joan Llach

Inventor： Sitaram Bhagavathy ,  Joan Llach

IPC: G06K9/40 ,  H04N5/00 ,  G09G5/10 ,  G09G5/02 ,  G09G5/00

CPC classification number: H04N5/21 ,  G06T5/002 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/20182 ,  H04N19/105 ,  H04N19/117 ,  H04N19/162 ,  H04N19/182 ,  H04N19/537 ,  H04N19/593 ,  H04N19/86

Abstract: In an implementation, a pixel is selected from a target digital image. Multiple candidate pixels, from one or more digital images, are evaluated based on values of the multiple candidate pixels. For the selected pixel, a corresponding set of pixels is determined from the multiple candidate pixels based on the evaluations of the multiple candidate pixels and on whether a predetermined threshold number of pixels have been included in the corresponding set. Further for the selected pixel, a substitute value is determined based on the values of the pixels in the corresponding set of pixels. Various implementations described provide adaptive pixel-based spatio-temporal filtering of images or video to reduce film grain or noise. Implementations may achieve an “even” amount of noise reduction at each pixel while preserving as much picture detail as possible by, for example, averaging each pixel with a constant number, N, of temporally and/or spatially correlated pixels.

Abstract translation: 在实现中，从目标数字图像中选择像素。 基于多个候选像素的值来评估来自一个或多个数字图像的多个候选像素。 对于所选择的像素，基于多个候选像素的评估以及相应组中是否包括预定阈值数量的像素，从多个候选像素确定相应的像素集合。 此外，对于所选择的像素，基于相应像素集合中的像素的值来确定替代值。 所描述的各种实现提供了对图像或视频的自适应基于像素的时空滤波以减少胶片颗粒或噪声。 实施方式可以在每个像素处实现“均匀”的噪声降低量，同时通过例如使用恒定数量N对时间和/或空间相关像素对每个像素进行平均，尽可能地保留尽可能多的图像细节。

公开(公告)号：US20120114184A1

公开(公告)日：2012-05-10

申请号：US13386145

申请日：2010-07-20

Applicant: Jesus Barcons-Palau ,  Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang

Inventor： Jesus Barcons-Palau ,  Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang

IPC: G06K9/68

CPC classification number: G06K9/00711 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/30224 ,  G06T2207/30241

Abstract: The present invention concerns a method and associated apparatus for using a trajectory-based technique to detect a moving object in a video sequence, such as the ball in a soccer game. In one embodiment, the method comprises steps of identifying and evaluating sets of connected components in a video frame, filtering the list of connected components by comparing features of the connected components to predetermined criteria, identifying candidate trajectories across multiple frames, evaluating the candidate trajectories to determine a selected trajectory, and processing images in the video sequence based at least in part upon the selected trajectory.

Abstract translation: 本发明涉及一种使用基于轨迹的技术来检测诸如足球游戏中的球的视频序列中的移动物体的方法和相关装置。 在一个实施例中，该方法包括以下步骤：识别和评估视频帧中的连接分量集合，通过将所连接分量的特征与预定标准进行比较来过滤所连接分量列表，识别跨多个帧的候选轨迹，评估候选轨迹 确定所选择的轨迹，以及至少部分地基于所选择的轨迹来处理视频序列中的图像。