公开(公告)号：US20120263437A1

公开(公告)日：2012-10-18

申请号：US13516228

申请日：2010-12-10

Applicant: Jesus Barcons-Palau ,  Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang

Inventor： Jesus Barcons-Palau ,  Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang

IPC: H04N9/80

CPC classification number: G06K9/00711 ,  G06K9/00335 ,  G06K9/00724 ,  G06K9/033 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/30228 ,  G06T2207/30241

Abstract: A method and associated apparatus for using a trajectory-based technique to detect a moving object in a video sequence at incorporates human interaction through a user interface. The method comprises steps of identifying and evaluating sets of connected components in a video frame, filtering the list of connected components by comparing features of the connected components to predetermined criteria, identifying candidate trajectories across multiple frames, evaluating the candidate trajectories to determine a selected trajectory, eliminating incorrect trajectories through use of the interface and processing images in said video sequence responsive to the evaluating and eliminating steps.

Abstract translation: 一种用于使用基于轨迹的技术来检测视频序列中的移动对象的方法和相关联的装置，其通过用户界面并入人类交互。 该方法包括以下步骤：识别和评估视频帧中的连接分量集合，通过将所连接分量的特征与预定标准进行比较来过滤所连接分量的列表，识别跨多个帧的候选轨迹，评估候选轨迹以确定所选择的轨迹 通过使用界面消除不正确的轨迹，并响应于评估和消除步骤来处理所述视频序列中的图像。

公开(公告)号：US20090304270A1

公开(公告)日：2009-12-10

申请号：US12449046

申请日：2008-01-18

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Jie fu Zhai

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Jie fu Zhai

IPC: G06K9/00 ,  G06K9/40

CPC classification number: G06T5/002 ,  G06T2207/10024 ,  H04N1/409

Abstract: One or more implementations access a digital image containing one or more bands. Adjacent bands of the one or more bands have a difference in color resulting in a contour between the adjacent bands. The one or more implementations apply an algorithm to at least a portion of the digital image for reducing visibility of a contour. The algorithm is based on a value representing the fraction of pixels in a region of the digital image having a particular color value.

Abstract translation: 一个或多个实现访问包含一个或多个频带的数字图像。 一个或多个频带的相邻频带具有不同的颜色，导致相邻频带之间的轮廓。 所述一个或多个实现将算法应用于数字图像的至少一部分，以减少轮廓的可视性。 该算法基于表示具有特定颜色值的数字图像的区域中的像素的分数的值。

公开(公告)号：US20090278988A1

公开(公告)日：2009-11-12

申请号：US12308914

申请日：2006-06-29

Applicant: Sitaram Bhagavathy ,  Joan Llach

Inventor： Sitaram Bhagavathy ,  Joan Llach

IPC: H04N5/222

CPC classification number: H04N5/21 ,  G06T5/002 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/20182 ,  H04N19/105 ,  H04N19/117 ,  H04N19/162 ,  H04N19/182 ,  H04N19/537 ,  H04N19/593 ,  H04N19/86

Abstract: In an implementation, a pixel is selected from a target digital image. Multiple candidate pixels, from one or more digital images, are evaluated based on values of the multiple candidate pixels. For the selected pixel, a corresponding set of pixels is determined from the multiple candidate pixels based on the evaluations of the multiple candidate pixels and on whether a predetermined threshold number of pixels have been included in the corresponding set. Further for the selected pixel, a substitute value is determined based on the values of the pixels in the corresponding set of pixels. Various implementations described provide adaptive pixel-based spatio-temporal filtering of images or video to reduce film grain or noise. Implementations may achieve an “even” amount of noise reduction at each pixel while preserving as much picture detail as possible by, for example, averaging each pixel with a constant number, N, of temporally and/or spatially correlated pixels.

Abstract translation: 在实现中，从目标数字图像中选择像素。 基于多个候选像素的值来评估来自一个或多个数字图像的多个候选像素。 对于所选择的像素，基于多个候选像素的评估以及相应组中是否包括预定阈值数量的像素，从多个候选像素确定相应的像素集合。 此外，对于所选择的像素，基于相应像素集合中的像素的值来确定替代值。 所描述的各种实现提供了对图像或视频的自适应基于像素的时空滤波以减少胶片颗粒或噪声。 实施方式可以在每个像素处实现“均匀”的噪声降低量，同时通过例如使用恒定数量N对时间和/或空间相关像素对每个像素进行平均，尽可能地保留尽可能多的图像细节。

公开(公告)号：US09118912B2

公开(公告)日：2015-08-25

申请号：US13508562

申请日：2010-12-08

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang ,  Jesus Barcons-Palau

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang ,  Jesus Barcons-Palau

IPC: H04N7/26 ,  H04N19/103 ,  H04N19/172 ,  H04N19/115 ,  H04N19/14 ,  H04N19/154 ,  H04N19/20 ,  H04N19/176 ,  H04N19/147 ,  H04N19/46 ,  H04N19/124 ,  H04N19/137 ,  H04N19/167 ,  H04N19/85 ,  H04N19/177

CPC classification number: H04N19/103 ,  H04N19/115 ,  H04N19/124 ,  H04N19/137 ,  H04N19/14 ,  H04N19/147 ,  H04N19/154 ,  H04N19/167 ,  H04N19/172 ,  H04N19/176 ,  H04N19/177 ,  H04N19/20 ,  H04N19/46 ,  H04N19/85

Abstract: A method of object-aware video coding is provided that comprises the steps of: receiving a video sequence having a plurality of frames; selecting at least two frames; determing total area of at least one object of interest in each of the at least two frames; comparing the total area to a threshold area; classifying each of the at least two frames as being a low object weighted frame or a high object weighted frame, low object weighted frames being frames having the total area exceeding the threshold area and high object weighted frames being frame having the total area not exceeding the threshold area; and encoding each low object weighted frame according to one encoding mode and encoding each high object weighted frame according to a different encoding mode.

Abstract translation: 提供了一种对象感知视频编码方法，包括以下步骤：接收具有多个帧的视频序列; 选择至少两个帧; 确定所述至少两个帧中的每一个中的至少一个感兴趣对象的总面积; 将总面积与阈值区域进行比较; 将至少两个帧中的每一个分类为低对象加权帧或高对象加权帧，低对象加权帧是具有超过阈值区域的总区域的帧，并且高对象加权帧是具有不超过阈值区域的总区域的帧 阈值面积 并根据一个编码模式对每个低对象加权帧进行编码，并根据不同的编码模式对每个高对象加权帧进行编码。

公开(公告)号：US20110148858A1

公开(公告)日：2011-06-23

申请号：US12737873

申请日：2009-08-28

Applicant: Zefeng Ni ,  Dong Tian ,  Sitaram Bhagavathy ,  Joan Llach

Inventor： Zefeng Ni ,  Dong Tian ,  Sitaram Bhagavathy ,  Joan Llach

IPC: H04N13/00

CPC classification number: H04N13/128 ,  H04N13/111 ,  H04N2213/003 ,  H04N2213/005

Abstract: Several implementations relate to view synthesis with heuristic view merging for 3D Video (3DV) applications. According to one aspect, a first candidate pixel from a first warped reference view and a second candidate pixel from a second warped reference view are assessed based on at least one of a backward synthesis process to assess a quality of the first and second candidate pixels, a hole distribution around the first and second candidate pixels, or on an amount of energy around the first and second candidate pixels above a specified frequency. The assessing occurs as part of merging at least the first and second warped reference views into a signal synthesized view. Based on the assessing, a result is determined for a given target pixel in the single synthesized view. The result may be determining a value for the given target pixel, or marking the given target pixel as a hole.

Abstract translation: 几个实现涉及用于3D视频（3DV）应用的启发式视图合并的视图合成。 根据一个方面，基于评估第一和第二候选像素的质量的后向合成过程中的至少一个来评估来自第一翘曲参考视图的第一候选像素和来自第二翘曲参考视图的第二候选像素， 围绕第一和第二候选像素的孔分布，或者围绕指定频率之上的第一和第二候选像素周围的能量量。 评估是将至少第一和第二翘曲参考视图合并为信号合成视图的一部分。 基于评估，在单个合成视图中为给定目标像素确定结果。 结果可能是确定给定目标像素的值，或将给定的目标像素标记为孔。

公开(公告)号：US20110026606A1

公开(公告)日：2011-02-03

申请号：US12736408

申请日：2009-04-07

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Yu Huang

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Yu Huang

IPC: H04N7/12

CPC classification number: G06T5/20 ,  G06T5/002 ,  G06T5/003 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/20012 ,  G06T2207/20192 ,  G06T2207/30221

Abstract: The visibility of an object in a digital picture is enhanced by comparing an input video of the digital picture with stored information representative of the nature and characteristics of the object to develop object localization information that identifies and locates the object. The visibility of the object and the region in which the object is located is enhanced by image processing and the enhanced input video is encoded.

Abstract translation: 通过将数字图像的输入视频与表示对象的性质和特征的存储信息进行比较，以开发识别和定位对象的对象定位信息来增强数字图像中对象的可视性。 通过图像处理增强对象和对象所在的区域的可视性，并对增强的输入视频进行编码。

公开(公告)号：US09602814B2

公开(公告)日：2017-03-21

申请号：US13574428

申请日：2011-01-20

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang

IPC: H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04N19/577 ,  H04N19/51 ,  H04N19/527 ,  H04N19/119 ,  H04N19/132 ,  H04N19/12 ,  H04N19/59 ,  H04N19/137 ,  H04N19/172 ,  H04N19/20 ,  H04N19/46 ,  H04N19/33

CPC classification number: H04N19/577 ,  H04N19/119 ,  H04N19/12 ,  H04N19/132 ,  H04N19/137 ,  H04N19/172 ,  H04N19/20 ,  H04N19/33 ,  H04N19/46 ,  H04N19/527 ,  H04N19/537 ,  H04N19/573 ,  H04N19/59

Abstract: Methods and apparatus are provided for sampling-based super resolution video encoding and decoding. The encoding method receives high resolution pictures and generates low resolution pictures and metadata there from, the metadata for guiding post-decoding post-processing of the low resolution pictures and the metadata; and then encodes the low resolution pictures and the metadata using at least one encoder. The corresponding decoding method receives a bitstream and decodes low resolution pictures and metadata there from using a decoder; and then reconstructs high resolution pictures respectively corresponding to the low resolution pictures using the low resolution pictures and the metadata.

公开(公告)号：US09420291B2

公开(公告)日：2016-08-16

申请号：US13576848

申请日：2011-02-01

Applicant: Dong-Qing Zhang ,  Joan Llach ,  Sitaram Bhagavathy

Inventor： Dong-Qing Zhang ,  Joan Llach ,  Sitaram Bhagavathy

IPC: H04N7/12 ,  H04N19/105 ,  G06T1/00 ,  H04N19/139 ,  H04N19/593 ,  H04N19/14 ,  H04N19/94 ,  H04N19/59

CPC classification number: H04N19/105 ,  G06T1/00 ,  H04N19/139 ,  H04N19/14 ,  H04N19/59 ,  H04N19/593 ,  H04N19/94

Abstract: Methods and apparatus are provided for reducing vector quantization error through patch shifting. A method generates, from an input video sequence, one of more high resolution replacement patches, the one or more high resolution replacement patches for replacing one or more low resolution patches during a reconstruction of the input video sequence. This generating step generates the one or more high resolution replacement patches using data corresponding to a patch spatial shifting process, the patch spatial shifting process for reducing jittery artifacts caused by a motion-induced vector quantization error in the one or more high resolution replacement patches, the data for at least deriving a patch size of the one or more high resolution replacement patches such that the one or more high resolution replacement patches are generated to have the patch size greater than a patch size of the one or more low resolution patches in order to be suitable for use in the patch spatial shifting process.

Abstract translation: 提供了通过补片移位来减少矢量量化误差的方法和装置。 一种方法从输入视频序列生成更多高分辨率替换贴片之一，该一个或多个高分辨率替换贴片用于在重建输入视频序列期间替换一个或多个低分辨率贴片。 该生成步骤使用与贴片空间移位处理对应的数据来生成一个或多个高分辨率替换贴片，该贴片空间移位处理用于减少由一个或多个高分辨率替换贴片中的运动引起的矢量量化误差引起的抖动伪像， 所述数据用于至少导出所述一个或多个高分辨率替换补丁的补丁大小，使得生成所述一个或多个高分辨率替换补丁以使所述补丁大小大于所述一个或多个低分辨率补丁的补丁大小顺序 适用于贴片空间位移过程。

公开(公告)号：US08532375B2

公开(公告)日：2013-09-10

申请号：US12448966

申请日：2008-01-18

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Zhai Jie Fu

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Zhai Jie Fu

IPC: G06K9/00

CPC classification number: G06T5/002 ,  G06T2207/10024 ,  H04N1/409

Abstract: One or more implementations access a digital image and determine whether at least one portion of the digital image includes one or more bands having a difference in color. The determination is based on at least two candidate scales. One or more implementations access a digital image and assess at least a portion of the digital image for the existence of one or more bands having a difference in color. The assessing includes determining a fraction of pixels in the portion having a color value offset by an offset value from a color value of a particular pixel in the portion.

Abstract translation: 一个或多个实现访问数字图像并确定数字图像的至少一部分是否包括具有不同颜色的一个或多个频带。 该决定基于至少两个候选量表。 一个或多个实现访问数字图像并且评估数字图像的至少一部分是否存在具有不同颜色的一个或多个频带。 评估包括确定具有偏移值的部分中的像素的一部分中的像素的部分中的特定像素的颜色值。

公开(公告)号：US08391547B2

公开(公告)日：2013-03-05

申请号：US12450410

申请日：2007-11-06

Applicant: Yu Huang ,  Joan Llach ,  Sitaram Bhagavathy

Inventor： Yu Huang ,  Joan Llach ,  Sitaram Bhagavathy

IPC: G06K9/00 ,  G06K9/34

CPC classification number: G06K9/00711 ,  G06K9/44 ,  G06K9/4652

Abstract: A method is disclosed for detecting and locating players in soccer video frames without errors caused by artifacts by a shape analysis-based approach to identify the players and the ball from roughly extracted foregrounds obtained by color segmentation and connected component analysis, by performing a Euclidean distance transform to extract skeletons for every foreground blob, by performing a shape analysis to remove false alarms (non-players and non-ball), and then by performing skeleton pruning and a reverse Euclidean distance transform to cut-off the artifacts primarily caused by playing field lines.

Abstract translation: 公开了一种用于通过基于形状分析的方法来检测和定位足球视频帧中的玩家而产生错误的方法，以通过执行欧几里德距离从颜色分割和连接分量分析获得的粗略提取的前景识别玩家和球， 通过执行形状分析来消除假警报（非玩家和非球），然后通过执行骨架修剪和反向欧几里得距离变换来截取主要由玩耍造成的伪影，从而转换为每个前景斑点提取骨架 现场线。