公开(公告)号：US20110026606A1

公开(公告)日：2011-02-03

申请号：US12736408

申请日：2009-04-07

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Yu Huang

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Yu Huang

IPC: H04N7/12

CPC classification number: G06T5/20 ,  G06T5/002 ,  G06T5/003 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/20012 ,  G06T2207/20192 ,  G06T2207/30221

Abstract: The visibility of an object in a digital picture is enhanced by comparing an input video of the digital picture with stored information representative of the nature and characteristics of the object to develop object localization information that identifies and locates the object. The visibility of the object and the region in which the object is located is enhanced by image processing and the enhanced input video is encoded.

Abstract translation: 通过将数字图像的输入视频与表示对象的性质和特征的存储信息进行比较，以开发识别和定位对象的对象定位信息来增强数字图像中对象的可视性。 通过图像处理增强对象和对象所在的区域的可视性，并对增强的输入视频进行编码。

公开(公告)号：US20110026607A1

公开(公告)日：2011-02-03

申请号：US12736496

申请日：2009-04-07

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Yu Huang

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Yu Huang

IPC: H04N7/26 ,  G06K9/40 ,  H04N5/21

CPC classification number: G06T5/002 ,  G06T5/003 ,  G06T5/20 ,  G06T2207/10016 ,  H04N19/119 ,  H04N19/124 ,  H04N19/162 ,  H04N19/167 ,  H04N19/17 ,  H04N19/20 ,  H04N19/46 ,  H04N19/80 ,  H04N19/85

Abstract: The visibility of an object in a digital picture is enhanced by comparing an input video of the digital picture with stored information representative of the nature and characteristics of the object to develop object localization information that identifies and locates the object. The input video and the object localization information are encoded and transmitted to a receiver where the input video and the object localization information are decoded and the decoded input video is enhanced by the decoded object localization information

Abstract translation: 通过将数字图像的输入视频与表示对象的性质和特征的存储信息进行比较，以开发识别和定位对象的对象定位信息来增强数字图像中对象的可视性。 输入视频和对象定位信息被编码并发送到接收机，其中输入视频和对象定位信息被解码，并且解码的输入视频被解码的对象定位信息增强

公开(公告)号：US20100098307A1

公开(公告)日：2010-04-22

申请号：US12450410

申请日：2007-11-06

Applicant: Yu Huang ,  Joan Llach ,  Sitaram Bhagavathy

Inventor： Yu Huang ,  Joan Llach ,  Sitaram Bhagavathy

IPC: G06K9/62

CPC classification number: G06K9/00711 ,  G06K9/44 ,  G06K9/4652

Abstract: A method is disclosed for detecting and locating players in soccer video frames without errors caused by artifacts by a shape analysis-based approach to identify the players and the ball from roughly extracted foregrounds obtained by color segmentation and connected component analysis, by performing a Euclidean distance transform to extract skeletons for every foreground blob, by performing a shape analysis to remove false alarms (non-players and non-ball), and then by performing skeleton pruning and a reverse Euclidean distance transform to cut-off the artifacts primarily caused by playing field lines.

Abstract translation: 公开了一种用于通过基于形状分析的方法来检测和定位足球视频帧中的玩家而产生错误的方法，以通过执行欧几里德距离从颜色分割和连接分量分析获得的大致提取的前景识别玩家和球， 通过执行形状分析来消除假警报（非玩家和非球），然后通过执行骨架修剪和反向欧几里得距离变换来截取主要由玩耍造成的伪影，从而转换为每个前景斑点提取骨架 现场线。

公开(公告)号：US08391547B2

公开(公告)日：2013-03-05

申请号：US12450410

申请日：2007-11-06

Applicant: Yu Huang ,  Joan Llach ,  Sitaram Bhagavathy

Inventor： Yu Huang ,  Joan Llach ,  Sitaram Bhagavathy

IPC: G06K9/00 ,  G06K9/34

CPC classification number: G06K9/00711 ,  G06K9/44 ,  G06K9/4652

Abstract: A method is disclosed for detecting and locating players in soccer video frames without errors caused by artifacts by a shape analysis-based approach to identify the players and the ball from roughly extracted foregrounds obtained by color segmentation and connected component analysis, by performing a Euclidean distance transform to extract skeletons for every foreground blob, by performing a shape analysis to remove false alarms (non-players and non-ball), and then by performing skeleton pruning and a reverse Euclidean distance transform to cut-off the artifacts primarily caused by playing field lines.

Abstract translation: 公开了一种用于通过基于形状分析的方法来检测和定位足球视频帧中的玩家而产生错误的方法，以通过执行欧几里德距离从颜色分割和连接分量分析获得的粗略提取的前景识别玩家和球， 通过执行形状分析来消除假警报（非玩家和非球），然后通过执行骨架修剪和反向欧几里得距离变换来截取主要由玩耍造成的伪影，从而转换为每个前景斑点提取骨架 现场线。

公开(公告)号：US20120263437A1

公开(公告)日：2012-10-18

申请号：US13516228

申请日：2010-12-10

Applicant: Jesus Barcons-Palau ,  Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang

Inventor： Jesus Barcons-Palau ,  Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang

IPC: H04N9/80

CPC classification number: G06K9/00711 ,  G06K9/00335 ,  G06K9/00724 ,  G06K9/033 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/30228 ,  G06T2207/30241

Abstract: A method and associated apparatus for using a trajectory-based technique to detect a moving object in a video sequence at incorporates human interaction through a user interface. The method comprises steps of identifying and evaluating sets of connected components in a video frame, filtering the list of connected components by comparing features of the connected components to predetermined criteria, identifying candidate trajectories across multiple frames, evaluating the candidate trajectories to determine a selected trajectory, eliminating incorrect trajectories through use of the interface and processing images in said video sequence responsive to the evaluating and eliminating steps.

Abstract translation: 一种用于使用基于轨迹的技术来检测视频序列中的移动对象的方法和相关联的装置，其通过用户界面并入人类交互。 该方法包括以下步骤：识别和评估视频帧中的连接分量集合，通过将所连接分量的特征与预定标准进行比较来过滤所连接分量的列表，识别跨多个帧的候选轨迹，评估候选轨迹以确定所选择的轨迹 通过使用界面消除不正确的轨迹，并响应于评估和消除步骤来处理所述视频序列中的图像。

公开(公告)号：US20090304270A1

公开(公告)日：2009-12-10

申请号：US12449046

申请日：2008-01-18

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Jie fu Zhai

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Jie fu Zhai

IPC: G06K9/00 ,  G06K9/40

CPC classification number: G06T5/002 ,  G06T2207/10024 ,  H04N1/409

Abstract: One or more implementations access a digital image containing one or more bands. Adjacent bands of the one or more bands have a difference in color resulting in a contour between the adjacent bands. The one or more implementations apply an algorithm to at least a portion of the digital image for reducing visibility of a contour. The algorithm is based on a value representing the fraction of pixels in a region of the digital image having a particular color value.

Abstract translation: 一个或多个实现访问包含一个或多个频带的数字图像。 一个或多个频带的相邻频带具有不同的颜色，导致相邻频带之间的轮廓。 所述一个或多个实现将算法应用于数字图像的至少一部分，以减少轮廓的可视性。 该算法基于表示具有特定颜色值的数字图像的区域中的像素的分数的值。

公开(公告)号：US20090278988A1

公开(公告)日：2009-11-12

申请号：US12308914

申请日：2006-06-29

Applicant: Sitaram Bhagavathy ,  Joan Llach

Inventor： Sitaram Bhagavathy ,  Joan Llach

IPC: H04N5/222

CPC classification number: H04N5/21 ,  G06T5/002 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/20182 ,  H04N19/105 ,  H04N19/117 ,  H04N19/162 ,  H04N19/182 ,  H04N19/537 ,  H04N19/593 ,  H04N19/86

Abstract: In an implementation, a pixel is selected from a target digital image. Multiple candidate pixels, from one or more digital images, are evaluated based on values of the multiple candidate pixels. For the selected pixel, a corresponding set of pixels is determined from the multiple candidate pixels based on the evaluations of the multiple candidate pixels and on whether a predetermined threshold number of pixels have been included in the corresponding set. Further for the selected pixel, a substitute value is determined based on the values of the pixels in the corresponding set of pixels. Various implementations described provide adaptive pixel-based spatio-temporal filtering of images or video to reduce film grain or noise. Implementations may achieve an “even” amount of noise reduction at each pixel while preserving as much picture detail as possible by, for example, averaging each pixel with a constant number, N, of temporally and/or spatially correlated pixels.

Abstract translation: 在实现中，从目标数字图像中选择像素。 基于多个候选像素的值来评估来自一个或多个数字图像的多个候选像素。 对于所选择的像素，基于多个候选像素的评估以及相应组中是否包括预定阈值数量的像素，从多个候选像素确定相应的像素集合。 此外，对于所选择的像素，基于相应像素集合中的像素的值来确定替代值。 所描述的各种实现提供了对图像或视频的自适应基于像素的时空滤波以减少胶片颗粒或噪声。 实施方式可以在每个像素处实现“均匀”的噪声降低量，同时通过例如使用恒定数量N对时间和/或空间相关像素对每个像素进行平均，尽可能地保留尽可能多的图像细节。

公开(公告)号：US09118912B2

公开(公告)日：2015-08-25

申请号：US13508562

申请日：2010-12-08

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang ,  Jesus Barcons-Palau

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang ,  Jesus Barcons-Palau

IPC: H04N7/26 ,  H04N19/103 ,  H04N19/172 ,  H04N19/115 ,  H04N19/14 ,  H04N19/154 ,  H04N19/20 ,  H04N19/176 ,  H04N19/147 ,  H04N19/46 ,  H04N19/124 ,  H04N19/137 ,  H04N19/167 ,  H04N19/85 ,  H04N19/177

CPC classification number: H04N19/103 ,  H04N19/115 ,  H04N19/124 ,  H04N19/137 ,  H04N19/14 ,  H04N19/147 ,  H04N19/154 ,  H04N19/167 ,  H04N19/172 ,  H04N19/176 ,  H04N19/177 ,  H04N19/20 ,  H04N19/46 ,  H04N19/85

Abstract: A method of object-aware video coding is provided that comprises the steps of: receiving a video sequence having a plurality of frames; selecting at least two frames; determing total area of at least one object of interest in each of the at least two frames; comparing the total area to a threshold area; classifying each of the at least two frames as being a low object weighted frame or a high object weighted frame, low object weighted frames being frames having the total area exceeding the threshold area and high object weighted frames being frame having the total area not exceeding the threshold area; and encoding each low object weighted frame according to one encoding mode and encoding each high object weighted frame according to a different encoding mode.

Abstract translation: 提供了一种对象感知视频编码方法，包括以下步骤：接收具有多个帧的视频序列; 选择至少两个帧; 确定所述至少两个帧中的每一个中的至少一个感兴趣对象的总面积; 将总面积与阈值区域进行比较; 将至少两个帧中的每一个分类为低对象加权帧或高对象加权帧，低对象加权帧是具有超过阈值区域的总区域的帧，并且高对象加权帧是具有不超过阈值区域的总区域的帧 阈值面积 并根据一个编码模式对每个低对象加权帧进行编码，并根据不同的编码模式对每个高对象加权帧进行编码。

公开(公告)号：US20110148858A1

公开(公告)日：2011-06-23

申请号：US12737873

申请日：2009-08-28

Applicant: Zefeng Ni ,  Dong Tian ,  Sitaram Bhagavathy ,  Joan Llach

Inventor： Zefeng Ni ,  Dong Tian ,  Sitaram Bhagavathy ,  Joan Llach

IPC: H04N13/00

CPC classification number: H04N13/128 ,  H04N13/111 ,  H04N2213/003 ,  H04N2213/005

Abstract: Several implementations relate to view synthesis with heuristic view merging for 3D Video (3DV) applications. According to one aspect, a first candidate pixel from a first warped reference view and a second candidate pixel from a second warped reference view are assessed based on at least one of a backward synthesis process to assess a quality of the first and second candidate pixels, a hole distribution around the first and second candidate pixels, or on an amount of energy around the first and second candidate pixels above a specified frequency. The assessing occurs as part of merging at least the first and second warped reference views into a signal synthesized view. Based on the assessing, a result is determined for a given target pixel in the single synthesized view. The result may be determining a value for the given target pixel, or marking the given target pixel as a hole.

Abstract translation: 几个实现涉及用于3D视频（3DV）应用的启发式视图合并的视图合成。 根据一个方面，基于评估第一和第二候选像素的质量的后向合成过程中的至少一个来评估来自第一翘曲参考视图的第一候选像素和来自第二翘曲参考视图的第二候选像素， 围绕第一和第二候选像素的孔分布，或者围绕指定频率之上的第一和第二候选像素周围的能量量。 评估是将至少第一和第二翘曲参考视图合并为信号合成视图的一部分。 基于评估，在单个合成视图中为给定目标像素确定结果。 结果可能是确定给定目标像素的值，或将给定的目标像素标记为孔。

公开(公告)号：US08611728B2

公开(公告)日：2013-12-17

申请号：US13138384

申请日：2010-01-05

Applicant: Sitaram Bhagavathy ,  Joan Llach

Inventor： Sitaram Bhagavathy ,  Joan Llach

IPC: H04N5/93 ,  H04N9/80 ,  G11B27/00 ,  G06K9/34 ,  G06K9/00 ,  G06K9/74 ,  G06G5/00

CPC classification number: G06T7/254 ,  G06T7/174 ,  G06T2207/10016 ,  G06T2207/20092 ,  G06T2207/20096

Abstract: A method for propagating user-provided foreground-background constraint information for a first video frame to subsequent frames allows extraction of moving foreground objects with minimal user interaction. Video matting is performed wherein constraints derived from user input with respect to a first frame are propagated to subsequent frames using the estimated alpha matte of each frame. The matte of a frame is processed in order to arrive at a rough foreground-background segmentation which is then used for estimating the matte of the next frame. At each frame, the propagated constraints are used by an image matting method for estimating the corresponding matte which is in turn used for propagating the constraints to the next frame, and so on.

Abstract translation: 用于将第一视频帧的用户提供的前景 - 背景约束信息传播到后续帧的方法允许以最小的用户交互提取移动的前景对象。 执行视频消隐，其中从相对于第一帧的用户输入导出的约束使用每帧的估计的α遮罩传播到后续帧。 处理帧的哑光以便获得粗糙的前景 - 背景分割，然后将其用于估计下一帧的无光泽。 在每个帧处，通过图像消隐方法使用传播的约束来估计相应的无光泽，其依次用于将约束传播到下一帧，等等。