公开(公告)号：US09578342B2

公开(公告)日：2017-02-21

申请号：US14087264

申请日：2013-11-22

申请人： Kyeong Ho Yang ,  Sangseok Park

发明人： Kyeong Ho Yang ,  Sangseok Park

IPC分类号： H04N7/24 ,  H04N11/02 ,  H04N19/187 ,  H04N21/2343 ,  H04N7/12 ,  H04N19/124 ,  H04N19/147 ,  H04N19/30 ,  H04N19/132 ,  H04N19/152 ,  H04N19/162

CPC分类号： H04N19/147 ,  H04N19/105 ,  H04N19/124 ,  H04N19/132 ,  H04N19/152 ,  H04N19/162 ,  H04N19/172 ,  H04N19/184 ,  H04N19/187 ,  H04N19/30 ,  H04N19/503

摘要： Systems and methods of performing rate control in scalable video encoders that can be used to provide videoconferencing, announcements, and live video streaming to multiple participant devices having diverse bandwidths, resolutions, and/or other device characteristics. The systems and methods can accommodate different target bit rates of the multiple participant devices by operating on scalable video bitstreams in a multi-layer video format, including a base layer having one or more reference video frames, and an enhancement layer having one or more disposable non-reference, predictive video frames. By adjusting the number of disposable non-reference, predictive video frames in the enhancement layer, as well as quantization parameters for the respective base and enhancement layers, the disclosed systems and methods can accommodate the different target bit rates for the respective participant devices, while enhancing the spatial and/or temporal qualities of the base and enhancement layers in the respective video bitstreams.

摘要翻译： 在可扩展视频编码器中执行速率控制的系统和方法，可用于向具有不同带宽，分辨率和/或其他设备特性的多个参与者设备提供视频会议，通告和实时视频流。 系统和方法可以通过以包括具有一个或多个参考视频帧的基本层的多层视频格式的可缩放视频比特流进行操作来适应多个参与者设备的不同目标比特率，以及具有一个或多个一次性 非参考，预测视频帧。 通过调整增强层中的一次性非参考预测视频帧的数量以及相应的基本和增强层的量化参数，所公开的系统和方法可以适应各个参与者设备的不同的目标比特率，而 增强相应视频比特流中的基本和增强层的空间和/或时间质量。

公开(公告)号：US20140376617A1

公开(公告)日：2014-12-25

申请号：US14087264

申请日：2013-11-22

申请人： Kyeong Ho Yang ,  Sangseok Park

发明人： Kyeong Ho Yang ,  Sangseok Park

IPC分类号： H04N19/187 ,  H04N19/50 ,  H04N19/124

CPC分类号： H04N19/147 ,  H04N19/105 ,  H04N19/124 ,  H04N19/132 ,  H04N19/152 ,  H04N19/162 ,  H04N19/172 ,  H04N19/184 ,  H04N19/187 ,  H04N19/30 ,  H04N19/503

摘要： Systems and methods of performing rate control in scalable video encoders that can be used to provide videoconferencing, announcements, and live video streaming to multiple participant devices having diverse bandwidths, resolutions, and/or other device characteristics. The systems and methods can accommodate different target bit rates of the multiple participant devices by operating on scalable video bitstreams in a multi-layer video format, including a base layer having one or more reference video frames, and an enhancement layer having one or more disposable non-reference, predictive video frames. By adjusting the number of disposable non-reference, predictive video frames in the enhancement layer, as well as quantization parameters for the respective base and enhancement layers, the disclosed systems and methods can accommodate the different target bit rates for the respective participant devices, while enhancing the spatial and/or temporal qualities of the base and enhancement layers in the respective video bitstreams.

摘要翻译： 在可扩展视频编码器中执行速率控制的系统和方法，可用于向具有不同带宽，分辨率和/或其他设备特性的多个参与者设备提供视频会议，通告和实时视频流。 系统和方法可以通过以包括具有一个或多个参考视频帧的基本层的多层视频格式的可缩放视频比特流进行操作来适应多个参与者设备的不同目标比特率，以及具有一个或多个一次性 非参考，预测视频帧。 通过调整增强层中的一次性非参考预测视频帧的数量以及相应的基本和增强层的量化参数，所公开的系统和方法可以适应各个参与者设备的不同的目标比特率，而 增强相应视频比特流中的基本和增强层的空间和/或时间质量。

公开(公告)号：US20170118474A1

公开(公告)日：2017-04-27

申请号：US15401243

申请日：2017-01-09

申请人： Kyeong Ho Yang ,  Sangseok Park

发明人： Kyeong Ho Yang ,  Sangseok Park

IPC分类号： H04N19/147 ,  H04N19/124 ,  H04N19/105 ,  H04N19/503

CPC分类号： H04N19/147 ,  H04N19/105 ,  H04N19/124 ,  H04N19/132 ,  H04N19/152 ,  H04N19/162 ,  H04N19/172 ,  H04N19/184 ,  H04N19/187 ,  H04N19/30 ,  H04N19/503

摘要： Systems and methods of performing rate control in scalable video encoders that can be used to provide videoconferencing, announcements, and live video streaming to multiple participant devices having diverse bandwidths, resolutions, and/or other device characteristics. The systems and methods can accommodate different target bit rates of the multiple participant devices by operating on scalable video bitstreams in a multi-layer video format, including a base layer having one or more reference video frames, and an enhancement layer having one or more disposable non-reference, predictive video frames. By adjusting the number of disposable non-reference, predictive video frames in the enhancement layer, as well as quantization parameters for the respective base and enhancement layers, the disclosed systems and methods can accommodate the different target bit rates for the respective participant devices, while enhancing the spatial and/or temporal qualities of the base and enhancement layers in the respective video bitstreams.

公开(公告)号：US07957600B2

公开(公告)日：2011-06-07

申请号：US11737632

申请日：2007-05-08

申请人： Kyeong Ho Yang

发明人： Kyeong Ho Yang

IPC分类号： G06K9/36

CPC分类号： H04N19/154 ,  H04N19/124 ,  H04N19/13 ,  H04N19/132 ,  H04N19/147 ,  H04N19/176 ,  H04N19/61

摘要： Provided are methods and systems for rate-distortion optimized quantization and for skipping transform blocks that can take into account the rate-distortion tradeoff as well as the perceptual quality of reconstructed video.

摘要翻译： 提供了用于速率失真优化量化的方法和系统，并且用于跳过可以考虑速率失真折衷以及重构视频的感知质量的变换块。

公开(公告)号：US07403562B2

公开(公告)日：2008-07-22

申请号：US11074661

申请日：2005-03-09

申请人： Kyeong Ho Yang ,  Hyung Joon Kim

发明人： Kyeong Ho Yang ,  Hyung Joon Kim

IPC分类号： H04B1/66

CPC分类号： H04N19/194 ,  H04N19/124 ,  H04N19/142 ,  H04N19/149 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/177 ,  H04N19/61

摘要： A rate control algorithm for a predictive video encoder is provided to accurately control the coding rate while requiring a small complexity. The algorithm assumes the video encoder to consist of two processors, pre-processor and main processor, and the rate control located in main processor uses prediction cost and residual cost for each picture that are computed in pre-processor. Prediction cost represents the estimated number of bits needed to generate an error image, and residual cost describes the difficulty of encoding the resultant error image. Accurate and simple rate control is made possible by using a new rate model that adapts to the local characteristic of a video sequence, and by targeting to maintain the quantization parameter as constant as possible in a given set of pictures, GOP, instead of the conventional two step approach.

摘要翻译： 提供用于预测视频编码器的速率控制算法以在需要较小复杂度的情况下精确地控制编码率。 该算法假设视频编码器由两个处理器，预处理器和主处理器组成，并且位于主处理器中的速率控制器使用在预处理器中计算的每个图像的预测成本和剩余成本。 预测成本表示产生误差图像所需的估计位数，剩余成本描述了编码所得误差图像的难度。 通过使用适应视频序列的局部特征的新的速率模型，并且通过在给定的一组图像GOP中将量化参数尽可能地保持为一定的量化参数，而不是常规的，可以实现准确和简单的速率控制 两步法。

公开(公告)号：US06625215B1

公开(公告)日：2003-09-23

申请号：US09326872

申请日：1999-06-07

申请人： Alireza Farid Faryar ,  Moushumi Sen ,  Kyeong Ho Yang

发明人： Alireza Farid Faryar ,  Moushumi Sen ,  Kyeong Ho Yang

IPC分类号： H04B166

CPC分类号： H04N19/507

摘要： A technique is provided for use in a video processing system for selecting between an inter-frame coding mode and an intra-frame coding mode when processing a current portion of a video sequence. The technique includes identifying previously reconstructed samples associated with the current portion from a current frame and a reference frame of the video sequence. Then, a selection is made whether to implement the inter-frame coding technique or the intra-frame coding technique on the current portion based on comparisons associated with the previously reconstructed samples. The technique may be implemented in both a video encoder and a video decoder. As a result, the encoder does not need to transmit coding mode-related overhead information to a corresponding decoder. By way of example, the invention may be implemented in a pixel-based coding system or a block transform-based coding system.

摘要翻译： 提供一种在视频处理系统中用于在处理视频序列的当前部分时在帧间编码模式和帧内编码模式之间进行选择的技术。 该技术包括从视频序列的当前帧和参考帧识别与当前部分相关联的先前重建的样本。 然后，基于与先前重建的样本相关联的比较，选择是否对当前部分实现帧间编码技术或帧内编码技术。 该技术可以在视频编码器和视频解码器中实现。 结果，编码器不需要向对应的解码器发送编码模式相关开销信息。 作为示例，本发明可以在基于像素的编码系统或基于块变换的编码系统中实现。

公开(公告)号：US09628411B2

公开(公告)日：2017-04-18

申请号：US14186239

申请日：2014-02-21

申请人： Kyeong Ho Yang ,  Myo Tun

发明人： Kyeong Ho Yang ,  Myo Tun

IPC分类号： H04L12/939 ,  H04L1/16 ,  H04L29/06 ,  H04N21/442 ,  H04N21/6375 ,  H04N21/6437

CPC分类号： H04L49/552 ,  H04L1/1621 ,  H04L65/608 ,  H04L65/80 ,  H04N21/44209 ,  H04N21/6375 ,  H04N21/6437

摘要： Systems and methods of handling packet errors associated with multimedia data received at data receivers from data senders, in which packet error feedback information is provided by the data receivers to the data senders in one or more real-time transport control protocol (RTCP) feedback packets. The data receivers can calculate, determine, or otherwise obtain costs associated with providing specific forms of packet error feedback information in the RTCP feedback packets, and further calculate, determine, or otherwise obtain wait times for handling out-of-order packets, as well as receiving retransmissions of lost packets. By handling packet errors associated with multimedia data while taking into account such costs and wait times, each of which can have an impact on system bandwidth and/or latency, the systems and methods can more reliably achieve the quality of experience (QoE) generally desired and/or required for multimedia data transmissions.

公开(公告)号：US06680974B1

公开(公告)日：2004-01-20

申请号：US09452990

申请日：1999-12-02

申请人： Alireza Farid Faryar ,  Moushumi Sen ,  Kyeong Ho Yang

发明人： Alireza Farid Faryar ,  Moushumi Sen ,  Kyeong Ho Yang

IPC分类号： H04B166

CPC分类号： H04N19/126 ,  H04N19/593 ,  H04N19/60

摘要： A technique for use in a block transform-based coding system of processing (e.g., encoding and/or decoding) one or more block transform coefficients associated with at least one block of visual data (e.g., an image and/or video sequence) comprises the following steps. First, one or more previously reconstructed block transform coefficients associated with the visual data are identified. Then, a context selection value is computed for use in processing a block transform coefficient associated with the at least one block, the context selection value being based on the one or more previously reconstructed block transform coefficients. The context selection value may be computed as a function of one or more values respectively associated with one or more previously reconstructed block transform coefficients in near proximity, with respect to a scanning order, to the block transform coefficient to be processed. Further, the context selection value may be computed as a function of a spatial frequency associated with the block transform coefficient. Still further, the context selection value may be computed as a function of both the one or more values respectively associated with the one or more previously reconstructed block transform coefficients in near scanning order proximity and the spatial frequency associated with the block transform coefficient.

摘要翻译： 一种用于在与至少一个视觉数据块（例如，图像和/或视频序列）相关联的一个或多个块变换系数的处理（例如，编码和/或解码）块变换的编码系统中的技术包括 以下步骤。 首先，识别与视觉数据相关联的一个或多个先前重构的块变换系数。 然后，计算上下文选择值以用于处理与至少一个块相关联的块变换系数，上下文选择值基于一个或多个先前重构的块变换系数。 上下文选择值可以作为与将要处理的块变换系数相对于扫描顺序的接近的一个或多个先前重构的块变换系数分别相关联的一个或多个值的函数来计算。 此外，可以根据与块变换系数相关联的空间频率来计算上下文选择值。 另外，上下文选择值可以被计算为分别与近扫描顺序接近度中的一个或多个先前重构的块变换系数和与块变换系数相关联的空间频率分别相关联的一个或多个值的函数。

公开(公告)号：US09756356B2

公开(公告)日：2017-09-05

申请号：US14307860

申请日：2014-06-18

申请人： Kyeong Ho Yang ,  Myo Tun ,  Ashwini Kumar

发明人： Kyeong Ho Yang ,  Myo Tun ,  Ashwini Kumar

IPC分类号： H04N19/513 ,  H04N19/895

CPC分类号： H04N19/521 ,  H04N19/895

摘要： Systems and methods that employ an application-assisted approach to adaptive spatio-temporal error concealment in video decoders. The systems and methods employ a video receiver that can receive real-time video frames from a video transmitter over a wired and/or wireless network. The video receiver includes an end system configurable as an application for consuming the content of the real-time video frames. The end system application can determine whether each received real-time video frame is complete or incomplete, whether each received slice is complete or incomplete, and provide such information to the video decoder for use in avoiding errors while decoding the respective real-time video frames. The video decoder can determine whether any pixel blocks included in real-time video packets are properly decoded or missing, generate statistics regarding the coding mode of the respective pixel blocks, and use such further information while performing adaptive spatio-temporal error concealment on the respective pixel blocks.

公开(公告)号：US20150244650A1

公开(公告)日：2015-08-27

申请号：US14186239

申请日：2014-02-21

申请人： Kyeong Ho Yang ,  Myo Tun

发明人： Kyeong Ho Yang ,  Myo Tun

IPC分类号： H04L12/939 ,  H04L29/06 ,  H04N5/44 ,  H04L1/16

CPC分类号： H04L49/552 ,  H04L1/1621 ,  H04L65/608 ,  H04L65/80 ,  H04N21/44209 ,  H04N21/6375 ,  H04N21/6437

摘要： Systems and methods of handling packet errors associated with multimedia data received at data receivers from data senders, in which packet error feedback information is provided by the data receivers to the data senders in one or more real-time transport control protocol (RTCP) feedback packets. The data receivers can calculate, determine, or otherwise obtain costs associated with providing specific forms of packet error feedback information in the RTCP feedback packets, and further calculate, determine, or otherwise obtain wait times for handling out-of-order packets, as well as receiving retransmissions of lost packets. By handling packet errors associated with multimedia data while taking into account such costs and wait times, each of which can have an impact on system bandwidth and/or latency, the systems and methods can more reliably achieve the quality of experience (QoE) generally desired and/or required for multimedia data transmissions.

摘要翻译： 处理与来自数据发送器的数据接收器处接收的多媒体数据相关联的分组错误的系统和方法，其中数据接收器向一个或多个实时传输控制协议（RTCP）反馈分组中的数据发送器提供分组错误反馈信息 。 数据接收器可以计算，确定或以其他方式获得与在RTCP反馈分组中提供特定形式的分组错误反馈信息相关的成本，并且进一步计算，确定或以其他方式获得处理无序分组的等待时间，以及 作为接收丢失数据包的重传。 通过处理与多媒体数据相关联的分组错误，同时考虑到这些成本和等待时间，其中每一个可能对系统带宽和/或延迟产生影响，系统和方法可以更可靠地实现通常期望的体验质量（QoE） 和/或多媒体数据传输所需的。