Pixel patch collection for prediction in video coding system

    公开(公告)号:US10536726B2

    公开(公告)日:2020-01-14

    申请号:US13463547

    申请日:2012-05-03

    摘要: In a video coding system, an encoder may include a coding engine to predictively code input video, a decoder to reconstruct reference pictures generated by the coding engine, a reference picture cache to store the reconstructed reference pictures, a patch cache to store prediction patches generated from other sources, and a prediction search unit to search among the reference picture cache and the patch cache to generate prediction references for use by the coding engine while coding input video. The prediction patches may be assembled from a variety of sources including: predefined image content, reference pictures being evicted from the reference picture cache, image content of prior coding sessions and image data stored by applications on a common terminal where the encoder resides. A decoder may store prediction patches in its own patch cache for synchronous decoding.

    Adaptive auto exposure adjustment
    2.
    发明授权
    Adaptive auto exposure adjustment 有权
    自适应自动曝光调整

    公开(公告)号:US09402034B2

    公开(公告)日:2016-07-26

    申请号:US13558309

    申请日:2012-07-25

    摘要: Techniques for adjusting exposure parameters of a camera such that video data captured by the camera may be coded efficiently. A camera with auto exposure control may capture and output frames of video. A pre-processor may estimate brightness of the frames of the video output from the camera. A controller may estimate a rate of brightness change among the frames, and when the rate of change is lower than a predetermined threshold, the controller may reduce sensitivity of the auto exposure control. A coding engine may predictively code the video.

    摘要翻译: 用于调整照相机的曝光参数的技术,使得由相机拍摄的视频数据可以被有效地编码。 具有自动曝光控制的照相机可以捕获和输出视频帧。 预处理器可以估计从相机输出的视频的帧的亮度。 控制器可以估计帧之间的亮度变化率,并且当变化率低于预定阈值时,控制器可以降低自动曝光控制的灵敏度。 编码引擎可以预测性地对视频进行编码。

    Optimized search for reference frames in predictive video coding system
    3.
    发明授权
    Optimized search for reference frames in predictive video coding system 有权
    在预测视频编码系统中优化参考帧的搜索

    公开(公告)号:US08989270B2

    公开(公告)日:2015-03-24

    申请号:US13397291

    申请日:2012-02-15

    摘要: A system and method for efficiently performing motion estimation during temporal prediction for coding. When a new frame is presented for coding, an encoder may identify a limited number of pixel blocks within the input frame that are complex. The encoder may perform motion estimation searches to find reference frame(s) that are adequate prediction references for the complex pixel blocks. The encoder may search for prediction references for the remaining pixel blocks of the new frame, confining the search to the reference frame(s) that were selected as prediction references of the complex pixel blocks.

    摘要翻译: 一种用于在编码的时间预测期间有效执行运动估计的系统和方法。 当提供用于编码的新帧时,编码器可以识别输入帧内有限数量的复杂的像素块。 编码器可以执行运动估计搜索以找到作为复数像素块的足够的预测参考的参考帧。 编码器可以搜索新帧的剩余像素块的预测参考,将搜索限制为被选为复数像素块的预测参考的参考帧。

    Complexity-aware encoding
    6.
    发明授权
    Complexity-aware encoding 有权
    复杂性感知编码

    公开(公告)号:US08830092B2

    公开(公告)日:2014-09-09

    申请号:US13156610

    申请日:2011-06-09

    IPC分类号: H03M7/00

    摘要: Techniques for encoding data based at least in part upon an awareness of the decoding complexity of the encoded data and the ability of a target decoder to decode the encoded data are disclosed. In some embodiments, a set of data is encoded based at least in part upon a state of a target decoder to which the encoded set of data is to be provided. In some embodiments, a set of data is encoded based at least in part upon the states of multiple decoders to which the encoded set of data is to be provided.

    摘要翻译: 公开了至少部分地基于编码数据的解码复杂度的意识和目标解码器解码编码数据的能力对数据进行编码的技术。 在一些实施例中,至少部分地基于要提供编码数据集合的目标解码器的状态对数据集进行编码。 在一些实施例中,一组数据至少部分地基于要提供编码数据集的多个解码器的状态进行编码。

    Multi-pass video encoding solution for buffer underflow
    7.
    发明授权
    Multi-pass video encoding solution for buffer underflow 有权
    用于缓冲区下溢的多路视频编码解决方案

    公开(公告)号:US08811475B2

    公开(公告)日:2014-08-19

    申请号:US13437931

    申请日:2012-04-03

    IPC分类号: H04N7/12 H04N7/26

    摘要: A method of encoding a sequence of video images is described. The method receives the sequence of video images. The method iteratively examines different encoding solutions for the sequence of video images to identify an encoding solution that optimizes image quality while meeting a target bit rate and satisfying a set of constraints regarding flow of encoded data through an input buffer of a hypothetical reference decoder for decoding the encoded video sequence. The iterative examining includes, for each encoding solution, determining whether the hypothetical reference decoder underflows while processing the encoding solution for any set of images within the video sequence.

    摘要翻译: 描述了对视频图像序列进行编码的方法。 该方法接收视频图像序列。 该方法迭代地检查视频图像序列的不同编码解决方案,以识别优化图像质量同时满足目标比特率并且通过用于解码的假设参考解码器的输入缓冲器满足编码数据流的一组约束的编码解决方案 编码视频序列。 对于每个编码解决方案,迭代检查包括在处理视频序列内的任何图像集合的编码解决方案的同时确定假想参考解码器是否下溢。

    Adaptive bandwidth estimation
    8.
    发明授权
    Adaptive bandwidth estimation 有权
    自适应带宽估计

    公开(公告)号:US08773993B2

    公开(公告)日:2014-07-08

    申请号:US13085456

    申请日:2011-04-12

    IPC分类号: G08C15/00

    CPC分类号: H04L43/0882 H04L43/10

    摘要: Some embodiments provide a method of combining multiple streams of data packets into a single combined stream in a manner that facilitates accurate estimation of bandwidth of a connection over a network between two devices. When combining the streams into the combined stream, the method associates a set of packets from a first stream and a reference packet from a second stream to form a longer sequence of packets in the combined stream. The method sends the combined stream from a first device to a second device so that the second device can estimate the bandwidth of the connection between the first and second devices based on the inter-arrival times of the packets in the sequence of packets.

    摘要翻译: 一些实施例提供了一种将多个数据分组流合并为单个组合流的方法,其方式是促进通过两个设备之间的网络上的连接的带宽的精确估计。 当将流合并到组合流中时,该方法将来自第一流的一组分组和来自第二个流的参考分组相关联,以在组合流中形成较长的分组序列。 该方法将组合流从第一设备发送到第二设备,使得第二设备可以基于分组序列中的分组的到达之间时间来估计第一和第二设备之间的连接的带宽。

    PREDICTIVE VIDEO CODER WITH LOW POWER REFERENCE PICTURE TRANSFORMATION
    9.
    发明申请
    PREDICTIVE VIDEO CODER WITH LOW POWER REFERENCE PICTURE TRANSFORMATION 有权
    具有低功率参考图像转换的预测视频编码器

    公开(公告)号:US20130329799A1

    公开(公告)日:2013-12-12

    申请号:US13755928

    申请日:2013-01-31

    IPC分类号: H04N7/26

    CPC分类号: H04N19/51 H04N19/503

    摘要: Video coders may perform perspective transformation of reference frames during coding in a manner that conserves processing resources. When a new input frame is available for coding, a camera position for the input frame may be estimated. A video coder may search for reference pictures having similar camera positions as the position of the input frame and, for each reference picture identified, the video coder may perform a prediction search to identify a reference picture that is the best prediction match for the input frame. Once the video coder identifies a reference picture to serve as a prediction source for the input frame, the video coder may derive a transform to match the reference frame data to the input frame data and may transform the reference picture accordingly. The video coder may code the input frame using the transformed reference picture as a prediction reference and may transmit coded frame data and the camera position of the input frame to a decoder. Thus, the video coder may perform derivation and execution of transforms on a limited basis which conserves system resources.

    摘要翻译: 视频编码器可以在编码期间以保存处理资源的方式执行参考帧的透视变换。 当新的输入帧可用于编码时,可以估计用于输入帧的摄像机位置。 视频编码器可以搜索具有与输入帧的位置相似的相机位置的参考图像,并且对于识别的每个参考图像,视频编码器可以执行预测搜索以识别作为输入帧的最佳预测匹配的参考图像 。 一旦视频编码器识别用作输入帧的预测源的参考图像,则视频编码器可以导出将参考帧数据与输入帧数据相匹配的变换,并且可以相应地变换参考图像。 视频编码器可以使用变换的参考图片作为预测参考来对输入帧进行编码,并且可以将编码的帧数据和输入帧的摄像机位置发送到解码器。 因此,视频编码器可以在有限的基础上进行变换的推导和执行,从而节省系统资源。

    Method of implementing improved rate control for a multimedia compression and encoding system
    10.
    发明授权
    Method of implementing improved rate control for a multimedia compression and encoding system 有权
    实现改进的多媒体压缩和编码系统的速率控制的方法

    公开(公告)号:US08477843B2

    公开(公告)日:2013-07-02

    申请号:US13078922

    申请日:2011-04-01

    IPC分类号: H04N7/26 H04N7/30 H04N7/24

    摘要: The rate controller in a digital video encoding system is responsible for allocating a bit budget for video frames to be encoded. The rate controller considers many different factors when determining the frame bit budget. One of the factors considered is the complexity of the frames being compressed. Occasionally there will be a very complex frame that is not representative of the overall video frame sequence. Such a rare complex frame may cause a disproportionate affect on the bit budget allocation. The system of the present invention limits the amount that a very complex frame can change the bit budget allocation. The rate controller of the present invention also includes a relaxation factor. The relaxation factor allows a user to determine if the rate controller should strictly allocate its bit budget or relax its standards such that the rate controller may not be so conservative when allocating bits to frames.

    摘要翻译: 数字视频编码系统中的速率控制器负责为要编码的视频帧分配比特预算。 速率控制器在确定帧位预算时会考虑许多不同的因素。 考虑的因素之一是被压缩的帧的复杂性。 偶尔会有一个非常复杂的帧,不能代表整个视频帧序列。 这种罕见的复杂框架可能会对比特预算分配造成不成比例的影响。 本发明的系统限制了非常复杂的帧可以改变比特预算分配的量。 本发明的速率控制器还包括松弛因子。 松弛因子允许用户确定速率控制器是否应严格分配其位预算或放宽其标准,使得速率控制器在将位分配给帧时可能不那么保守。