Video decoding using point sprites

    公开(公告)号:US10237566B2

    公开(公告)日:2019-03-19

    申请号:US15089310

    申请日:2016-04-01

    Abstract: A GPU loads point sprites that represent coded blocks of transform coefficients of one or more frames encoded in a bitstream and loads a transform kernel as a transform kernel texture. The GPU constructs an output frame using an inverse transform on the coded blocks of transform coefficients by transforming the point sprites with the transform kernel texture and by optionally dequantizing the point sprites. A single render pass may be used in which the rasterization formula performs the inverse transform and optionally dequantization. To preserve bandwidth, a CPU may refrain from sending the GPU at least some zero valued transform coefficients for the point sprites. Also, to reduce processing, the transform coefficients can remain in a zig-zag arrangement. The transform kernel texture used in the decoding can correspond to a modified version of the basis matrices used to encode the frame, which compensates for the zig-zag arrangement.

    Multi-stage image classification
    3.
    发明授权

    公开(公告)号:US09704066B2

    公开(公告)日:2017-07-11

    申请号:US14664662

    申请日:2015-03-20

    CPC classification number: G06K9/6268 G06K9/4642 G06K9/6267

    Abstract: Techniques are described for performing multi-stage image classification. For example, multi-stage image classification can comprise a first classification stage and a second classification stage. The first classification stage can determine an overall classification for an input image (e.g., based on a relative entropy result calculated for the input image). The second classification stage can be performed by dividing the image into a plurality of blocks and classifying individual blocks, or groups of blocks, based on a classification model that is specific to the overall classification of the image determined in the first classification stage.

    GRADUAL UPDATING USING TRANSFORM COEFFICIENTS FOR ENCODING AND DECODING
    4.
    发明申请
    GRADUAL UPDATING USING TRANSFORM COEFFICIENTS FOR ENCODING AND DECODING 有权
    使用变换系数进行编码和解码的梯度更新

    公开(公告)号:US20160212425A1

    公开(公告)日:2016-07-21

    申请号:US14598668

    申请日:2015-01-16

    Abstract: Innovations are provided for encoding and/or decoding video and/or image content using transform coefficient level gradual updating. Transform coefficient level gradual updating can be applied by encoding (or decoding) different subsets of the transform coefficients for the blocks, macroblocks, or other coding unit for each of a sequence of pictures. For example, a first subset of the transform coefficients of the blocks of a first picture can be encoded with the first picture, a second subset of the transform coefficients of the blocks of a second picture can be encoded with the second picture, and so on. A decoder can reconstruct pictures with increasing quality by receiving additional subsets of the transform coefficients.

    Abstract translation: 提供了使用变换系数级逐渐更新对视频和/或图像内容进行编码和/或解码的创新。 可以通过对于图像序列中的每一个对块,宏块或其他编码单元的变换系数的不同子集进行编码(或解码)来应用变换系数级逐渐更新。 例如,第一图像的块的变换系数的第一子集可以用第一图像编码,第二图像的块的变换系数的第二子集可以用第二图像编码,等等 。 解码器可以通过接收变换系数的附加子集来以更高的质量重建图像。

    Dynamically updating quality to higher chroma sampling rate

    公开(公告)号:US10044974B2

    公开(公告)日:2018-08-07

    申请号:US15822590

    申请日:2017-11-27

    Abstract: Innovations in encoding of video pictures in a high-resolution chroma sampling format (such as YUV 4:4:4) using a video encoder operating on coded pictures in a low-resolution chroma sampling format (such as YUV 4:2:0) are presented. For example, according to a set of decision rules, high chroma resolution details are selectively encoded on a region-by-region basis such that increases in bit rate (due to encoding of sample values for the high chroma resolution details) happen when and where corresponding increases in chroma resolution are likely to improve quality in noticeable ways. In this way, available encoders operating on coded pictures in the low-resolution chroma sampling format can be effectively used to provide high chroma resolution details.

    ENCODING/DECODING OF HIGH CHROMA RESOLUTION DETAILS
    7.
    发明申请
    ENCODING/DECODING OF HIGH CHROMA RESOLUTION DETAILS 有权
    编码/解码高分辨率细节

    公开(公告)号:US20160212433A1

    公开(公告)日:2016-07-21

    申请号:US14599416

    申请日:2015-01-16

    Abstract: Innovations in encoding and decoding of video pictures in a high-resolution chroma sampling format (such as YUV 4:4:4) using a video encoder and decoder operating on coded pictures in a low-resolution chroma sampling format (such as YUV 4:2:0) are presented. For example, high chroma resolution details are selectively encoded on a region-by-region basis. Or, as another example, coded pictures that contain sample values for low chroma resolution versions of input pictures and coded pictures that contain sample values for high chroma resolution details of the input pictures are encoded as separate sub-sequences of a single sequence of coded pictures, which can facilitate effective motion compensation. In this way, available encoders and decoders operating on coded pictures in the low-resolution chroma sampling format can be effectively used to provide high chroma resolution details.

    Abstract translation: 使用以低分辨率色度采样格式(例如YUV 4:4:4)对编码图像进行操作的视频编码器和解码器以高分辨率色度采样格式(例如YUV 4:4:4)对视频图像进行编码和解码的创新, 2:0)。 例如,高色度分辨率细节在逐个区域的基础上被有选择地编码。 或者,作为另一示例,包含输入图像的低色度分辨率版本的输入图像的编码图像和包含用于输入图像的高色度分辨率细节的采样值的编码图像的编码图像被编码为单个编码图像序列的单独子序列 ,可以促进有效的运动补偿。 以这种方式,可以有效地使用以低分辨率色度采样格式对编码图像进行操作的可用编码器和解码器来提供高色度分辨率细节。

    DYNAMICALLY UPDATING QUALITY TO HIGHER CHROMA SAMPLING RATE
    8.
    发明申请
    DYNAMICALLY UPDATING QUALITY TO HIGHER CHROMA SAMPLING RATE 有权
    动态更新质量达到更高的色谱采样率

    公开(公告)号:US20160212373A1

    公开(公告)日:2016-07-21

    申请号:US14599412

    申请日:2015-01-16

    Abstract: Innovations in encoding of video pictures in a high-resolution chroma sampling format (such as YUV 4:4:4) using a video encoder operating on coded pictures in a low-resolution chroma sampling format (such as YUV 4:2:0) are presented. For example, according to a set of decision rules, high chroma resolution details are selectively encoded on a region-by-region basis such that increases in bit rate (due to encoding of sample values for the high chroma resolution details) happen when and where corresponding increases in chroma resolution are likely to improve quality in noticeable ways. In this way, available encoders operating on coded pictures in the low-resolution chroma sampling format can be effectively used to provide high chroma resolution details.

    Abstract translation: 使用以低分辨率色度采样格式(例如YUV 4:2:0)编码图像操作的视频编码器以高分辨率色度采样格式(例如YUV 4:4:4)编码视频图像的创新, 被呈现。 例如,根据一组决策规则,在逐个区域的基础上选择性地编码高色度分辨率细节,使得比特率的增加(由于对高色度分辨率细节的采样值的编码)发生在何时何地 色度分辨率的相应增加可能以明显的方式提高质量。 以这种方式,可以有效地使用以低分辨率色度采样格式操作在编码图像上的可用编码器来提供高色度分辨率细节。

    PROGRESSIVE UPDATES WITH MOTION
    9.
    发明申请

    公开(公告)号:US20170300312A1

    公开(公告)日:2017-10-19

    申请号:US15097991

    申请日:2016-04-13

    Abstract: Non-limiting examples of the present disclosure describe detection of gross motion of a region of content. Gross motion of a region of content may be detected. A determination may be made as to a current quality level of the region. Based on detection of the gross motion, residual values may be generated for a progressive update of the region. The residual values are generated using the current quality level of the region as a base to determine a quantization update for a progressive update of the region at a higher quality level as compared with the current quality level of the region. Frame data for the progressive update of the region may be encoded. The frame data may comprise the residual values and motion vectors for progressive update of the region. The frame data may be transmitted for decoding. Other examples are also described.

    Multi-stage image classification
    10.
    发明授权

    公开(公告)号:US09785865B2

    公开(公告)日:2017-10-10

    申请号:US15483671

    申请日:2017-04-10

    CPC classification number: G06K9/6268 G06K9/4642 G06K9/6267

    Abstract: Techniques are described for performing multi-stage image classification. For example, multi-stage image classification can comprise a first classification stage and a second classification stage. The first classification stage can determine an overall classification for an input image (e.g., based on a relative entropy result calculated for the input image). The second classification stage can be performed by dividing the image into a plurality of blocks and classifying individual blocks, or groups of blocks, based on a classification model that is specific to the overall classification of the image determined in the first classification stage.

Patent Agency Ranking