公开(公告)号：US09179151B2

公开(公告)日：2015-11-03

申请号：US14057554

申请日：2013-10-18

Applicant: Google Inc.

Inventor： Ronald Sebastiaan Bultje ,  Debargha Mukherjee ,  Yaowu Xu

IPC: G06K9/36 ,  G06K9/46 ,  H04N19/13 ,  H04N19/129 ,  H04N19/91

CPC classification number: H04N19/13 ,  H04N19/129 ,  H04N19/91

Abstract: Encoding and decoding using spatial proximity context entropy coding may include identifying a plurality of transform coefficients for a current block of a current frame of a video stream. The plurality of transform coefficients may be ordered based on a scan order. A current transform coefficient may be identified from the plurality of transform coefficients. A plurality of context coefficients may be identified from the plurality of transform coefficients. Each context coefficient may be spatially proximate to the current transform coefficient and may be available for entropy coding the current transform coefficient. An entropy coding probability for the current transform coefficient may be identified based on the scan order and the plurality of context coefficients. The current transform coefficient may be entropy coded based on the entropy coding probability. The entropy coded current transform coefficient may be included in an output bitstream, which may be stored or transmitted.

Abstract translation: 使用空间邻近度上下文熵编码的编码和解码可以包括识别视频流的当前帧的当前块的多个变换系数。 可以基于扫描顺序对多个变换系数进行排序。 可以从多个变换系数中识别当前变换系数。 可以从多个变换系数中识别多个上下文系数。 每个上下文系数可以在空间上接近当前变换系数，并且可用于对当前变换系数进行熵编码。 可以基于扫描顺序和多个上下文系数来识别当前变换系数的熵编码概率。 可以基于熵编码概率对当前变换系数进行熵编码。 熵编码的电流变换系数可以包括在可以存储或发送的输出比特流中。

公开(公告)号：US20150055706A1

公开(公告)日：2015-02-26

申请号：US13974678

申请日：2013-08-23

Applicant: Google Inc.

Inventor： Yaowu Xu ,  Paul Gordon Wilkins ,  Adrian William Grange ,  Ronald Sebastiaan Bultje

IPC: H04N7/36

CPC classification number: H04N19/52 ,  H04N19/105 ,  H04N19/117 ,  H04N19/124 ,  H04N19/13 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/182 ,  H04N19/184 ,  H04N19/46 ,  H04N19/61

Abstract: Techniques are described to use a reference motion vector to reduce the amount of bits needed to encode motion vectors for inter prediction. One method includes identifying a candidate motion vector used to inter predict each of a plurality of previously coded blocks to define a plurality of candidate motion vectors, identifying a set of reconstructed pixel values corresponding to a set of previously coded pixels for the current block, and generating, using each candidate motion vector, a corresponding set of predicted values for the set of previously coded pixel values within each reference frame of a plurality of reference frames. A respective error value based on a difference between the set of reconstructed pixel values and each set of predicted values is used to select a reference motion vector from the candidate motion vectors that is used to encode the motion vector for the current block.

Abstract translation: 描述技术以使用参考运动矢量来减少编码用于帧间预测的运动矢量所需的位数量。 一种方法包括识别用于相互预测多个先前编码块中的每一个的候选运动矢量，以定义多个候选运动矢量，识别与当前块的一组先前编码像素相对应的一组重建像素值，以及 使用每个候选运动矢量生成多个参考帧的每个参考帧内的先前编码的像素值集合的相应的一组预测值。 使用基于重构像素值集合和每组预测值之间的差的相应误差值从用于编码当前块的运动矢量的候选运动矢量中选择参考运动矢量。

公开(公告)号：US09674530B1

公开(公告)日：2017-06-06

申请号：US13874412

申请日：2013-04-30

Applicant: Google Inc.

Inventor： Ronald Sebastiaan Bultje ,  Debargha Mukherjee ,  Jingning Han

IPC: H04N7/30 ,  H04N19/61 ,  H04N19/176

CPC classification number: H04N19/00793 ,  H04N19/12 ,  H04N19/157 ,  H04N19/176

Abstract: A block of video data can be encoded using intra prediction followed by transforming the generated residual block where the transform size is different from the prediction size. A plurality of transform modes for the residual block is provided whereby the transform subblocks of the residual block are transformed using horizontal and vertical one-dimensional transform types. The transform types may be selected such that their base function corresponds to a pattern in the data of the generated residual block resulting from the intra prediction mode. As a result, the position of each block relative to the peripheral pixels used to generate a prediction block for the block may be used to select the transform types.

公开(公告)号：US20170048543A1

公开(公告)日：2017-02-16

申请号：US15338554

申请日：2016-10-31

Applicant: Google Inc.

Inventor： Adrian William Grange ,  Ronald Sebastiaan Bultje ,  Yaowu Xu ,  Paul Gordon Wilkins

IPC: H04N19/52 ,  H04N19/13 ,  H04N19/105 ,  H04N19/61 ,  H04N19/117 ,  H04N19/159 ,  H04N19/124

CPC classification number: H04N19/52 ,  H04N19/105 ,  H04N19/117 ,  H04N19/124 ,  H04N19/13 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/182 ,  H04N19/184 ,  H04N19/46 ,  H04N19/61

Abstract: Techniques described use a reference motion vector to reduce the amount of bits needed to encode motion vectors for inter prediction. One method includes determining a reference motion vector used to encode a current block of a current frame. The reference motion vector was selected by identifying, multiple candidate motion vectors used to inter predict blocks, and identifying a set of reconstructed pixel values from at least one block adjacent to the current block. For each candidate motion vector, a set of predicted pixel values for the set of reconstructed pixel value is generated using the candidate motion vector and a first reference frame, and an error value is calculated based on a difference between the sets of pixel values. Finally, a reference motion vector from the candidates is selected based on the error values. The method also includes decoding the current block using the reference motion vector.

Abstract translation: 所描述的技术使用参考运动矢量来减少编码用于帧间预测的运动矢量所需的位数量。 一种方法包括确定用于编码当前帧的当前块的参考运动矢量。 通过识别用于相互预测块的多个候选运动矢量以及从与当前块相邻的至少一个块中识别一组重建像素值来选择参考运动矢量。 对于每个候选运动矢量，使用候选运动矢量和第一参考帧生成用于重建像素值集合的一组预测像素值，并且基于像素值集合之间的差计算误差值。 最后，根据误差值选择候选的参考运动矢量。 该方法还包括使用参考运动矢量解码当前块。

公开(公告)号：US20150189269A1

公开(公告)日：2015-07-02

申请号：US14144375

申请日：2013-12-30

Applicant: GOOGLE INC.

Inventor： Jingning Han ,  Ronald Sebastiaan Bultje

IPC: H04N19/91 ,  H04N19/593

CPC classification number: H04N19/91 ,  H04N19/119 ,  H04N19/13 ,  H04N19/147 ,  H04N19/176 ,  H04N19/593

Abstract: In accordance with aspects of the disclosure, systems and methods are provided for dividing an image into regions, applying partition types to each region, determining a rate distortion cost for each region based on partition types applied to each region, determining a coding scheme for each region based on the partition types applied to each region, and separately encoding each region based on the rate distortion cost and coding scheme determined for each region.

Abstract translation: 根据本公开的方面，提供了系统和方法，用于将图像划分为区域，对每个区域应用分区类型，基于应用于每个区域的分区类型确定每个区域的速率失真成本，确定每个区域的编码方案 区域，并且基于为每个区域确定的速率失真成本和编码方案，分别对每个区域进行编码。

公开(公告)号：US20150110409A1

公开(公告)日：2015-04-23

申请号：US14057554

申请日：2013-10-18

Applicant: Google Inc.

Inventor： Ronald Sebastiaan Bultje ,  Debargha Mukherjee ,  Yaowu Xu

IPC: H04N19/13

CPC classification number: H04N19/13 ,  H04N19/129 ,  H04N19/91

Abstract: Encoding and decoding using spatial proximity context entropy coding may include identifying a plurality of transform coefficients for a current block of a current frame of a video stream, wherein the plurality of transform coefficients is ordered based on a scan order, identifying a current transform coefficient from the plurality of transform coefficients, identifying a plurality of context coefficients from the plurality of transform coefficients, wherein each context coefficient from the plurality of context coefficients is spatially proximate to the current transform coefficient and is available for entropy coding the current transform coefficient, identifying an entropy coding probability for the current transform coefficient based on the scan order and the plurality of context coefficients, entropy coding the current transform coefficient based on the entropy coding probability, including the entropy coded current transform coefficient in an output bitstream, and storing or transmitting the output bitstream.

Abstract translation: 使用空间邻近度上下文熵编码的编码和解码可以包括识别视频流的当前帧的当前块的多个变换系数，其中基于扫描顺序对多个变换系数进行排序，从而从 所述多个变换系数从所述多个变换系数中识别多个上下文系数，其中来自所述多个上下文系数的每个上下文系数在空间上接近于当前变换系数，并且可用于对当前变换系数进行熵编码， 基于扫描顺序和多个上下文系数的当前变换系数的熵编码概率，基于熵编码概率熵编码当前变换系数，包括输出比特流中的熵编码电流变换系数，以及存储或者转换 忽略输出比特流。

公开(公告)号：US20150110173A1

公开(公告)日：2015-04-23

申请号：US14056331

申请日：2013-10-17

Applicant: Google Inc.

Inventor： Ronald Sebastiaan Bultje ,  Christian Luc Duvivier

IPC: H04N19/122 ,  H04N19/136 ,  H04N19/18 ,  H04N19/60 ,  H04N19/12

CPC classification number: H04N19/136 ,  H04N19/129 ,  H04N19/176 ,  H04N19/40 ,  H04N19/60 ,  H04N19/61 ,  H04N21/4305

Abstract: Scatter-based scan tables are used to encode and decode video streams. Scatter scan patterns transform coefficients between positions within a 2D array representing a block of a frame and positions within a 1D array for further encoding. By calculating a probability of whether a transform coefficient at a given position in a 2D array is non-zero, a scan order of the 2D array may be defined by a 1D array that groups the values most likely to be zero at the end of the 1D array for removal from a subsequent encoding process. This can reduce the amount of data in an encoded video stream. A decoder can use the same scatter scan pattern to rearrange a sequence of encoded transform coefficients in a 1D array into a 2D array for further decoding of an encoded block.

Abstract translation: 基于散射的扫描表用于对视频流进行编码和解码。 散射扫描图案在表示帧的块和2D阵列内的位置之间的位置之间变换系数，用于进一步的编码。 通过计算2D阵列中的给定位置处的变换系数是否为非零的概率，2D阵列的扫描顺序可以由1D阵列定义，其将最可能为零的值分组 1D数组，用于从后续编码过程中删除。 这可以减少编码视频流中的数据量。 解码器可以使用相同的散射扫描图案将1D阵列中的编码变换系数序列重新排列成2D阵列，以进一步解码编码块。

公开(公告)号：US09813700B1

公开(公告)日：2017-11-07

申请号：US14287442

申请日：2014-05-27

Applicant: Google Inc.

Inventor： Ronald Sebastiaan Bultje

IPC: H04N19/00 ,  H04N19/105 ,  H04N19/159 ,  H04N19/176

CPC classification number: H04N19/00024 ,  H04N5/765 ,  H04N9/80 ,  H04N19/00218 ,  H04N19/00278

Abstract: A method and apparatus for adaptively encoding a media stream with compound prediction are provided. Adaptively encoding a media stream with compound prediction may include decoding a first compound prediction use indicator for decoding a current frame, on a condition that the first compound prediction use indicator indicates that the encoded video stream includes a compound prediction mode for the current block, decoding the compound prediction mode for the current block from the encoded video stream and decoding the current block using the compound prediction mode, and on a condition that the first compound prediction use indicator indicates that the encoded video stream includes a second compound prediction use indicator, decoding the second compound prediction use indicator from the encoded video stream and decoding the current block based on the second compound prediction use indicator; and outputting or storing the decoded current block.

公开(公告)号：US09485515B2

公开(公告)日：2016-11-01

申请号：US13974678

申请日：2013-08-23

Applicant: Google Inc.

Inventor： Yaowu Xu ,  Paul Gordon Wilkins ,  Adrian William Grange ,  Ronald Sebastiaan Bultje

IPC: H04B1/66 ,  H04N19/46 ,  H04N19/52

CPC classification number: H04N19/52 ,  H04N19/105 ,  H04N19/117 ,  H04N19/124 ,  H04N19/13 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/182 ,  H04N19/184 ,  H04N19/46 ,  H04N19/61

Abstract: Techniques are described to use a reference motion vector to reduce the amount of bits needed to encode motion vectors for inter prediction. One method includes identifying a candidate motion vector used to inter predict each of a plurality of previously coded blocks to define a plurality of candidate motion vectors, identifying a set of reconstructed pixel values corresponding to a set of previously coded pixels for the current block, and generating, using each candidate motion vector, a corresponding set of predicted values for the set of previously coded pixel values within each reference frame of a plurality of reference frames. A respective error value based on a difference between the set of reconstructed pixel values and each set of predicted values is used to select a reference motion vector from the candidate motion vectors that is used to encode the motion vector for the current block.

Abstract translation: 描述技术以使用参考运动矢量来减少编码用于帧间预测的运动矢量所需的位数量。 一种方法包括识别用于相互预测多个先前编码块中的每一个的候选运动矢量，以定义多个候选运动矢量，识别与当前块的一组先前编码像素相对应的一组重建像素值，以及 使用每个候选运动矢量生成多个参考帧的每个参考帧内的先前编码的像素值集合的相应的一组预测值。 使用基于重构像素值集合和每组预测值之间的差的相应误差值从用于编码当前块的运动矢量的候选运动矢量中选择参考运动矢量。

公开(公告)号：US09392288B2

公开(公告)日：2016-07-12

申请号：US14056331

申请日：2013-10-17

Applicant: Google Inc.

Inventor： Ronald Sebastiaan Bultje ,  Christian Luc Duvivier

IPC: H04N7/12 ,  H04N19/136 ,  H04N19/61 ,  H04N19/40 ,  H04N21/43 ,  H04N19/129 ,  H04N19/60 ,  H04N19/176

CPC classification number: H04N19/136 ,  H04N19/129 ,  H04N19/176 ,  H04N19/40 ,  H04N19/60 ,  H04N19/61 ,  H04N21/4305

Abstract: Scatter-based scan tables are used to encode and decode video streams. Scatter scan patterns transform coefficients between positions within a 2D array representing a block of a frame and positions within a 1D array for further encoding. By calculating a probability of whether a transform coefficient at a given position in a 2D array is non-zero, a scan order of the 2D array may be defined by a 1D array that groups the values most likely to be zero at the end of the 1D array for removal from a subsequent encoding process. This can reduce the amount of data in an encoded video stream. A decoder can use the same scatter scan pattern to rearrange a sequence of encoded transform coefficients in a 1D array into a 2D array for further decoding of an encoded block.

Abstract translation: 基于散射的扫描表用于对视频流进行编码和解码。 散射扫描图案在表示帧的块和2D阵列内的位置之间的位置之间变换系数，用于进一步的编码。 通过计算2D阵列中的给定位置处的变换系数是否为非零的概率，2D阵列的扫描顺序可以由1D阵列定义，该1D阵列将在最后可能为零的值分组 1D数组，用于从后续编码过程中删除。 这可以减少编码视频流中的数据量。 解码器可以使用相同的散射扫描图案将1D阵列中的编码变换系数序列重新排列成2D阵列，以进一步解码编码块。