公开(公告)号：US10390026B2

公开(公告)日：2019-08-20

申请号：US15081082

申请日：2016-03-25

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Hui Su

IPC: H04N19/174 ,  H04N19/159 ,  H04N19/129 ,  H04N19/593 ,  H04N19/103 ,  H04N19/44 ,  H04N19/503 ,  H04N19/65 ,  H04N19/88 ,  H04N19/91 ,  H04N19/192

Abstract: Video data streams can be encoded and decoded using inter or intra prediction. The blocks of a frame can be processed based on depth, from the lowest level sub-blocks to the highest level large blocks, and divided into groups of blocks to be inter predicted, blocks having sub-blocks that are to be inter predicted and sub-blocks that are to be intra predicted, and blocks to be intra predicted, and the blocks to be inter predicted are encoded first, the blocks having sub-blocks to be inter predicted and intra predicted encoded second, and the blocks to be intra predicted encoded last. The availability of data from the inter predicted blocks can improve the performance of intra prediction over processing the blocks in the scan order since more pixel data is available for intra prediction of some blocks.

公开(公告)号：US10382767B2

公开(公告)日：2019-08-13

申请号：US15656270

申请日：2017-07-21

Applicant: GOOGLE LLC

Inventor： Yi Luo ,  Hui Su

IPC: H04N19/17 ,  H04N19/10 ,  H04N19/00 ,  H04N19/176 ,  H04N19/159 ,  H04N19/172 ,  H04N19/119 ,  H04N19/147 ,  H04N19/61 ,  H04N19/88

Abstract: Video frames are rotated for encoding and decoding blocks therein. During an encoding process, a number of degrees to rotate a video frame is determined. The video frame is rotated to produce rotated pixel values. A prediction residual is then generated for a block to be encoded based on the rotated pixel values. That block is encoded based on the prediction residual. During a decoding process, an encoded block is decoded to produce inverse transform pixel values, and a number of degrees to inverse rotate an encoded video frame is determined. The encoded video frame is inverse rotated to produce inverse rotated pixel values corresponding to the inverse transform pixel values. The inverse rotated pixel values are then outputted to an output video stream. One or more syntax elements indicating the number of degrees can be encoded to a bitstream during encoding and decoded from the bitstream during decoding.

公开(公告)号：US20240388690A1

公开(公告)日：2024-11-21

申请号：US18576733

申请日：2021-07-15

Applicant: Google LLC

Inventor： Yue Chen ,  Yu Wang ,  Hui Su ,  Debargha Mukherjee ,  Yunqing Wang

IPC: H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/52

Abstract: Video coding using warped motion compensation is described. Extended rotations for the warped motion compensation can be explicitly signaled. For example, motion parameters for predicting the current block and a rotation angle can be decoded. A warping matrix is obtained using the motion parameters and the rotation angle, and a prediction block is obtained by projecting the current block to a quadrilateral in a reference frame. Also described is determining a prediction model of the current block and obtaining a prediction block by projecting the current block to a quadrilateral in a reference frame. Determining the prediction model can include determining whether to predict the current block using a motion vector, a local warping model, or a global motion model, obtaining motion parameters of the prediction model, decoding a rotation angle, and obtaining a warping matrix using the motion parameters and the rotation angle.

公开(公告)号：US20240314345A1

公开(公告)日：2024-09-19

申请号：US18577831

申请日：2021-07-15

Applicant: GOOGLE LLC

Inventor： Hui Su ,  Debargha Mukherjee

IPC: H04N19/513 ,  H04N19/105 ,  H04N19/119 ,  H04N19/139 ,  H04N19/159 ,  H04N19/176

CPC classification number: H04N19/513 ,  H04N19/105 ,  H04N19/119 ,  H04N19/139 ,  H04N19/159 ,  H04N19/176

Abstract: A method for inter-prediction includes coding a first block of a current frame using a first motion vector (MV) and a reference frame type; storing, in at least one MV buffer, the first MV and the reference frame type; identifying MV candidates for coding a current block using the reference frame type; responsive to a determination that a cardinality of the MV candidates is less than a maximum number of MV candidates identifying the first motion vector in the at least one MV buffer, and responsive to a determination that the first MV is not included in the MV candidates, adding the first MV as an MV candidate; and selecting one of the MV candidates for coding the current block.

公开(公告)号：US20200275130A1

公开(公告)日：2020-08-27

申请号：US16838539

申请日：2020-04-02

Applicant: GOOGLE LLC

Inventor： Alexander Bokov ,  Hui Su

IPC: H04N19/70 ,  H04N19/176 ,  G06T9/00 ,  H04N19/13 ,  H04N19/61 ,  G06K9/46 ,  H04N19/18 ,  H04N19/14

Abstract: Machine learning is used to refine a probability distribution for entropy coding video or image data. A probability distribution is determined for symbols associated with a video block (e.g., quantized transform coefficients, such as during encoding, or syntax elements from a bitstream, such as during decoding), and a set of features is extracted from video data associated with the video block and/or neighbor blocks. The probability distribution and the set of features are then processed using machine learning to produce a refined probability distribution. The video data associated with a video block are entropy coded according to the refined probability distribution. Using machine learning to refine the probability distribution for entropy coding minimizes the cross-entropy loss between the symbols to entropy code and the refined probability distribution.

公开(公告)号：US20200275095A1

公开(公告)日：2020-08-27

申请号：US16287969

申请日：2019-02-27

Applicant: GOOGLE LLC

Inventor： Alexander Bokov ,  Hui Su

IPC: H04N19/11 ,  H04N19/184 ,  H04N19/117

Abstract: A method for generating a prediction block for coding a block of a frame using intra prediction. The method includes determining, using a training region, filter coefficients for generating the prediction block, the training region neighbors the block and includes a plurality of reconstructed pixels, the filter coefficients minimize a function of differences, each difference being a respective difference between a pixel in the training region and a prediction of that pixel in the training region, and the predictions use the filter coefficients; and generating the prediction block using the determined filter coefficients.

公开(公告)号：US20200252656A1

公开(公告)日：2020-08-06

申请号：US16776863

申请日：2020-01-30

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Hui Su

IPC: H04N19/91 ,  H04N19/176 ,  H04N19/177 ,  H04N19/172 ,  G06F17/18 ,  H04N19/184

Abstract: Generating encoded image data using adjustable per-symbol entropy coding probability updating may include generating a portion of the encoded image data in accordance with a value of a probability update indicator for the portion indicating whether per-symbol entropy coding probability updating is disabled for the portion, and including the value of the probability update indicator and the entropy coded image data in an output bitstream. Generating decoded image data using adjustable per-symbol entropy coding probability updating may include obtaining a value of a probability update indicator for a portion of the decoded image data, the value of the probability update indicator for the portion indicating whether per-symbol entropy coding probability updating is disabled for the portion, and generating decoded image data for the portion in accordance with the value of the probability update indicator for the portion.

公开(公告)号：US10567807B1

公开(公告)日：2020-02-18

申请号：US16266486

申请日：2019-02-04

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Hui Su

IPC: H04N19/00 ,  H04N19/91 ,  H04N19/184 ,  G06F17/18 ,  H04N19/172 ,  H04N19/177 ,  H04N19/176

Abstract: Decoding encoded image data using adjustable per-symbol entropy coding probability updating may include identifying a probability update indicator indicating whether per-symbol entropy coding probability updating is enabled, identifying current entropy coding probabilities, identifying a current entropy coded representation of a current symbol, generating the current symbol by entropy decoding the current entropy coded representation of the current symbol based on the current entropy coding probabilities, in response to a determination that the probability update indicator indicates that per-symbol entropy coding probability updating is enabled for the current portion, generating updated entropy coding probabilities based on the current symbol and the current entropy coding probabilities, generating a decoded current portion using the current symbol, including the decoded current portion in the decoded image data, and outputting the decoded image data.

公开(公告)号：US20190028714A1

公开(公告)日：2019-01-24

申请号：US15656270

申请日：2017-07-21

Applicant: GOOGLE LLC

Inventor： Yi Luo ,  Hui Su

IPC: H04N19/176 ,  H04N19/172 ,  H04N19/159

CPC classification number: H04N19/176 ,  H04N19/119 ,  H04N19/147 ,  H04N19/159 ,  H04N19/17 ,  H04N19/172 ,  H04N19/61 ,  H04N19/88

Abstract: Video frames are rotated for encoding and decoding blocks therein. During an encoding process, a number of degrees to rotate a video frame is determined. The video frame is rotated to produce rotated pixel values. A prediction residual is then generated for a block to be encoded based on the rotated pixel values. That block is encoded based on the prediction residual. During a decoding process, an encoded block is decoded to produce inverse transform pixel values, and a number of degrees to inverse rotate an encoded video frame is determined. The encoded video frame is inverse rotated to produce inverse rotated pixel values corresponding to the inverse transform pixel values. The inverse rotated pixel values are then outputted to an output video stream. One or more syntax elements indicating the number of degrees can be encoded to a bitstream during encoding and decoded from the bitstream during decoding.

公开(公告)号：US20190020888A1

公开(公告)日：2019-01-17

申请号：US15646312

申请日：2017-07-11

Applicant: GOOGLE LLC

Inventor： Yuxin Liu ,  Hui Su

IPC: H04N19/50 ,  H04N19/11 ,  H04N19/105 ,  H04N19/147 ,  H04N19/176 ,  H04N19/593 ,  H04N21/234

Abstract: Compound intra prediction is used to encode or decode blocks of video frames. First and second intra-prediction modes are selected based on motion within the video frame. For example, rate-distortion values resulting from predicting the motion can be determined for combinations of intra-prediction modes. The combination including the first and second intra-prediction modes can be selected based on it resulting in the lowest rate-distortion value. A compound prediction block is generated by combining first and second prediction blocks respectively generated using the first and second intra-prediction modes. For example, combining the first and second prediction blocks can include weighting the pixel values of the first and second prediction blocks or using each of those intra-prediction modes with different partitions of the block to be encoded or decoded. That block is then encoded or decoded using the compound prediction block.