公开(公告)号：US20210084336A1

公开(公告)日：2021-03-18

申请号：US17106898

申请日：2020-11-30

Applicant: GOOGLE LLC

Inventor： Jingning Han ,  James Zern ,  Linfeng Zhang ,  Ching-Han Chiang ,  Yaowu Xu

IPC: H04N19/60 ,  H04N19/129 ,  H04N19/88 ,  H04N19/184 ,  H04N19/13

Abstract: A processor is configured to maintain, for encoding current values related to the transform coefficients a first line buffer and a second line buffer. The current values are arranged along a current scan-order anti-diagonal line. The first line buffer includes first values of a first scan-order anti-diagonal line. The second line buffer includes second values of a second scan-order anti-diagonal line. The processor is further configured to interleave the first values and the second values in a destination buffer; select, using the destination buffer, a probability distribution for coding a current value of the current values; entropy encode, in a compressed bitstream, the current value using the probability distribution; and replace, for coding values of an immediately subsequent scan-order anti-diagonal line to the current scan-order anti-diagonal line, one of the second line buffer or the first line buffer with the current scan-order anti-diagonal line.

公开(公告)号：US10951921B2

公开(公告)日：2021-03-16

申请号：US16776863

申请日：2020-01-30

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Hui Su

IPC: H04N19/00 ,  H04N19/91 ,  H04N19/184 ,  G06F17/18 ,  H04N19/172 ,  H04N19/177 ,  H04N19/176

Abstract: Generating encoded image data using adjustable per-symbol entropy coding probability updating may include generating a portion of the encoded image data in accordance with a value of a probability update indicator for the portion indicating whether per-symbol entropy coding probability updating is disabled for the portion, and including the value of the probability update indicator and the entropy coded image data in an output bitstream. Generating decoded image data using adjustable per-symbol entropy coding probability updating may include obtaining a value of a probability update indicator for a portion of the decoded image data, the value of the probability update indicator for the portion indicating whether per-symbol entropy coding probability updating is disabled for the portion, and generating decoded image data for the portion in accordance with the value of the probability update indicator for the portion.

公开(公告)号：US10798408B2

公开(公告)日：2020-10-06

申请号：US16407297

申请日：2019-05-09

Applicant: GOOGLE LLC

Inventor： James Bankoski ,  Debargha Mukherjee ,  Yaowu Xu

IPC: H04N19/52 ,  H04N19/105 ,  H04N19/176 ,  H04N19/119 ,  H04N19/513 ,  H04N19/136 ,  H04N19/167 ,  H04N19/44

Abstract: A first partitioning for partitioning a first region of a frame before a current frame in a video sequence is determined. The first partitioning defines at least two prediction sub-regions of the first region, and the prediction sub-regions include contiguous, non-overlapping groups of pixels. A motion vector that predicts a prediction sub-region of the first region is determined. The first partitioning is modified to a second partitioning by moving at least one border of the first partitioning that is between adjacent prediction sub-regions of the first region by the motion vector. A current region of the current frame that is collocated with the first region is partitioned by the second partitioning, and is encoded or decoded. The technique eliminates the need to re-partition an entire frame each time, and can be used with both rectangular-shaped block partitioning and partitioning using masks and other partitioning techniques.

公开(公告)号：US10771803B2

公开(公告)日：2020-09-08

申请号：US16379062

申请日：2019-04-09

Applicant: GOOGLE LLC

Inventor： Jingning Han ,  Yaowu Xu ,  James Bankoski ,  Jia Feng

IPC: H04N19/00 ,  H04N19/51 ,  H04N19/196 ,  H04N19/182 ,  H04N19/176 ,  H04N19/513 ,  H04N19/433 ,  H04N19/55

Abstract: A method for decoding an encoded block of an encoded frame includes selecting motion vectors corresponding to blocks of an extended collocated processing unit in a first reference frame; identifying a block of the blocks, such that the encoded block is a projection, using a motion vector of the block that refers to a third reference frame, onto the encoded frame; on condition that a block is identified, determining a temporal motion vector candidate for the encoded block in a second reference frame using a motion vector of the identified block and respective display orders of the encoded frame, the first reference frame, the second reference frame, and the third reference frame, and adding the temporal motion vector candidate to a motion vector candidate list; selecting a motion vector from the motion vector candidate list; generating a prediction block using the selected motion vector for decoding the encoded block.

公开(公告)号：US20200236350A1

公开(公告)日：2020-07-23

申请号：US16838544

申请日：2020-04-02

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Jingning Han ,  Ching-Han Chiang

IPC: H04N19/105 ,  H04N19/167 ,  H04N19/18 ,  H04N19/91 ,  H04N19/13

Abstract: A sign value of a DC coefficient of a current block is determined using neighbor blocks of the current block. First and second sign values are identified as respectively corresponding to an above neighbor block of the current block and a left neighbor block of the current block. A context value is calculated by applying a first weighting value to the first sign value and a second weighting value to the second sign value. The first weighting value is based on a boundary between the above neighbor block and the current block, and the second weighting value is based on a boundary between the left neighbor block and the current block. A probability value is selected based on the context value. The sign value of the DC coefficient of the current block is then determined using the probability model.

公开(公告)号：US10531124B1

公开(公告)日：2020-01-07

申请号：US16016980

申请日：2018-06-25

Applicant: GOOGLE LLC

Inventor： Jingning Han ,  Yaowu Xu

IPC: H04N19/66 ,  H04N19/119 ,  H04N19/176 ,  H04N19/96 ,  H04N19/192 ,  H04N19/50

Abstract: Multi-stage coding block partition search is disclosed. A method includes selecting a partition-none partition type and a partition-split partition type for predicting the block, determining a first cost of predicting the block using the partition-none partition type, and determining a second cost of predicting the block using the partition-split partition type. The partition-none partition type and the partition-split partition type are selected from a set of partition types that includes the partition-none partition type, the partition-split partition type, and third partition types. The method also includes, on condition that the result meets a criterion, determining a respective encoding cost corresponding to at least some of the third partition types; selecting a selected partition type corresponding to a minimal cost amongst the partition-none partition type and the at least some of the third partition types; and encoding, in a compressed bitstream, the selected partition type.

公开(公告)号：US10484707B1

公开(公告)日：2019-11-19

申请号：US16511389

申请日：2019-07-15

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Jingning Han

IPC: H04N19/52 ,  G06T7/20 ,  G06T9/00 ,  H04N19/159 ,  H04N19/139 ,  H04N19/527 ,  H04N19/44 ,  H04N19/109 ,  H04N19/176

Abstract: Candidate motion vectors are identified from previously coded blocks. For each candidate, a distance between a previously coded block associated with the candidate and a current block and a popularity value based previously coded pixels associated with the candidate are determined. Each candidate is ranked within a list according to a priority value, the priority value based on the distance and the popularity value associated with the candidate. The ranking also includes determining reference blocks that share first and second reference frames for decoding the current block using compound prediction, and assigning a higher priority to candidates that share the same combination of the reference frames within the list than combinations of candidates encoded using respective single reference frames of the first reference frame and the second reference frame. The reference motion vector is selected from the list and is used to decode the current block.

公开(公告)号：US20190289319A1

公开(公告)日：2019-09-19

申请号：US16434339

申请日：2019-06-07

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Yuxin Liu

IPC: H04N19/53 ,  H04N19/573 ,  H04N19/109 ,  H04N19/513 ,  H04N19/105 ,  H04N19/11

Abstract: Coding a current block using multi-level compound predictor is disclosed. An apparatus includes a memory and a processor. The processor is configured to execute instructions stored in the memory to generate four or more prediction blocks; combine a first prediction block and a second prediction block of the four or more prediction blocks to form a first first-level compound prediction block; combine a third prediction block and a fourth prediction block of the four or more prediction blocks to form a second first-level compound prediction block; and combine, to obtain a prediction block for coding the current block, the first first-level compound prediction block and the second first-level compound prediction block.

公开(公告)号：US10412410B2

公开(公告)日：2019-09-10

申请号：US15675979

申请日：2017-08-14

Applicant: GOOGLE LLC

Inventor： Jingning Han ,  Yaowu Xu

IPC: H04N5/225 ,  H04N19/573 ,  H04N19/52 ,  H04N19/107 ,  H04N19/172 ,  H04N19/176 ,  H04N19/91 ,  H04N19/82 ,  H04N19/86 ,  H04N19/61 ,  H04N19/70 ,  H04N19/126 ,  H04N19/567 ,  H04N19/577

Abstract: A prediction scheme is selected for encoding or decoding a video block. A first compound motion block can be determined by weighting distances from a first reference frame to the video frame and from a second reference frame to the video frame using one or more quantized weighting coefficients. A second compound motion block can be determined based on an average of pixel values a video block of the first reference frame and pixel values from a video block of the second reference frame. One of the first compound motion block or the second compound motion block is selected and used to generate a prediction block. Alternatively, data encoded to a bitstream including the video frame can be used to determine which compound motion block to use to generate the prediction block. The current block of the video frame is then encoded or decoded using the prediction block.

公开(公告)号：US10390026B2

公开(公告)日：2019-08-20

申请号：US15081082

申请日：2016-03-25

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Hui Su

IPC: H04N19/174 ,  H04N19/159 ,  H04N19/129 ,  H04N19/593 ,  H04N19/103 ,  H04N19/44 ,  H04N19/503 ,  H04N19/65 ,  H04N19/88 ,  H04N19/91 ,  H04N19/192

Abstract: Video data streams can be encoded and decoded using inter or intra prediction. The blocks of a frame can be processed based on depth, from the lowest level sub-blocks to the highest level large blocks, and divided into groups of blocks to be inter predicted, blocks having sub-blocks that are to be inter predicted and sub-blocks that are to be intra predicted, and blocks to be intra predicted, and the blocks to be inter predicted are encoded first, the blocks having sub-blocks to be inter predicted and intra predicted encoded second, and the blocks to be intra predicted encoded last. The availability of data from the inter predicted blocks can improve the performance of intra prediction over processing the blocks in the scan order since more pixel data is available for intra prediction of some blocks.