公开(公告)号：US10555000B2

公开(公告)日：2020-02-04

申请号：US16434339

申请日：2019-06-07

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Yuxin Liu

IPC: H04N19/53 ,  H04N19/513 ,  H04N19/105 ,  H04N19/11 ,  H04N19/109 ,  H04N19/573

Abstract: Coding a current block using multi-level compound predictor is disclosed. An apparatus includes a memory and a processor. The processor is configured to execute instructions stored in the memory to generate four or more prediction blocks; combine a first prediction block and a second prediction block of the four or more prediction blocks to form a first first-level compound prediction block; combine a third prediction block and a fourth prediction block of the four or more prediction blocks to form a second first-level compound prediction block; and combine, to obtain a prediction block for coding the current block, the first first-level compound prediction block and the second first-level compound prediction block.

公开(公告)号：US10462482B2

公开(公告)日：2019-10-29

申请号：US15420359

申请日：2017-01-31

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Yuxin Liu

IPC: H04N7/12 ,  H04N19/573 ,  H04N19/132 ,  H04N19/56 ,  H04N19/176 ,  H04N19/119 ,  H04N19/20 ,  H04N19/58 ,  H04N19/577

Abstract: Multi-reference compound prediction using masking for encoding and decoding blocks of video frames is described. A mask for segmenting a current block of a current frame of the video sequence into at least a first segment and a second segment is determined using a first set of reference frames. A first predictor using the first set of reference frames is generated for the first segment of the current block. A second predictor is generated for the second segment of the current block using a second set of reference frames, wherein the first set of reference frames is a subset of the second set of reference frames.

公开(公告)号：US20190058880A1

公开(公告)日：2019-02-21

申请号：US15677305

申请日：2017-08-15

Applicant: GOOGLE LLC

Inventor： Yuxin Liu ,  Di Chen ,  Yaowu Xu

IPC: H04N19/105 ,  H04N19/159 ,  H04N19/124 ,  H04N19/61 ,  H04N19/82 ,  H04N19/177 ,  H04N19/36 ,  H04N19/52

CPC classification number: H04N19/105 ,  H04N19/103 ,  H04N19/114 ,  H04N19/124 ,  H04N19/13 ,  H04N19/137 ,  H04N19/159 ,  H04N19/177 ,  H04N19/36 ,  H04N19/51 ,  H04N19/52 ,  H04N19/61 ,  H04N19/82 ,  H04N19/91

Abstract: Groups of video frames can be compressed using reversed ordering. For a group of a video sequence having a display order, a determination is made as to whether to arrange the group in a reversed display order before a prediction process of an encoder for the group. Responsive thereto, the group is arranged in the reversed display order as an input order to the prediction process. Otherwise, the group is provided to the prediction process in the display order as the input order. In performing the prediction process, the group, received in the input order, is arranged in a coding order using a group coding structure that defines at least one backward reference frame for inclusion within a set of candidate reference frames. Multiple backward reference frames may also be defined. The group is predicted in the coding order using the set of candidate reference frames.

公开(公告)号：US20190020888A1

公开(公告)日：2019-01-17

申请号：US15646312

申请日：2017-07-11

Applicant: GOOGLE LLC

Inventor： Yuxin Liu ,  Hui Su

IPC: H04N19/50 ,  H04N19/11 ,  H04N19/105 ,  H04N19/147 ,  H04N19/176 ,  H04N19/593 ,  H04N21/234

Abstract: Compound intra prediction is used to encode or decode blocks of video frames. First and second intra-prediction modes are selected based on motion within the video frame. For example, rate-distortion values resulting from predicting the motion can be determined for combinations of intra-prediction modes. The combination including the first and second intra-prediction modes can be selected based on it resulting in the lowest rate-distortion value. A compound prediction block is generated by combining first and second prediction blocks respectively generated using the first and second intra-prediction modes. For example, combining the first and second prediction blocks can include weighting the pixel values of the first and second prediction blocks or using each of those intra-prediction modes with different partitions of the block to be encoded or decoded. That block is then encoded or decoded using the compound prediction block.

公开(公告)号：US20240333961A1

公开(公告)日：2024-10-03

申请号：US18742180

申请日：2024-06-13

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  James Bankoski ,  Yue Chen ,  Yuxin Liu ,  Sarah Parker

IPC: H04N19/517 ,  H04N19/105 ,  H04N19/136 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182 ,  H04N19/46

CPC classification number: H04N19/517 ,  H04N19/105 ,  H04N19/136 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182 ,  H04N19/46

Abstract: Generating a compound predictor block includes generating a first predictor block and generating a second predictor block. The first predictor block includes a first pixel and the second predictor block includes a second pixel. The first and the second pixels are located at a same location within the first predictor block and the second predictor block, respectively. A first weight is determined for the first pixel based on a difference between a first value of the first pixel and a second value of the second pixel. A second weight is determined for the second pixel based on the first weight. The compound predictor block is generated by combining the first predictor block and the second predictor block. The compound predictor block includes a weighted pixel that is determined based on a weighted sum of the first pixel and the second pixel based on the first weight and the second weight.

公开(公告)号：US12034963B2

公开(公告)日：2024-07-09

申请号：US17731470

申请日：2022-04-28

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  James Bankoski ,  Yue Chen ,  Yuxin Liu ,  Sarah Parker

IPC: H04N11/02 ,  H04N19/105 ,  H04N19/136 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182 ,  H04N19/46 ,  H04N19/517

CPC classification number: H04N19/517 ,  H04N19/105 ,  H04N19/136 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182 ,  H04N19/46

Abstract: Generating a compound predictor block for a current block of video includes generating, for the current block, a first predictor block using one of inter-prediction or intra-prediction and generating a second predictor block. The first predictor block includes a first pixel and the second predictor block includes a second pixel that is co-located with the first pixel. A first weight is determined for the first pixel using a difference between a value of the first pixel and a value of the second pixel. A second weight is determined for the second pixel using the first weight. The compound predictor block is generated by combining the first predictor block and the second predictor block. The compound predictor block includes a weighted pixel that is determined using a weighted sum of the first pixel and the second pixel using the first weight and the second weight.

公开(公告)号：US20240098298A1

公开(公告)日：2024-03-21

申请号：US18521182

申请日：2023-11-28

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  Yuxin Liu ,  Sarah Parker

IPC: H04N19/517 ,  H04N19/17 ,  H04N19/20 ,  H04N19/513 ,  H04N19/54 ,  H04N19/543 ,  H04N19/547 ,  H04N19/557 ,  H04N19/80

CPC classification number: H04N19/517 ,  H04N19/17 ,  H04N19/20 ,  H04N19/521 ,  H04N19/54 ,  H04N19/543 ,  H04N19/547 ,  H04N19/557 ,  H04N19/80

Abstract: Multiple global motion models associated with respective segments of a current frame are decoded from a compressed bitstream. Each global motion model is based on a segmentation of the current frame and represents a respective underlying motion of blocks within a respective segment. Blocks of the current frame are decoded by: for each inter-predicted block of a segment, decoding, form the compressed bitstream, an indication of whether to decode the each inter-predicted block based on a global motion model of the multiple global motion models and associated with the segment, or whether to decode the each inter-predicted block based on a motion vector that is different from the global motion model; and decoding the each inter-predicted block based on the indication.

公开(公告)号：US20190289319A1

公开(公告)日：2019-09-19

申请号：US16434339

申请日：2019-06-07

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Yuxin Liu

IPC: H04N19/53 ,  H04N19/573 ,  H04N19/109 ,  H04N19/513 ,  H04N19/105 ,  H04N19/11

Abstract: Coding a current block using multi-level compound predictor is disclosed. An apparatus includes a memory and a processor. The processor is configured to execute instructions stored in the memory to generate four or more prediction blocks; combine a first prediction block and a second prediction block of the four or more prediction blocks to form a first first-level compound prediction block; combine a third prediction block and a fourth prediction block of the four or more prediction blocks to form a second first-level compound prediction block; and combine, to obtain a prediction block for coding the current block, the first first-level compound prediction block and the second first-level compound prediction block.

公开(公告)号：US11343528B2

公开(公告)日：2022-05-24

申请号：US17073892

申请日：2020-10-19

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  James Bankoski ,  Yue Chen ,  Yuxin Liu ,  Sarah Parker

IPC: H04N11/02 ,  H04N19/517 ,  H04N19/46 ,  H04N19/136 ,  H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182

Abstract: Generating a compound predictor block of a current block of video can include generating, for the current block, predictor blocks comprising a first predictor block including first predictor pixels and a second predictor block including second predictor pixels; using at least a subset of the first predictor pixels to determine a first weight for a first predictor pixel of the first predictor pixels; obtaining a second weight for a second predictor pixel of the second predictor pixels, where the second predictor pixel is co-located with the first predictor pixel; and generating the compound predictor block by combining the first predictor block and the second predictor block, where the predictor block includes a weighted pixel that is determined using a weighted sum of the first predictor pixel and the second predictor pixel using the first weight and the second weight, respectively.

公开(公告)号：US10412383B2

公开(公告)日：2019-09-10

申请号：US15677305

申请日：2017-08-15

Applicant: GOOGLE LLC

Inventor： Yuxin Liu ,  Di Chen ,  Yaowu Xu

IPC: H04N19/00 ,  H04N19/105 ,  H04N19/159 ,  H04N19/124 ,  H04N19/61 ,  H04N19/82 ,  H04N19/177 ,  H04N19/36 ,  H04N19/52 ,  H04N19/51 ,  H04N19/103 ,  H04N19/114 ,  H04N19/137 ,  H04N19/13 ,  H04N19/91

Abstract: Groups of video frames can be compressed using reversed ordering. For a group of a video sequence having a display order, a determination is made as to whether to arrange the group in a reversed display order before a prediction process of an encoder for the group. Responsive thereto, the group is arranged in the reversed display order as an input order to the prediction process. Otherwise, the group is provided to the prediction process in the display order as the input order. In performing the prediction process, the group, received in the input order, is arranged in a coding order using a group coding structure that defines at least one backward reference frame for inclusion within a set of candidate reference frames. Multiple backward reference frames may also be defined. The group is predicted in the coding order using the set of candidate reference frames.