公开(公告)号：US20190132592A1

公开(公告)日：2019-05-02

申请号：US15794134

申请日：2017-10-26

Applicant: GOOGLE LLC

Inventor： Yuxin Liu ,  Di Chen ,  Yaowu Xu

IPC: H04N19/139 ,  H04N19/107 ,  H04N19/172

Abstract: Encoding a group of frames of a video sequence can include determining a stillness of the group of frames, in response to determining that the stillness of the group of frames meets stillness conditions, encoding the group of frames using a coding structure that is a one-layer coding structure, and, in response to determining that the stillness of the group of frames does not meet the stillness conditions, encoding the group of frames using the coding structure that is a multi-layer coding structure. Instructions for decoding a group of frames include instructions to determine, from an encoded bitstream, an indication of a coding structure used to encode the group of frames, receive the group of frames in a coding order of the coding structure, and decode the group of frames using the coding structure. The indication is one of a one-layer coding structure indication or a multi-layer coding structure indication.

公开(公告)号：US20210037254A1

公开(公告)日：2021-02-04

申请号：US17073892

申请日：2020-10-19

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  James Bankoski ,  Yue Chen ,  Yuxin Liu ,  Sarah Parker

IPC: H04N19/517 ,  H04N19/46 ,  H04N19/136 ,  H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182

Abstract: Generating a compound predictor block of a current block of video can include generating, for the current block, predictor blocks comprising a first predictor block including first predictor pixels and a second predictor block including second predictor pixels; using at least a subset of the first predictor pixels to determine a first weight for a first predictor pixel of the first predictor pixels; obtaining a second weight for a second predictor pixel of the second predictor pixels, where the second predictor pixel is co-located with the first predictor pixel; and generating the compound predictor block by combining the first predictor block and the second predictor block, where the predictor block includes a weighted pixel that is determined using a weighted sum of the first predictor pixel and the second predictor pixel using the first weight and the second weight, respectively.

公开(公告)号：US10805629B2

公开(公告)日：2020-10-13

申请号：US15898532

申请日：2018-02-17

Applicant: GOOGLE LLC

Inventor： Yuxin Liu ,  Adrian Grange

IPC: H04N19/527 ,  H04N19/172 ,  H04N19/176 ,  H04N19/61 ,  G06T7/11 ,  G06N3/08 ,  G06T7/238 ,  H04N19/503 ,  H04N19/593 ,  H04N19/17 ,  H04N19/167 ,  G06T7/194 ,  H04N19/103 ,  G06K9/46 ,  G06K9/62 ,  G06T7/40 ,  H04N19/543

Abstract: Regions for texture-based coding are identified using a spatial segmentation and a motion flow segmentation. For frames of a group of frames in a video sequence, a frame is segmented using a first classifier into at least one of a texture region or a non-texture region of an image in the frame. Then, the texture regions of the group of frames are segmented using a second classifier into a texture coding region or a non-texture coding region. The second classifier uses motion across the group of frames as input. Each of the classifiers is generated using a machine-learning process. Blocks of the non-texture region and the non-texture coding region of the current frame are coded using a block-based coding technique, while blocks of the texture coding region are coded using a coding technique that is other than the block-based coding technique.

公开(公告)号：US10701364B2

公开(公告)日：2020-06-30

申请号：US15794134

申请日：2017-10-26

Applicant: GOOGLE LLC

Inventor： Yuxin Liu ,  Di Chen ,  Yaowu Xu

IPC: H04N19/139 ,  H04N19/172 ,  H04N19/107 ,  H04N19/31 ,  H04N19/177 ,  H04N19/109 ,  H04N19/30

Abstract: Encoding a group of frames of a video sequence can include determining a stillness of the group of frames, in response to determining that the stillness of the group of frames meets stillness conditions, encoding the group of frames using a coding structure that is a one-layer coding structure, and, in response to determining that the stillness of the group of frames does not meet the stillness conditions, encoding the group of frames using the coding structure that is a multi-layer coding structure. Instructions for decoding a group of frames include instructions to determine, from an encoded bitstream, an indication of a coding structure used to encode the group of frames, receive the group of frames in a coding order of the coding structure, and decode the group of frames using the coding structure. The indication is one of a one-layer coding structure indication or a multi-layer coding structure indication.

公开(公告)号：US20200092575A1

公开(公告)日：2020-03-19

申请号：US16693425

申请日：2019-11-25

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  Yuxin Liu ,  Sarah Parker

IPC: H04N19/517 ,  H04N19/547 ,  H04N19/543 ,  H04N19/54 ,  H04N19/20 ,  H04N19/17 ,  H04N19/80 ,  H04N19/513 ,  H04N19/557

Abstract: An apparatus for decoding a current block of a video frame includes a memory and a processor. The processor is configured to execute instructions stored in the memory to identify a parameterized motion model; associate the parameterized motion model with a segment of a reference frame; and, in response to determining that the current block is encoded using the parameterized motion model, decode the current block using the parameterized motion model.

公开(公告)号：US20180205964A1

公开(公告)日：2018-07-19

申请号：US15807653

申请日：2017-11-09

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  James Bankoski ,  Yue Chen ,  Yuxin Liu ,  Sarah Parker

IPC: H04N19/517 ,  H04N19/182 ,  H04N19/176 ,  H04N19/105 ,  H04N19/139

Abstract: Generating a compound predictor block of a current block includes generating, for the current block, predictor blocks including a first predictor block formed of first predictor pixels. Using at least a subset of the first predictor pixels, a first modulation value for modulating a first weight to be applied to a first predictor pixel of the first predictor pixels is determined. The compound predictor block is generated using the first predictor pixel, the first weight, and the first modulation value

公开(公告)号：US20220256186A1

公开(公告)日：2022-08-11

申请号：US17731470

申请日：2022-04-28

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  James Bankoski ,  Yue Chen ,  Yuxin Liu ,  Sarah Parker

IPC: H04N19/517 ,  H04N19/46 ,  H04N19/136 ,  H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182

Abstract: Generating a compound predictor block for a current block of video includes generating, for the current block, a first predictor block using one of inter-prediction or intra-prediction and generating a second predictor block. The first predictor block includes a first pixel and the second predictor block includes a second pixel that is co-located with the first pixel. A first weight is determined for the first pixel using a difference between a value of the first pixel and a value of the second pixel. A second weight is determined for the second pixel using the first weight. The compound predictor block is generated by combining the first predictor block and the second predictor block. The compound predictor block includes a weighted pixel that is determined using a weighted sum of the first pixel and the second pixel using the first weight and the second weight.

公开(公告)号：US10827196B2

公开(公告)日：2020-11-03

申请号：US15807653

申请日：2017-11-09

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  James Bankoski ,  Yue Chen ,  Yuxin Liu ,  Sarah Parker

IPC: H04N11/02 ,  H04N19/517 ,  H04N19/46 ,  H04N19/136 ,  H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182

Abstract: Generating a compound predictor block of a current block includes generating, for the current block, predictor blocks including a first predictor block formed of first predictor pixels. Using at least a subset of the first predictor pixels, a first modulation value for modulating a first weight to be applied to a first predictor pixel of the first predictor pixels is determined. The compound predictor block is generated using the first predictor pixel, the first weight, and the first modulation value.

公开(公告)号：US20190261016A1

公开(公告)日：2019-08-22

申请号：US15898532

申请日：2018-02-17

Applicant: GOOGLE LLC

Inventor： Yuxin Liu ,  Adrian Grange

IPC: H04N19/527 ,  H04N19/172 ,  H04N19/176 ,  H04N19/61 ,  G06N3/08 ,  G06T7/11

Abstract: Regions for texture-based coding are identified using a spatial segmentation and a motion flow segmentation. For frames of a group of frames in a video sequence, a frame is segmented using a first classifier into at least one of a texture region or a non-texture region of an image in the frame. Then, the texture regions of the group of frames are segmented using a second classifier into a texture coding region or a non-texture coding region. The second classifier uses motion across the group of frames as input. Each of the classifiers is generated using a machine-learning process. Blocks of the non-texture region and the non-texture coding region of the current frame are coded using a block-based coding technique, while blocks of the texture coding region are coded using a coding technique that is other than the block-based coding technique.

公开(公告)号：US10271062B2

公开(公告)日：2019-04-23

申请号：US15074442

申请日：2016-03-18

Applicant: Google LLC

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  Yuxin Liu

IPC: H04N19/51 ,  H04N19/137 ,  H04N19/577 ,  H04N19/184 ,  H04N19/573 ,  H04N19/44 ,  H04N19/176 ,  H04N19/52 ,  H04N19/463

Abstract: Motion vectors are predicted for a current block of a current frame using motion vectors from previous frames in the video stream. Temporal distances between a current frame and the one or more reference frames used to predict a current block and temporal distances between the previous frame and its reference frames are determined. Temporal distances for current frames and previous frames can be combined to weight the motion vectors and improve motion vector prediction.