公开(公告)号：US20240137400A1

公开(公告)日：2024-04-25

申请号：US18403659

申请日：2024-01-03

Applicant: Google LLC

Inventor： Ching Yin Derek Pang ,  Kyrah Felder ,  Akshay Gadde ,  Paul Wilkins ,  Cheng Chen ,  Yao-Chung Lin

IPC: H04L65/70 ,  G06N20/00 ,  H04L65/61 ,  H04L65/80 ,  H04N21/25

CPC classification number: H04L65/70 ,  G06N20/00 ,  H04L65/61 ,  H04L65/80 ,  H04N21/251

Abstract: A media item to be provided to users of a platform is identified. The media item is associated with a media class of one or more media classes. An indication of the media item is provided as input to a machine learning model trained based on historical encoding data to predict, for a given media item, a set of encoder parameter settings that satisfy a performance criterion in view of a respective media class of the given media item. The historical encoding data includes a prior set of encoder parameter settings that satisfied the performance criterion with respect to a prior media item associated with the respective class. Encoder parameter settings that satisfy the performance criterion in view of the media class is determined based on an output of the model. The media item is caused to be encoded using the determined encoder parameter settings.

公开(公告)号：US11870833B2

公开(公告)日：2024-01-09

申请号：US17462591

申请日：2021-08-31

Applicant: Google LLC

Inventor： Ching Yin Derek Pang ,  Kyrah Felder ,  Akshay Gadde ,  Paul Wilkins ,  Cheng Chen ,  Yao-Chung Lin

IPC: H04L65/70 ,  G06N20/00 ,  H04L65/61 ,  H04L65/80 ,  H04N21/25

CPC classification number: H04L65/70 ,  G06N20/00 ,  H04L65/61 ,  H04L65/80 ,  H04N21/251

Abstract: Methods and systems for encoder parameter setting optimization. A media item to be provided to one or more users of a platform is identified. The media item is associated with a media class. An indication of the identified media item is provided as input to a first machine learning model. The first machine learning model is trained to predict, for a given media item, a set of encoder parameter settings that satisfy a performance criterion in view of a respective media class associated with the given media item. One or more outputs of the first machine learning model are obtained. The one or more obtained outputs include encoder data identifying one or more sets of encoder parameter settings and, for each of the sets of encoder parameter settings, an indication of a level of confidence that a respective set of encoder parameter settings satisfies the performance criterion in view of the media class associated with the identified media item. The identified media item is encoded using the respective set of encoding parameter settings associated with the level of confidence that satisfies a confidence criterion.

公开(公告)号：US10652535B1

公开(公告)日：2020-05-12

申请号：US16287881

申请日：2019-02-27

Applicant: GOOGLE LLC

Inventor： Cheng Chen ,  Jingning Han

IPC: H04N19/117 ,  H04N19/172 ,  H04N19/426

Abstract: A memory-efficient filtering approach is used to code images and video. A buffer having a fixed size based on a size of processing units to use for filtering a video frame is allocated. For each of the processing units, pre-filtered pixel values are copied from a respective region of the video frame to the buffer based on a writing point for the video frame and an offset applied to the writing point, filtering is performed against the pre-filtered pixel values from the buffer to produce filtered pixel values, and the filtered pixel values are written to the video frame based on the writing point and the offset. The filtering may be performed using a loop restoration tool, such as where the pre-filtered pixel values are output from a constrained directional enhancement filter (CDEF) tool. Alternatively, the filtering may be performed using the CDEF tool or another coding tool.

公开(公告)号：US20240305802A1

公开(公告)日：2024-09-12

申请号：US18276407

申请日：2021-02-09

Applicant: Google LLC

Inventor： Cheng Chen ,  Jingning Han ,  Hui Su ,  Yaowu Xu

IPC: H04N19/44 ,  H04N19/14 ,  H04N19/176 ,  H04N19/186

CPC classification number: H04N19/44 ,  H04N19/14 ,  H04N19/176 ,  H04N19/186

Abstract: Syntax elements are written to a bitstream to designate bit depth precision for palette mode coding of video blocks. During encoding, a bit depth to use for palette mode coding a current block may be based on an input video signal including the current block or based on some change in bit depth precision. A prediction residual for the current block is encoded to a bitstream along with syntax elements indicative of the bit depth used for the palette mode coding of the current block. In particular, the syntax elements include a first element indicating the palette mode coding bit depth used and a second element indicating whether to apply a bit offset to the palette mode coding bit depth. During decoding, values of the syntax elements are read from the bitstream and used to determine a bit depth for palette mode coding the encoded block.

公开(公告)号：US20200275098A1

公开(公告)日：2020-08-27

申请号：US16858805

申请日：2020-04-27

Applicant: GOOGLE LLC

Inventor： Cheng Chen ,  Jingning Han

IPC: H04N19/117 ,  H04N19/426 ,  H04N19/172

Abstract: A memory-efficient filtering approach is used to code images and video. A buffer having a fixed size based on a size of processing units to use for filtering a video frame is allocated. For each of the processing units, pre-filtered pixel values are copied from a respective region of the video frame to the buffer based on a writing point for the video frame and an offset applied to the writing point, filtering is performed against the pre-filtered pixel values from the buffer to produce filtered pixel values, and the filtered pixel values are written to the video frame based on the writing point and the offset. The filtering may be performed using a loop restoration tool, such as where the pre-filtered pixel values are output from a constrained directional enhancement filter (CDEF) tool. Alternatively, the filtering may be performed using the CDEF tool or another coding tool.

公开(公告)号：US20190394463A1

公开(公告)日：2019-12-26

申请号：US16016768

申请日：2018-06-25

Applicant: GOOGLE LLC

Inventor： Cheng Chen ,  Jingning Han ,  Yaowu Xu

IPC: H04N19/117 ,  H04N19/176 ,  H04N19/46 ,  H04N19/186

Abstract: Systems and methods are disclosed for encoding and decoding video. For example, methods may include: accessing an encoded bitstream; reconstructing an image including multiple color planes based on data from the encoded bitstream; decoding a first filter level from the encoded bitstream, wherein the first filter level specifies one or more thresholds that are used to select a length for a deblocking filter; decoding a second filter level from the encoded bitstream, wherein the second filter level specifies one or more thresholds that are used to select a length for a deblocking filter; after reconstruction of the image, applying a deblocking filter to a first color plane of the image using the first filter level; and, after reconstruction of the image, applying a deblocking filter to a second color plane of the image using the second filter level.

公开(公告)号：US11870983B2

公开(公告)日：2024-01-09

申请号：US16995078

申请日：2020-08-17

Applicant: Google LLC

Inventor： Yaowu Xu ,  Jingning Han ,  Cheng Chen

IPC: H04N19/186 ,  H04N19/117 ,  H04N19/46 ,  H04N19/176

CPC classification number: H04N19/117 ,  H04N19/176 ,  H04N19/186 ,  H04N19/46

Abstract: Techniques for encoding and decoding image data are described. An image is reconstructed and deblocked. A respective deblocking filter is identified for different color planes of the image. The deblocking filters may include those having different lengths for a luma plane as compared to one or more chroma planes of the image. One or more of the color planes, such as the luma plane, may have different filters for filtering reconstructed pixels vertically as compared to filtering the reconstructed pixels horizontally.

公开(公告)号：US20230068026A1

公开(公告)日：2023-03-02

申请号：US17462591

申请日：2021-08-31

Applicant: Google LLC

Inventor： Ching Yin Derek Pang ,  Kyrah Felder ,  Akshay Gadde ,  Paul Wilkins ,  Cheng Chen ,  Yao-Chung Lin

IPC: H04L29/06 ,  H04N21/25 ,  G06N20/00

Abstract: Methods and systems for encoder parameter setting optimization. A media item to be provided to one or more users of a platform is identified. The media item is associated with a media class. An indication of the identified media item is provided as input to a first machine learning model. The first machine learning model is trained to predict, for a given media item, a set of encoder parameter settings that satisfy a performance criterion in view of a respective media class associated with the given media item. One or more outputs of the first machine learning model are obtained. The one or more obtained outputs include encoder data identifying one or more sets of encoder parameter settings and, for each of the sets of encoder parameter settings, an indication of a level of confidence that a respective set of encoder parameter settings satisfies the performance criterion in view of the media class associated with the identified media item. The identified media item is encoded using the respective set of encoding parameter settings associated with the level of confidence that satisfies a confidence criterion.

公开(公告)号：US20200382776A1

公开(公告)日：2020-12-03

申请号：US16995078

申请日：2020-08-17

Applicant: Google LLC

Inventor： Yaowu Xu ,  Jingning Han ,  Cheng Chen

IPC: H04N19/117 ,  H04N19/46 ,  H04N19/186 ,  H04N19/176

Abstract: Techniques for encoding and decoding image data are described. An image is reconstructed and deblocked. A respective deblocking filter is identified for different color planes of the image. The deblocking filters may include those having different lengths for a luma plane as compared to one or more chroma planes of the image. One or more of the color planes, such as the luma plane, may have different filters for filtering reconstructed pixels vertically as compared to filtering the reconstructed pixels horizontally.

公开(公告)号：US11095890B2

公开(公告)日：2021-08-17

申请号：US16858805

申请日：2020-04-27

Applicant: GOOGLE LLC

Inventor： Cheng Chen ,  Jingning Han

IPC: H04N19/117 ,  H04N19/172 ,  H04N19/426

Abstract: A memory-efficient filtering approach is used to code images and video. A buffer having a fixed size based on a size of processing units to use for filtering a video frame is allocated. For each of the processing units, pre-filtered pixel values are copied from a respective region of the video frame to the buffer based on a writing point for the video frame and an offset applied to the writing point, filtering is performed against the pre-filtered pixel values from the buffer to produce filtered pixel values, and the filtered pixel values are written to the video frame based on the writing point and the offset. The filtering may be performed using a loop restoration tool, such as where the pre-filtered pixel values are output from a constrained directional enhancement filter (CDEF) tool. Alternatively, the filtering may be performed using the CDEF tool or another coding tool.