公开(公告)号：US20240292021A1

公开(公告)日：2024-08-29

申请号：US18656099

申请日：2024-05-06

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu

IPC: H04N19/573 ,  H04N19/174 ,  H04N19/52

CPC classification number: H04N19/573 ,  H04N19/174 ,  H04N19/52

Abstract: Disclosed herein are representative embodiments of generating representative motion information that can be used during processing of a video frame. In one exemplary embodiment disclosed herein, a reference frame comprising a group of blocks is processed, and motion information for the group of blocks is compressed at least by buffering representative motion-vector information and representative reference-frame index information for the group of blocks. The representative reference-frame index information comprises reference-frame index information of a representative block of the group of blocks, and the representative reference-frame index information represents reference-frame index information for the group of blocks during processing of a current frame.

公开(公告)号：US20230269382A1

公开(公告)日：2023-08-24

申请号：US18141874

申请日：2023-05-01

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu ,  Gary J. Sullivan

IPC: H04N19/186 ,  H04N19/176 ,  H04N19/70 ,  H04N19/126 ,  H04N1/64 ,  H04N19/184

CPC classification number: H04N19/186 ,  H04N19/176 ,  H04N19/70 ,  H04N19/126 ,  H04N1/644 ,  H04N19/184

Abstract: Innovations in encoding or decoding when switching color spaces are presented. For example, some of the innovations relate to signaling of control information for adaptive color space transformation (“ACT”). Other innovations relate to ACT operations. These innovations can improve coding efficiency when switching between color spaces during encoding and decoding.

公开(公告)号：US20220217331A1

公开(公告)日：2022-07-07

申请号：US17701342

申请日：2022-03-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu ,  Jiahao Li

IPC: H04N19/105 ,  H04N19/176 ,  H04N19/593 ,  H04N19/147 ,  H04N19/117 ,  H04N19/82 ,  H04N19/11 ,  H04N19/159

Abstract: Innovations in intra-picture prediction with multiple candidate reference lines available are described herein. For example, intra-picture prediction for a current block uses a non-adjacent reference line of sample values to predict the sample values of the current block. This can improve the effectiveness of the intra-picture prediction when the reference line of sample values that is adjacent the current block includes significant capture noise, significant quantization error, or significantly different values (compared to the current block) due to an occlusion. Innovations described herein include, but are not limited to, the following: intra-picture prediction with multiple candidate reference lines available; encoding/decoding of reference line indices using prediction; filtering of reference sample values; residue compensation; weighted prediction; mode-dependent padding to replace unavailable reference sample values; using in-loop-filtered reference sample values; encoder-side decisions for selecting reference lines; and post-filtering of predicted sample values.

公开(公告)号：US20220201326A1

公开(公告)日：2022-06-23

申请号：US17691802

申请日：2022-03-10

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu ,  Gary J. Sullivan

IPC: H04N19/52 ,  H04N19/56 ,  H04N19/91 ,  H04N19/82 ,  H04N19/57 ,  H04N19/86 ,  H04N19/593

Abstract: Innovations in intra block copy (“BC”) prediction mode facilitate intra BC prediction that is more effective in terms of rate-distortion performance and/or computational efficiency of encoding and decoding. For example, some of the innovations provide ways to select block vector (“BV”) values more effectively. Other innovations provide ways to encode/decode BV values more efficiently. Still other innovations address how to perform in-loop deblock filtering when a block has intra BC prediction mode, or address how to perform intra BC prediction when constrained intra prediction is enabled.

公开(公告)号：US11363283B2

公开(公告)日：2022-06-14

申请号：US17009495

申请日：2020-09-01

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu

IPC: H04N19/436 ,  H04N19/11 ,  H04N19/174 ,  H04N19/176 ,  H04N19/186 ,  H04N19/593 ,  H04N19/96 ,  H04N19/129 ,  H04N19/70 ,  H04N19/463 ,  H04N19/55

Abstract: Various innovations facilitate the use of intra-picture prediction modes such as palette prediction mode, intra block copy mode, intra line copy mode and intra string copy mode by an encoder or decoder when wavefront parallel processing (“WPP”) is enabled. For example, for a palette coding/decoding mode, an encoder or decoder predicts a palette for an initial unit in a current WPP row of a picture using previous palette data from a previous unit in a previous WPP row of the picture. Or, as another example, for an intra copy mode (e.g., intra block copy mode, intra string copy mode, intra line copy mode), an encoder enforces one or more constraints attributable to the WPP, or a decoder receives and decodes encoded data that satisfies one or more constraints attributable to WPP.

公开(公告)号：US20220124367A1

公开(公告)日：2022-04-21

申请号：US17563997

申请日：2021-12-28

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu

IPC: H04N19/573 ,  H04N19/52 ,  H04N19/174

Abstract: Disclosed herein are representative embodiments of generating representative motion information that can be used during processing of a video frame. In one exemplary embodiment disclosed herein, a reference frame comprising a group of blocks is processed, and motion information for the group of blocks is compressed at least by buffering representative motion-vector information and representative reference-frame index information for the group of blocks. The representative reference-frame index information comprises reference-frame index information of a representative block of the group of blocks, and the representative reference-frame index information represents reference-frame index information for the group of blocks during processing of a current frame.

公开(公告)号：US11245923B2

公开(公告)日：2022-02-08

申请号：US16735486

申请日：2020-01-06

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu

IPC: H04N19/573 ,  H04N19/513 ,  H04N19/52 ,  H04N19/174

Abstract: Disclosed herein are representative embodiments of generating representative motion information that can be used during processing of a video frame. In one exemplary embodiment disclosed herein, a reference frame comprising a group of blocks is processed, and motion information for the group of blocks is compressed at least by buffering representative motion-vector information and representative reference-frame index information for the group of blocks. The representative reference-frame index information comprises reference-frame index information of a representative block of the group of blocks, and the representative reference-frame index information represents reference-frame index information for the group of blocks during processing of a current frame.

公开(公告)号：US11202085B1

公开(公告)日：2021-12-14

申请号：US16900742

申请日：2020-06-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Thomas W. Holcomb ,  Bin Li ,  Yan Lu ,  Mei-Hsuan Lu ,  Ming-Chieh Lee

IPC: H04N19/192 ,  H04N19/105 ,  H04N19/176 ,  H04N19/517 ,  H04N19/159

Abstract: Innovations in hash table construction and hash-based block matching for image encoding or video encoding are described. For example, an encoder determines hash values for base-size candidate blocks in a reference picture. The encoder stores, in a hash table, the hash values for the base-size candidate blocks. The encoder encodes a trial-size current block in a current picture. In some cases, the trial-size current block has a block size larger than the base block size. As part of the encoding, the encoder uses hash-based block matching, between base-size current blocks of the trial-size current block and the base-size candidate blocks, to identify a trial-size matching block, if any, in the reference picture. The encoder stores hash values only for the base-size candidate blocks. This can significantly reduce the computational cost and memory cost for hash table construction during encoding, without hurting compression efficiency or the overall speed of encoding.

公开(公告)号：US20210218974A1

公开(公告)日：2021-07-15

申请号：US17219720

申请日：2021-03-31

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Ji-Zheng Xu

IPC: H04N19/176 ,  H04N19/142 ,  H04N19/14 ,  H04N19/503 ,  H04N19/154

Abstract: Innovations in encoder-side decisions that use the results of hash-based block matching are presented. For example, some of the innovations relate to ways of building hash tables that include some (but not all) uniform blocks. Other innovations relate to ways of determining motion vector resolution based on results of hash-based block matching. Still other innovations relate to scene change detection, including long-term reference picture selection and picture quality determination during encoding.

公开(公告)号：US20210185345A1

公开(公告)日：2021-06-17

申请号：US17189589

申请日：2021-03-02

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bin Li ,  Jizheng Xu

IPC: H04N19/513 ,  H04N19/105 ,  H04N19/46 ,  H04N19/117 ,  H04N19/142 ,  H04N19/146 ,  H04N19/17 ,  H04N19/179 ,  H04N19/82 ,  H04N19/58 ,  H04N19/426 ,  H04N19/23

Abstract: Innovations in flexible reference picture management are described. For example, a video encoder and video decoder use a global reference picture set (“GRPS”) of reference pictures that remain in memory, and hence are available for use in video encoding/decoding, longer than conventional reference pictures. In particular, reference pictures of the GRPS remain available across random access boundaries. Or, as another example, a video encoder and video decoder clip a reference picture so that useful regions of the reference picture are retained in memory, while unhelpful or redundant regions of the reference picture are discarded. Reference picture clipping can reduce the amount of memory needed to store reference pictures or improve the utilization of available memory by providing better options for motion compensation. Or, as still another example, a video encoder and video decoder filter a reference picture to remove random noise (e.g., capture noise due to camera imperfections during capture).