公开(公告)号：US20240205389A1

公开(公告)日：2024-06-20

申请号：US18438202

申请日：2024-02-09

申请人： Vid Scale, Inc.

发明人： Xiaoyu Xiu ,  Yuwen He ,  Yan Ye ,  Jiancong Luo

IPC分类号： H04N19/105 ,  H04N19/132 ,  H04N19/146 ,  H04N19/159 ,  H04N19/176 ,  H04N19/513

CPC分类号： H04N19/105 ,  H04N19/132 ,  H04N19/146 ,  H04N19/159 ,  H04N19/176 ,  H04N19/513

摘要： Systems and methods are described for reducing the complexity of using bi-directional optical flow (BIO) in video coding. In some embodiments, bit-width reduction steps are introduced in the BIO motion refinement process to reduce the maximum bit-width used for BIO calculations. In some embodiments, simplified interpolation filters are used to generate predicted samples in an extended region around a current coding unit. In some embodiments, different interpolation filters are used for vertical versus horizontal interpolation. In some embodiments, BIO is disabled for coding units with small heights and/or for coding units that are predicted using a sub-block level inter prediction technique, such as advanced temporal motion vector prediction (ATMVP) or affine prediction.

公开(公告)号：US11825116B2

公开(公告)日：2023-11-21

申请号：US17690996

申请日：2022-03-09

申请人： VID SCALE, INC.

发明人： Xiaoyu Xiu ,  Yuwen He ,  Yan Ye

IPC分类号： H04N19/563 ,  H04N19/105 ,  H04N19/176 ,  H04N19/597

CPC分类号： H04N19/563 ,  H04N19/105 ,  H04N19/176 ,  H04N19/597

摘要： A video coding system (e.g., an encoder and/or a decoder) may perform face-based sub-block motion compensation for 360-degree video to predict samples (e.g., of a sub-block). The video coding system may receive a 360-degree video content. The 360-degree video content may include a current block. The current block may include a plurality of sub-blocks. The system may determine whether a sub-block mode is used for the current block. The system may predict a sample in the current block based on the sub-block level face association. For a first sub-block in the current block, the system may identify a first location of the first sub-block. The system may associate the first sub-block with a first face based on the identified first location of the first sub-block. The system may predict a first sample in the first sub-block based on the first face that is associated with the first sub-block.

公开(公告)号：US20230120362A1

公开(公告)日：2023-04-20

申请号：US18075169

申请日：2022-12-05

申请人： VID SCALE, INC.

发明人： Xiaoyu Xiu ,  Yuwen He ,  Yan Ye

IPC分类号： H04N19/513 ,  H04N19/176 ,  H04N19/577 ,  H04N19/86

摘要： Embodiments of video coding systems and methods are described for reducing coding latency introduced by decoder-side motion vector refinement (DMVR). In one example, two non-refined motion vectors are identified for coding of a first block of samples (e.g. a first coding unit) using bi-prediction. One or both of the non-refined motion vectors are used to predict motion information for a second block of samples (e.g. a second coding unit). The two non-refined motion vectors are refined using DMVR, and the refined motion vectors are used to generate a prediction signal of the first block of samples. Such embodiments allow the second block of samples to be coded substantially in parallel with the first block without waiting for completion of DMVR on the first block. In additional embodiments, optical-flow-based techniques are described for motion vector refinement.

公开(公告)号：US20230053233A1

公开(公告)日：2023-02-16

申请号：US17962918

申请日：2022-10-10

申请人： Vid Scale, Inc.

发明人： Xiaoyu Xiu ,  Yuwen He ,  Yan Ye ,  Jiancong Luo

IPC分类号： H04N19/105 ,  H04N19/132 ,  H04N19/146 ,  H04N19/159 ,  H04N19/176 ,  H04N19/513

摘要： Systems and methods are described for reducing the complexity of using bi-directional optical flow (BIO) in video coding. In some embodiments, bit-width reduction steps are introduced in the BIO motion refinement process to reduce the maximum bit-width used for BIO calculations. In some embodiments, simplified interpolation filters are used to generate predicted samples in an extended region around a current coding unit. In some embodiments, different interpolation filters are used for vertical versus horizontal interpolation. In some embodiments, BIO is disabled for coding units with small heights and/or for coding units that are predicted using a sub-block level inter prediction technique, such as advanced temporal motion vector prediction (ATMVP) or affine prediction.

公开(公告)号：US11582458B2

公开(公告)日：2023-02-14

申请号：US17269937

申请日：2019-08-28

申请人： Vid Scale, Inc.

发明人： Yuwen He ,  Xiaoyu Xiu ,  Yan Ye ,  Jiancong Luo

IPC分类号： H04N19/137 ,  H04N19/159 ,  H04N19/176 ,  H04N19/192

摘要： Systems and methods are described for video coding using affine motion models with adaptive precision. In an example, a block of video is encoded in a bitstream using an affine motion model, where the affine motion model is characterized by at least two motion vectors. A precision is selected for each of the motion vectors, and the selected precisions are signaled in the bitstream. In some embodiments, the precisions are signaled by including in the bitstream information that identifies one of a plurality of elements in a selected predetermined precision set. The identified element indicates the precision of each of the motion vectors that characterize the affine motion model. In some embodiments, the precision set to be used is signaled expressly in the bitstream; in other embodiments, the precision set may be inferred, e.g., from the block size, block shape or temporal layer.

公开(公告)号：US11570470B2

公开(公告)日：2023-01-31

申请号：US16651447

申请日：2018-09-28

申请人： VID SCALE, INC.

发明人： Yan Zhang ,  Xiaoyu Xiu ,  Yuwen He ,  Yan Ye

IPC分类号： H04N7/12 ,  H04N19/583 ,  H04N19/139 ,  H04N19/189 ,  H04N19/176

摘要： Overlapped block motion compensation (OBMC) may be performed for a current video block based on motion information associated with the current video block and motion information associated with one or more neighboring blocks of the current video block. Under certain conditions, some or ail of these neighboring blocks may be omitted from the OBMC operation of the current block. For instance, a neighboring block may be skipped during the OBMC operation if the current video block and the neighboring block are both uni-directionally or bi-directionally predicted, if the motion vectors associated with the current block and the neighboring block refer to a same reference picture, and if a sum of absolute differences between those motion vectors is smaller than a threshold value. Further, OBMC may be conducted in conjunction with regular motion compensation and may use simplified filters than traditionally allowed.

公开(公告)号：US11470308B2

公开(公告)日：2022-10-11

申请号：US17276448

申请日：2019-09-17

申请人： Vid Scale, Inc.

发明人： Xiaoyu Xiu ,  Yuwen He ,  Yan Ye ,  Jiancong Luo

IPC分类号： H04N7/12 ,  H04N19/105 ,  H04N19/132 ,  H04N19/146 ,  H04N19/159 ,  H04N19/176 ,  H04N19/513

摘要： Systems and methods are described for reducing the complexity of using bi-directional optical flow (BIO) in video coding. In some embodiments, bit-width reduction steps are introduced in the BIO motion refinement process to reduce the maximum bit-width used for BIO calculations. In some embodiments, simplified interpolation filters are used to generate predicted samples in an extended region around a current coding unit. In some embodiments, different interpolation filters are used for vertical versus horizontal interpolation. In some embodiments, BIO is disabled for coding units with small heights and/or for coding units that are predicted using a sub-block level inter prediction technique, such as advanced temporal motion vector prediction (ATMVP) or affine prediction.

公开(公告)号：US20220312001A1

公开(公告)日：2022-09-29

申请号：US17838729

申请日：2022-06-13

申请人： VID SCALE, INC.

发明人： Chun-Chi Chen ,  Xiaoyu Xiu ,  Yuwen He ,  Yan Ye

IPC分类号： H04N19/105 ,  H04N19/96 ,  H04N19/463 ,  H04N19/139 ,  H04N19/176 ,  H04N19/573

摘要： Systems and methods are described for video coding using generalized bi-prediction. In an exemplary embodiment, to code a current block of a video in a bitstream, a first reference block is selected from a first reference picture and a second reference block is selected from a second reference picture. Each reference block is associated with a weight, where the weight may be an arbitrary weight ranging, e.g., between 0 and 1. The current block is predicted using a weighted sum of the reference blocks. The weights may be selected from among a plurality of candidate weights. Candidate weights may be signaled in the bitstream or may be derived implicitly based on a template. Candidate weights may be pruned to avoid out-of-range or substantially duplicate candidate weights. Generalized bi-prediction may additionally be used in frame rate up conversion.

公开(公告)号：US11368676B2

公开(公告)日：2022-06-21

申请号：US16960455

申请日：2019-01-15

申请人： VID SCALE, INC.

发明人： Xiaoyu Xiu ,  Yuwen He ,  Yan Ye ,  Saurav Bandyopadhyay

IPC分类号： H04N19/105 ,  H04N19/132 ,  H04N19/159 ,  H04N19/176 ,  H04N19/186 ,  H04N19/30 ,  G06F17/18

摘要： Systems, methods, and Instrumentalities are described herein for calculating local Illumination compensation (LIC) parameters for bi-predicted coding unit (CU). The LIC parameters may be used to generate adjusted samples for the current CU and to address local illumination changes that may exist among temporal neighboring pictures. LIC parameters may be calculated based on bi-predicted reference template samples and template samples for a current CU. Bi-predicted reference template samples may be generated based on reference template samples neighboring temporal reference CUs. For example, the bi-predicted reference template samples may be generated based on averaging the reference template samples. The reference template samples may correspond to template samples for the current CU. A CU may be or may include a coding block and/or a sub-block that may be derived by dividing the coding block.

公开(公告)号：US20220038738A1

公开(公告)日：2022-02-03

申请号：US17504150

申请日：2021-10-18

申请人： Vid Scale, Inc.

发明人： Yan Zhang ,  Xiaoyu Xiu ,  Yuwen He ,  Yan Ye

IPC分类号： H04N19/577 ,  H04N19/176 ,  H04N19/31 ,  H04N19/573

摘要： Exemplary embodiments include systems and methods for coding a video comprising a plurality of pictures including a current picture, a first reference picture, and a second reference picture, where each picture includes a plurality of blocks. In one method, for at least a current block in the current picture, a number of available bi-prediction weights is determined based at least in part on a temporal layer and/or a quantization parameter of the current picture. From among available bi-prediction weights a pair of weights are identified. Using the identified weights, the current block is then predicted as a weighted sum of a first reference block in the first reference picture and a second reference block in the second reference picture. Encoding techniques are also described for efficient searching and selection of a pair of bi-prediction weights to use for prediction of a block.