公开(公告)号：US20230188720A1

公开(公告)日：2023-06-15

申请号：US17916574

申请日：2021-04-01

申请人： Fraunhofer-Gesellschaft Zur Förderung Der Angewandten Forschung E.V.

发明人： Jonathan Pfaff ,  Tobias Hinz ,  Philipp Helle ,  Philipp Merkle ,  Björn Stallenberger ,  Michael Schäfer ,  Benjamin Bross ,  Heiko Schwarz ,  Detlev Marpe ,  Thomas Wiegand

IPC分类号： H04N19/132 ,  H04N19/105 ,  H04N19/159 ,  H04N19/186 ,  H04N19/176

CPC分类号： H04N19/132 ,  H04N19/105 ,  H04N19/159 ,  H04N19/186 ,  H04N19/176

摘要： Block based decoder configured to partition a picture (10) of more than one color component (101, 102) and of a color sampling format, according to which each color component (101, 102) is equally sampled, into blocks using a partitioning scheme according to which the picture (10) is equally partitioned with respect to each color component (101, 102). Additionally, the block based decoder is configured to decode a first color component (101) of the picture (10) in units of the blocks with selecting, for each of intra-predicted first color component blocks (18′11-18′1n) of the picture (10), one out of a first set (508) of intra-prediction modes. The first set (508) comprises matrix-based intra prediction modes (5101 to 510m) according to each of which a block inner (18) is predicted by deriving a sample value vector (514) out of references samples (17), neighboring the block inner (18), computing a matrix-vector product (512) between the sample value vector (514) and a prediction matrix (516) associated with the respective matrix-based intra prediction mode (510i to 510m) so as to obtain a prediction vector (518), and predicting samples in the block inner (18) on the basis of the prediction vector (518). Additionally, the block based decoder is configured to decode a second color component (102) of the picture (10) in units of the blocks by intra-predicting a predetermined second color component block (182) of the picture using the matrix-based intra prediction mode selected for a co-located intra-predicted first color component block (181).

公开(公告)号：US11363259B2

公开(公告)日：2022-06-14

申请号：US16845715

申请日：2020-04-10

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan Pfaff ,  Philipp Helle ,  Dominique Maniry ,  Thomas Wiegand ,  Wojciech Samek ,  Stephan Kaltenstadler ,  Heiko Schwarz ,  Detlev Marpe ,  Mischa Siekmann ,  Martin Winken

IPC分类号： H04N19/11 ,  H04N19/109 ,  H04N19/176 ,  H04N19/61

摘要： In accordance with a first aspect, an improved compression efficiency is achieved by letting a block-wise picture codec support a set of intra-prediction modes according to which the intra-prediction signal for a current block of a picture is determined by applying a set of neighboring samples of the current block onto a neural network. A second aspect of the present application is that, additionally or alternatively to the spending of neural network-based intra-prediction modes, the mode selection may be rendered more effective by the usage of a neural network dedicated to determine a rank or a probability value for each of the set of intra-prediction modes by applying a set of neighboring samples thereonto with the rank or probability value being used for the selection of one intra-prediction mode out of the plurality of intra-prediction modes including or coinciding with the set of intra-prediction modes.

公开(公告)号：US12120321B2

公开(公告)日：2024-10-15

申请号：US17036828

申请日：2020-09-29

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Phan Hoang Tung Nguyen ,  Gerhard Tech ,  Jonathan Pfaff ,  Michael Schäfer ,  Jennifer Rasch ,  Tobias Hinz ,  Heiko Schwarz ,  Detlev Marpe ,  Thomas Wiegand

IPC分类号： H04N19/174 ,  H04N19/176

CPC分类号： H04N19/174 ,  H04N19/176

摘要： The refinement of block-based predictive coding and decoding of pictures as applicable in, e.g., hybrid video codecs, using additional reconstructed samples or residuals is described. An apparatus for block-based predictive decoding of a picture is described. The apparatus includes a combiner configured to combine a residual signal a predetermined block of the picture and a reference signal for the predetermined block so as to obtain a first spectrum, the residual signal correcting a prediction error of a prediction of the predetermined block of the picture; a reducer configured to perform thresholding on the first spectrum to obtain a second spectrum so that coefficients below a threshold value are set to a predefined value; an extractor configured to obtain from the second spectrum a modified version of the residual signal; and a reconstructor block configured to decode the predetermined block of the picture from the data stream on the basis of the modified version of the residual signal.

公开(公告)号：US12101510B2

公开(公告)日：2024-09-24

申请号：US18211729

申请日：2023-06-20

申请人： FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.

发明人： Jonathan Pfaff ,  Martin Winken ,  Christian Rudat ,  Heiko Schwarz ,  Thomas Wiegand ,  Detlev Marpe

IPC分类号： H04N19/65 ,  H04L65/70 ,  H04L65/80 ,  H04N19/13 ,  H04N19/176 ,  H04N19/60

CPC分类号： H04N19/65 ,  H04L65/70 ,  H04L65/80 ,  H04N19/13 ,  H04N19/176 ,  H04N19/60

摘要： A previously encoded or reconstructed version of a neighborhood of a predetermined block to be predicted is exploited so as to result into a more efficient predictive coding of the prediction block. In particular, a spectral decomposition of a region composed of this neighborhood and a first version of a predicted filling of the predetermined block results into a first spectrum which is subject to noise reduction and the thus resulting second spectrum may be subject to a spectral composition, thereby resulting in a modified version of this region including a second version of the predicted filling of the predetermined block. Owing to the exploitation of the already processed, i.e. encoded/reconstructed, neighborhood of the predetermined block, the second version of the predicted filling of the predetermined block tends to improve the coding efficiency.

公开(公告)号：US12069268B2

公开(公告)日：2024-08-20

申请号：US17560781

申请日：2021-12-23

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Wang-Q Lim ,  Heiko Schwarz ,  Detlev Marpe ,  Thomas Wiegand

IPC分类号： H04N19/00 ,  H04N19/117 ,  H04N19/132 ,  H04N19/169 ,  H04N19/172 ,  H04N19/80 ,  H04N19/85

CPC分类号： H04N19/132 ,  H04N19/117 ,  H04N19/172 ,  H04N19/1883 ,  H04N19/80 ,  H04N19/85

摘要： A video decoder and a video encoder include a noise reduction operation including at least two denoising operations and adapting the second denoising operation in dependence of the difference before and after the first denoising operation, thus correcting the quality reduction occurred due to the application of the first denoising operation. Corresponding methods serve to encode and decode video signals.

公开(公告)号：US12010337B2

公开(公告)日：2024-06-11

申请号：US17469137

申请日：2021-09-08

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Benjamin Bross ,  Martin Winken ,  Anastasia Henkel ,  Paul Keydel ,  Ivan Zupancic ,  Heiko Schwarz ,  Detlev Marpe ,  Thomas Wiegand

IPC分类号： H04N19/463 ,  H04N19/117 ,  H04N19/186 ,  H04N19/52 ,  H04N19/70

CPC分类号： H04N19/52 ,  H04N19/117 ,  H04N19/186 ,  H04N19/70

摘要： An encoder for hybrid video coding, the encoder for providing an encoded representation of a video sequence on the basis of an input video content, and the encoder configured to: determine one or more syntax elements related to a portion of the video sequence; select a processing scheme to be applied to the portion of the video sequence based a property described by on the one or more syntax elements, the processing scheme for acquiring a sample for a motion-compensated prediction at an integer and/or fractional location within the portion of the video sequence; encode an index indicating the selected processing scheme such that a given encoded index value represents different processing schemes depending on the property described by the one or more syntax elements; and provide, as the encoded representation of the video sequence, a bit stream including the one or more syntax elements and the encoded index.

公开(公告)号：US11997280B2

公开(公告)日：2024-05-28

申请号：US17460996

申请日：2021-08-30

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan Pfaff ,  Philipp Helle ,  Michael Schäfer ,  Tobias Hinz ,  Björn Stallenberger ,  Philipp Merkle ,  Heiko Schwarz ,  Detlev Marpe ,  Thomas Wiegand

IPC分类号： H04N19/13 ,  H04N19/176 ,  H04N19/46 ,  H04N19/70

CPC分类号： H04N19/13 ,  H04N19/176 ,  H04N19/46 ,  H04N19/70

摘要： An apparatus includes an encoder, which receives image or video data, encodes the data and provides a bitstream representing the data. The encoder includes a CABAC encoder, which receives a binary valued syntax element associated with a block of the data to be encoded, and encodes, using a selected context model, the syntax element into coded bits for the bitstream. The syntax element includes a tool flag indicating whether or not certain coding tool, like linear weighted intra prediction, is employed when encoding a block of the data. For a block of the data which exhibits an aspect ratio larger than 2 and for a block of the data which exhibits an aspect ratio less than or equal to 2, and to which blocks the certain coding tool is applicable, first and second context models for encoding the tool flag are selected from a group of one or more first and second context models, respectively.

公开(公告)号：US11805241B2

公开(公告)日：2023-10-31

申请号：US17035061

申请日：2020-09-28

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Valeri George ,  Tobias Hinz ,  Jackie Ma ,  Jens Brandenburg ,  Christian Lehmann ,  Adam Wieckowski ,  Heiko Schwarz ,  Detlev Marpe ,  Thomas Wiegand ,  Thomas Schierl

IPC分类号： H04N19/105 ,  H04N19/117 ,  H04N19/159 ,  H04N19/176 ,  H04N19/82

CPC分类号： H04N19/105 ,  H04N19/117 ,  H04N19/159 ,  H04N19/176 ,  H04N19/82

摘要： Concepts are described which enable improved suitability of a respective codec for parallel processing at encoder and/or decoder.

公开(公告)号：US11659169B2

公开(公告)日：2023-05-23

申请号：US17198750

申请日：2021-03-11

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan Pfaff ,  Heiko Schwarz ,  Philipp Helle ,  Michael Schäfer ,  Roman Rischke ,  Tobias Hinz ,  Philipp Merkle ,  Björn Stallenberger ,  Martin Winken ,  Mischa Siekmann ,  Detlev Marpe ,  Thomas Wiegand

IPC分类号： H04N19/176 ,  H04N19/593 ,  H04N19/11 ,  H04N19/48

CPC分类号： H04N19/11 ,  H04N19/176 ,  H04N19/48 ,  H04N19/593

摘要： There are disclosed techniques for block wise encoding and decoding. The techniques may be applied to encoders, decoders, and methods for encoding and/or decoding.
In one example, there is provided a technique to decode (resp. decode) a predetermined block of the picture by



assigning, based on a first signalization in the data stream, the predetermined block to the first set or the second set,
sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes,
deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes,
predicting the predetermined block using an intra prediction mode onto which the index points.




The decoder (resp. encoder), if the assigned set is the first set of intra-prediction modes, in sorting the assigned set, uses a second mapping which maps each intra-prediction mode of the second set of prediction modes onto a representative one in the first set of intra-prediction modes.

公开(公告)号：US11611750B2

公开(公告)日：2023-03-21

申请号：US17133736

申请日：2020-12-24

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Heiko Schwarz ,  Phan Hoang Tung Nguyen ,  Detlev Marpe ,  Thomas Wiegand

IPC分类号： H04N19/176 ,  H04N19/13 ,  H04N19/189 ,  H04N19/46

摘要： Concepts for transform coefficient block coding are described which enable coding of coefficients of a transform block in a manner suitable for dependent quantization and effectively implementable by entropy coding in terms of coding efficiency.