公开(公告)号：US20210218960A1

公开(公告)日：2021-07-15

申请号：US17198750

申请日：2021-03-11

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Heiko SCHWARZ ,  Philipp HELLE ,  Michael SCHÄFER ,  Roman RISCHKE ,  Tobias HINZ ,  Philipp MERKLE ,  Björn STALLENBERGER ,  Martin WINKEN ,  Mischa SIEKMANN ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： H04N19/11 ,  H04N19/176 ,  H04N19/593 ,  H04N19/48

摘要： There are disclosed techniques for block wise encoding and decoding. The techniques may be applied to encoders, decoders, and methods for encoding and/or decoding.
In one example, there is provided a technique to decode (resp. decode) a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to the first set or the second set, sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes, deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes, predicting the predetermined block using an intra prediction mode onto which the index points. The decoder (resp. encoder), if the assigned set is the first set of intra-prediction modes, in sorting the assigned set, uses a second mapping which maps each intra-prediction mode of the second set of prediction modes onto a representative one in the first set of intra-prediction modes.

公开(公告)号：US20210014531A1

公开(公告)日：2021-01-14

申请号：US17032113

申请日：2020-09-25

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Philipp HELLE ,  Philipp MERKLE ,  Björn STALLENBERGER ,  Mischa SIEKMANN ,  Martin WINKEN ,  Adam WIECKOWSKI ,  Wojciech SAMEK ,  Stephan KALTENSTADLER ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： H04N19/593 ,  H04N19/176 ,  H04N19/61 ,  H04N19/11 ,  H04N19/105

摘要： An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.

公开(公告)号：US20200244955A1

公开(公告)日：2020-07-30

申请号：US16845715

申请日：2020-04-10

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Philipp HELLE ,  Dominique MANIRY ,  Thomas WIEGAND ,  Wojciech SAMEK ,  Stephan KALTENSTADLER ,  Heiko SCHWARZ ,  Detlev MARPE ,  Mischa SIEKMANN ,  Martin WINKEN

IPC分类号： H04N19/109 ,  H04N19/176 ,  H04N19/61

摘要： In accordance with a first aspect, an improved compression efficiency is achieved by letting a block-wise picture codec support a set of intra-prediction modes according to which the intra-prediction signal for a current block of a picture is determined by applying a set of neighboring samples of the current block onto a neural network. A second aspect of the present application is that, additionally or alternatively to the spending of neural network-based intra-prediction modes, the mode selection may be rendered more effective by the usage of a neural network dedicated to determine a rank or a probability value for each of the set of intra-prediction modes by applying a set of neighboring samples thereonto with the rank or probability value being used for the selection of one intra-prediction mode out of the plurality of intra-prediction modes including or coinciding with the set of intra-prediction modes.

公开(公告)号：US20240298033A1

公开(公告)日：2024-09-05

申请号：US18661654

申请日：2024-05-12

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Björn STALLENBERGER ,  Michael SCHAFER ,  Philipp MERKLE ,  Tobias HINZ ,  Philipp HELLE ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND ,  Benjamin BROSS ,  Martin WINKEN ,  Mischa SIEKMANN

IPC分类号： H04N19/61 ,  H04N19/105 ,  H04N19/132 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46

CPC分类号： H04N19/619 ,  H04N19/105 ,  H04N19/132 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46

摘要： A method for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode is disclosed. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k)-and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal. The prediction residual signal is used to correct the prediction signal.

公开(公告)号：US20240205385A1

公开(公告)日：2024-06-20

申请号：US18405290

申请日：2024-01-05

申请人： Fraunhofer-Gesellschaft zur FÖrderung der angewandten Forschung e.V.

发明人： Thomas WIEGAND ,  Detlev MARPE ,  Heiko SCHWARZ ,  Martin WINKEN ,  Christian BARTNIK ,  Jonathan PFAFF ,  Philipp HELLE ,  Mischa SIEKMANN

IPC分类号： H04N19/103 ,  H04N19/107 ,  H04N19/109 ,  H04N19/11 ,  H04N19/159 ,  H04N19/176

CPC分类号： H04N19/103 ,  H04N19/107 ,  H04N19/109 ,  H04N19/11 ,  H04N19/159 ,  H04N19/176

摘要： Coding efficiency increases are achieved by using composed prediction signals to predict a predetermined block of a picture.

公开(公告)号：US20240275971A1

公开(公告)日：2024-08-15

申请号：US18647776

申请日：2024-04-26

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Philipp HELLE ,  Michael SCHÄFER ,  Tobias HINZ ,  Björn STALLENBERGER ,  Philipp MERKLE ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： H04N19/13 ,  H04N19/176 ,  H04N19/46 ,  H04N19/70

CPC分类号： H04N19/13 ,  H04N19/176 ,  H04N19/46 ,  H04N19/70

摘要： An apparatus includes an encoder, which receives image or video data, encodes the data and provides a bitstream. The encoder includes a CABAC encoder, which receives a binary valued syntax element associated with a block of the data to be encoded, and encodes, using a selected context model, the syntax element into coded bits for the bitstream. The syntax element includes a tool flag indicating whether or not certain coding tool is employed when encoding a block of the data. For a block of the data which exhibits an aspect ratio larger than 2 and for a block of the data which exhibits an aspect ratio less than or equal to 2, and to which blocks the certain coding tool is applicable, first and second context models for encoding the tool flag are selected from a group of one or more first and second context models, respectively.

公开(公告)号：US20230328287A1

公开(公告)日：2023-10-12

申请号：US17763624

申请日：2020-09-24

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Björn STALLENBERGER ,  Michael SCHAEFER ,  Philipp MERKLE ,  Tobias HINZ ,  Philipp HELLE ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND ,  Benjamin BROSS ,  Martin WINKEN ,  Mischa SIEKMANN

IPC分类号： H04N19/61 ,  H04N19/132 ,  H04N19/105 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46

CPC分类号： H04N19/619 ,  H04N19/132 ,  H04N19/105 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46

摘要： Apparatus (54) for decoding a predetermined block (18) of a picture using intra-prediction, configured to read, from a data stream (12), a mode index (200) using a binarization code (202). The mode index (200) points to one out of a list (204) of matrix-based intra-prediction modes. The apparatus is configured to predict samples (108) of the predetermined block (18) by computing a matrix-vector product (206) between an input vector (102) derived from reference samples (17) in a neighbourhood of the predetermined block (18) and a prediction matrix (19) associated with the matrix-based intra-prediction mode (k) pointed to by the mode index (200) and associating components (210) of an output vector (208) obtained by the matrix-vector product (206) onto sample positions (104) of the predetermined block. The list (204) of matrix-based intra-prediction modes consists of an even number of matrix-based intra-prediction modes. The list (204) of matrix-based intra-prediction modes consists of pairs (212) of matrix-based intra-prediction modes, and, for each pair (212) of matrix-based intra-prediction modes, the prediction matrix (19) associated with a first matrix-based intra-prediction mode of the respective pair (212) of matrix-based intra-prediction modes is equal to the prediction matrix (19) associated with a second matrix-based intra-prediction mode of the respective pair (212) of matrix-based intra-prediction modes. For each pair (212) of matrix-based intra-prediction modes, the apparatus is configured so that, if the matrix-based intra-prediction mode pointed to by the mode index (200) is the first matrix-based intra-prediction mode of the respective pair (212) of matrix-based intra-prediction modes, an association of the reference samples (17) in the neighbourhood of the predetermined block (18) with components (214) of the input vector (112) and of the sample positions (104) of the predetermined block (18) with the components (210) of the output vector (208) is transposed relative to the association in case of the matrix-based intra-prediction mode pointed to by the mode index (200) being the second matrix-based intra-prediction mode of the respective pair (212) of matrix-based intra-prediction modes. Furthermore, the apparatus is configured to read the mode index (200) using the binarization code (202) from the data stream (12) in a manner so that for each pair (212) of matrix-based intra-prediction modes the first matrix-based intra-prediction mode is assigned a first codeword and the second matrix-based intra-prediction mode is assigned a second codeword and both codewords are equal in length.

公开(公告)号：US20220058239A1

公开(公告)日：2022-02-24

申请号：US17520012

申请日：2021-11-05

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Tobias HINZ ,  Philipp HELLE ,  Philipp MERKLE ,  Björn STALLENBERGER ,  Michael SCHÄFER ,  Benjamin BROSS ,  Martin WINKEN ,  Mischa SIEKMANN ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： G06F17/16 ,  G06F17/15 ,  G06F7/483 ,  G06N20/00

摘要： Apparatus for predicting a predetermined block of a picture using a plurality of reference samples The apparatus is configured to form a sample value vector out of the plurality of reference samples, derive from the sample value vector a further vector onto which the sample value vector is mapped by a predetermined invertible linear transform, compute a matrix-vector product between the further vector and a predetermined prediction matrix so as to obtain a prediction vector, and predict samples of the predetermined block on the basis of the prediction vector.

公开(公告)号：US20240137500A1

公开(公告)日：2024-04-25

申请号：US18389665

申请日：2023-12-19

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Philipp HELLE ,  Dominique MANIRY ,  Thomas WIEGARD ,  Wojciech SAMEK ,  Stephan KALTENSTADLER ,  Heiko SCHWARZ ,  Detlev MARPE ,  Mischa SIEKMANN ,  Martin WINKEN

IPC分类号： H04N19/109 ,  H04N19/176 ,  H04N19/61

CPC分类号： H04N19/109 ,  H04N19/176 ,  H04N19/61

摘要： In accordance with a first aspect, an improved compression efficiency is achieved by letting a block-wise picture codec support a set of intra-prediction modes according to which the intra-prediction signal for a current block of a picture is determined by applying a set of neighboring samples of the current block onto a neural network. A second aspect of the present application is that, additionally or alternatively to the spending of neural network-based intra-prediction modes, the mode selection may be rendered more effective by the usage of a neural network dedicated to determine a rank or a probability value for each of the set of intra-prediction modes by applying a set of neighboring samples thereonto with the rank or probability value being used for the selection of one intra-prediction mode out of the plurality of intra-prediction modes including or coinciding with the set of intra-prediction modes.

公开(公告)号：US20230276048A1

公开(公告)日：2023-08-31

申请号：US18143587

申请日：2023-05-04

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Heiko SCHWARZ ,  Philipp HELLE ,  Michael SCHÄFER ,  Roman RISCHKE ,  Tobias HINZ ,  Philipp MERKLE ,  Björn STALLENBERGER ,  Martin WINKEN ,  Mischa SIEKMANN ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： H04N19/11 ,  H04N19/593 ,  H04N19/48 ,  H04N19/176

CPC分类号： H04N19/11 ,  H04N19/593 ,  H04N19/48 ,  H04N19/176

摘要： Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding. In one example, there is provided a technique to decode or encode a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to a first set or a second set; sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes; deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes; and predicting the predetermined block using an intra prediction mode onto which the index points. The decoder or encoder, if the assigned set is the first set of intra-prediction modes, in sorting the assigned set, uses a second mapping which maps each intra-prediction mode of the second set of prediction modes onto a representative one in the first set of intra-prediction modes.