公开(公告)号：US11589062B2

公开(公告)日：2023-02-21

申请号：US16867181

申请日：2020-05-05

Applicant: GE Video Compression, LLC

Inventor： Tobias Hinz ,  Haricharan Lakshman ,  Jan Stegemann ,  Philipp Helle ,  Mischa Siekmann ,  Karsten Suehring ,  Detlev Marpe ,  Heiko Schwarz ,  Christian Bartnik ,  Ali Atef Ibrahim Khairat Abdelhamid ,  Heiner Kirchhoffer ,  Thomas Wiegand

IPC: H04N19/117 ,  H04N19/33 ,  H04N19/105 ,  H04N19/157 ,  H04N19/187 ,  H04N19/82 ,  H04N19/136 ,  H04N19/159 ,  H04N19/34 ,  H04N19/119 ,  H04N19/587 ,  H04N19/59 ,  H04N19/18 ,  H04N19/48 ,  H04N19/61 ,  H04N19/70 ,  H04N19/86 ,  H04N19/107 ,  H04N19/137 ,  H04N19/176 ,  H04N19/196 ,  H04N19/503 ,  H04N19/593 ,  H04N19/615 ,  H04N19/11 ,  H04N19/463

Abstract: A subblock-based coding of transform coefficient blocks of the enhancement layer is rendered more efficient. To this end, the subblock subdivision of the respective transform coefficient block is controlled on the basis of the base layer residual signal or the base layer signal. In particular, by exploiting the respective base layer hint, the subblocks may be made longer along a spatial frequency axis transverse to edge extensions observable from the base layer residual signal or the base layer signal.

公开(公告)号：US11546618B2

公开(公告)日：2023-01-03

申请号：US17239022

申请日：2021-04-23

Applicant: GE VIDEO COMPRESSION, LLC

Inventor： Karsten Suehring ,  Thomas Schierl ,  Detlev Marpe ,  Robert Skupin ,  Yago Sanchez De La Fuente ,  Gerhard Tech

IPC: H04N19/30 ,  H04N19/65 ,  H04N19/70 ,  H04L69/324 ,  H04N19/187 ,  H04N19/423 ,  H04N19/44 ,  H04N19/50 ,  H04N19/85 ,  H04N19/119 ,  H04N19/166 ,  H04N19/174 ,  H04N19/593 ,  H04N19/66 ,  H04N19/89 ,  H04N19/91 ,  H04N19/33

Abstract: The signalization of the inter-layer dependencies between layers of a multi-layered data stream is described. A good compromise between a too intensive restriction of the potential diversity of inter-layer dependencies on the one hand and a too complex signaling of the inter-layer dependencies on the other hand has been found by describing the inter-layer dependencies by way of a first inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by a base layer-ID and a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by an extension layer-ID, the base layer ID and extension layer ID indexing the layers the portions of the multi-layer data stream are associated with. In accordance with this concept, emphasis may be shifted between increased diversity of the signalizable inter-layer dependencies on the one hand and reduced side-information overhead for signaling the inter-layer dependencies on the other hand.

公开(公告)号：US11252422B2

公开(公告)日：2022-02-15

申请号：US16395761

申请日：2019-04-26

Applicant: GE Video Compression, LLC

Inventor： Karsten Suehring ,  Thomas Schierl ,  Detlev Marpe ,  Robert Skupin ,  Yago Sanchez De La Fuente ,  Gerhard Tech

IPC: H04N19/66 ,  H04N19/30 ,  H04N19/65 ,  H04N19/70 ,  H04L29/08 ,  H04N19/187 ,  H04N19/423 ,  H04N19/44 ,  H04N19/50 ,  H04N19/85 ,  H04N19/119 ,  H04N19/166 ,  H04N19/174 ,  H04N19/593 ,  H04N19/89 ,  H04N19/91 ,  H04N19/33

Abstract: A number of negatively affected (correctly received) packets due to packet loss is reduced by providing, and analyzing, error resilience in the packets of the sequence of packets and identifying, for each of runs of one or more lost packets of the sequence of packets, a first packet in the sequence of packets after the respective run of one or more lost packets, which carries a beginning of any of the tiles of the video data stream, and concurrently carries a slice, the slice header of which is contained in any of the packets of the sequence of packets not being lost. In particular, the side information overhead for transmitting the error resilience data is comparatively low compared to the reduction in negatively affected packets due to packet loss.

公开(公告)号：US11025929B2

公开(公告)日：2021-06-01

申请号：US16552342

申请日：2019-08-27

Applicant: GE VIDEO COMPRESSION, LLC

Inventor： Karsten Suehring ,  Thomas Schierl ,  Detlev Marpe ,  Robert Skupin ,  Yago Sanchez De La Fuente ,  Gerhard Tech

IPC: H04N19/30 ,  H04N19/65 ,  H04N19/70 ,  H04L29/08 ,  H04N19/187 ,  H04N19/423 ,  H04N19/44 ,  H04N19/50 ,  H04N19/85 ,  H04N19/119 ,  H04N19/166 ,  H04N19/174 ,  H04N19/593 ,  H04N19/66 ,  H04N19/89 ,  H04N19/91 ,  H04N19/33

Abstract: An interleaved multi-layered video data stream with interleaved decoding units of different layers is provided with further timing control information in addition to the timing control information reflecting the interleaved decoding unit arrangement. The additional timing control information pertains to either a fallback position according to which all decoding units of an access unit are treated at the decoded buffer access unit-wise, or a fallback position according to which an intermediate procedure is used: the interleaving of the DUs of different layers is reversed according to the additionally sent timing control information, thereby enabling a DU-wise treatment at the decoder's buffer, however, with no interleaving of decoding units relating to different layers. Both fallback positions may be present concurrently. Various advantageous embodiments and alternatives are the subject of the various claims attached herewith.

公开(公告)号：US11012700B2

公开(公告)日：2021-05-18

申请号：US16738075

申请日：2020-01-09

Applicant: GE VIDEO COMPRESSION, LLC

Inventor： Karsten Suehring ,  Thomas Schierl ,  Detlev Marpe ,  Robert Skupin ,  Yago Sanchez De La Fuente ,  Gerhard Tech

IPC: H04N19/30 ,  H04N19/70 ,  H04N19/65 ,  H04L29/08 ,  H04N19/187 ,  H04N19/423 ,  H04N19/44 ,  H04N19/50 ,  H04N19/85 ,  H04N19/119 ,  H04N19/166 ,  H04N19/174 ,  H04N19/593 ,  H04N19/66 ,  H04N19/89 ,  H04N19/91 ,  H04N19/33

Abstract: A signaling of at least one characteristic for layers of a multi-layered video signal such as, for example, for each layer the indication of dependent layers to which the respective layer directly relates via inter-layer prediction, or the signaling of the afore-mentioned second inter-dependency syntax structure, is described. A maximum syntax element is signaled within the multi-layered video signal to indicate a maximally used value of an extension layer-ID field of the packets of the multi-layered video signal, the scope of the maximum syntax element being, for example, a predetermined portion of the multi-layered video signal extending, for example, across several portions of the multi-layered video signal. Accordingly, it is feasible for devices such as decoders or network elements receiving the multi-layered video signal to gain, for a relatively large predetermined portion of the multi-layered video signal, knowledge about the actually consumed portion of the possible domain of possible values.

公开(公告)号：US10425651B2

公开(公告)日：2019-09-24

申请号：US16157723

申请日：2018-10-11

Applicant: GE VIDEO COMPRESSION, LLC

Inventor： Karsten Suehring ,  Thomas Schierl ,  Detlev Marpe ,  Robert Skupin ,  Yago Sanchez De La Fuente ,  Gerhard Tech

IPC: H04N19/30 ,  H04N19/70 ,  H04N19/65 ,  H04L29/08 ,  H04N19/187 ,  H04N19/423 ,  H04N19/44 ,  H04N19/50 ,  H04N19/85 ,  H04N19/119 ,  H04N19/166 ,  H04N19/174 ,  H04N19/593 ,  H04N19/66 ,  H04N19/89 ,  H04N19/91 ,  H04N19/33

Abstract: The signalization of the inter-layer dependencies between layers of a multi-layered data stream is described. A good compromise between a too intensive restriction of the potential diversity of inter-layer dependencies on the one hand and a too complex signaling of the inter-layer dependencies on the other hand has been found by describing the inter-layer dependencies by way of a first inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by a base layer-ID and a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by an extension layer-ID, the base layer ID and extension layer ID indexing the layers the portions of the multi-layer data stream are associated with. In accordance with this concept, emphasis may be shifted between increased diversity of the signalizable inter-layer dependencies on the one hand and reduced side-information overhead for signaling the inter-layer dependencies on the other hand.

公开(公告)号：US10349066B2

公开(公告)日：2019-07-09

申请号：US14995399

申请日：2016-01-14

Applicant: GE Video Compression, LLC

Inventor： Karsten Suehring ,  Thomas Schierl ,  Detlev Marpe ,  Robert Skupin ,  Yago Sanchez de la Fuente ,  Gerhard Tech

IPC: H04N19/30 ,  H04N19/70 ,  H04N19/65 ,  H04L29/08 ,  H04N19/187 ,  H04N19/423 ,  H04N19/44 ,  H04N19/50 ,  H04N19/85 ,  H04N19/119 ,  H04N19/166 ,  H04N19/174 ,  H04N19/593 ,  H04N19/66 ,  H04N19/89 ,  H04N19/91 ,  H04N19/33

Abstract: A signaling of the layer ID for packets of a multi-layered video signal is described. In particular, an efficient way of signaling this layer association is achieved, with maintaining the backward compatibility with codecs according to which a certain value of the base layer-ID field is restricted to be non-extendable such as base layer-ID value 0 in the base layer-ID field. Instead of circumventing this restriction specifically with respect to this non-extendable base layer-ID value, the layer-ID of portions of the multi-layer data stream is signaled in an extendable manner by sub-dividing the base layer-ID field into a first sub-field and a second sub-field: whenever the first sub-field of the base layer-ID field fulfills a predetermined criterion, an extension layer-ID field is provided, and if the first sub-field of the base layer-ID field does not fulfill the predetermined criterion, the extension layer-ID field is omitted.

公开(公告)号：US10313691B2

公开(公告)日：2019-06-04

申请号：US14995399

申请日：2016-01-14

Applicant: GE Video Compression, LLC

Inventor： Karsten Suehring ,  Thomas Schierl ,  Detlev Marpe ,  Robert Skupin ,  Yago Sanchez de la Fuente ,  Gerhard Tech

IPC: H04N19/30 ,  H04N19/70 ,  H04N19/65 ,  H04L29/08 ,  H04N19/187 ,  H04N19/423 ,  H04N19/44 ,  H04N19/50 ,  H04N19/85 ,  H04N19/119 ,  H04N19/166 ,  H04N19/174 ,  H04N19/593 ,  H04N19/66 ,  H04N19/89 ,  H04N19/91 ,  H04N19/33

Abstract: A signaling of the layer ID for packets of a multi-layered video signal is described. In particular, an efficient way of signaling this layer association is achieved, with maintaining the backward compatibility with codecs according to which a certain value of the base layer-ID field is restricted to be non-extendable such as base layer-ID value 0 in the base layer-ID field. Instead of circumventing this restriction specifically with respect to this non-extendable base layer-ID value, the layer-ID of portions of the multi-layer data stream is signaled in an extendable manner by sub-dividing the base layer-ID field into a first sub-field and a second sub-field: whenever the first sub-field of the base layer-ID field fulfills a predetermined criterion, an extension layer-ID field is provided, and if the first sub-field of the base layer-ID field does not fulfill the predetermined criterion, the extension layer-ID field is omitted.

公开(公告)号：US10148957B2

公开(公告)日：2018-12-04

申请号：US14666634

申请日：2015-03-24

Applicant: GE Video Compression, LLC

Inventor： Tobias Hinz ,  Haricharan Lakshman ,  Jan Stegemann ,  Philipp Helle ,  Mischa Siekmann ,  Karsten Suehring ,  Detlev Marpe ,  Heiko Schwarz ,  Christian Bartnik ,  Ali Atef Ibrahim Khairat Abdelhamid ,  Heiner Kirchhoffer ,  Thomas Wiegand

IPC: H04N19/103 ,  H04N19/46 ,  H04N19/119 ,  H04N19/105 ,  H04N19/117 ,  H04N19/157 ,  H04N19/187 ,  H04N19/82 ,  H04N19/33 ,  H04N19/587 ,  H04N19/59 ,  H04N19/18 ,  H04N19/48 ,  H04N19/61 ,  H04N19/70 ,  H04N19/86 ,  H04N19/107 ,  H04N19/137 ,  H04N19/176 ,  H04N19/196 ,  H04N19/503 ,  H04N19/593 ,  H04N19/615 ,  H04N19/11 ,  H04N19/463

Abstract: Scalable video coding is rendered more efficient by deriving/selecting a subblock subdivision to be used for enhancement layer prediction, among a set of possible subblock subdivisions of an enhancement layer block by evaluating the spatial variation of the base layer coding parameters over the base layer signal. By this measure, less of the signalization overhead has to be spent on signaling this subblock subdivision within the enhancement layer data stream, if any. The subblock subdivision thus selected may be used in predictively coding/decoding the enhancement layer signal.

公开(公告)号：US10104386B2

公开(公告)日：2018-10-16

申请号：US14753144

申请日：2015-06-29

Applicant: GE Video Compression, LLC.

Inventor： Karsten Suehring ,  Thomas Schierl ,  Valeri George ,  Detlev Marpe ,  Robert Skupin

IPC: H04N19/33 ,  H04N19/187 ,  H04N19/70 ,  H04N19/119 ,  H04N19/46 ,  H04N19/30 ,  H04N19/102 ,  H04N19/12 ,  H04N19/174 ,  H04N19/80 ,  H04N19/436 ,  H04N19/59 ,  H04N19/139 ,  H04N19/156

Abstract: Scalable coding concepts are described. One aspect improves parallel decoding of inter-dependent layers of a multi-layer video data stream by introducing a long-term syntax element structure for guaranteeing that during a predetermined time period the pictures of the dependent layer are subdivided so that borders of the spatial segments of the pictures of the second layer and the spatial segments of the first layer overlay. Another aspect concerns upsampling from base layer to enhancement layer. Another aspect introduces a long-term syntax element structure allowing the decoder to determine the inter-layer offset for a predetermined time period. Another aspect introduces a type indicator field changing a way a layer indicator field within the NAL unit headers is to be interpreted. Another aspect allows different codecs/standards to be used for the different layers. Another aspect concerns a syntax element structure which indicates the inter-layer offset in units of the base layer blocks.