公开(公告)号：US20220207364A1

公开(公告)日：2022-06-30

申请号：US17606025

申请日：2020-04-20

Applicant: InterDigital VC Holdings, Inc.

Inventor： Fabien RACAPE ,  Swayambhoo JAIN ,  Shahab HAMIDI-RAD

IPC: G06N3/08 ,  H04N19/70 ,  G06N5/04

Abstract: A method and apparatus for conveying information in a bitstream for deep neural network compression, such as in matrices representing weights, biases and non-linearities, to iteratively compress a pre-trained deep neural network by low displacement rank based approximation of the network layer weight matrices. The low displacement rank approximation allows for replacement of an original layer weight matrices of the pre-trained deep neural network as the sum of small number of structured matrices, allowing compression and low inference complexity. A decoder stage parses a bitstream for inference.

公开(公告)号：US20210250577A1

公开(公告)日：2021-08-12

申请号：US17054561

申请日：2019-05-10

Applicant: INTERDIGITAL VC HOLDINGS, INC.

Inventor： Fabrice LELEANNEC ,  Fabien RACAPE ,  Gagan RATH ,  Fabrice URBAN

IPC: H04N19/105 ,  H04N19/159 ,  H04N19/176 ,  H04N19/593 ,  H04N19/147 ,  H04N19/11 ,  H04N19/96

Abstract: A video encoder or decoder processes portions of video using intra coding and with variable block shapes. Under the general aspects, intra prediction directions are adapted to the block shape or aspect ratio. The general aspects described adaptively replace several conventional angular intra prediction modes with wide-angle intra prediction modes for non-square blocks. The total number of angular directions for any block can remain the same as in prior video coding standards or can be reduced or expanded. To keep the same number of prediction directions, directions along a shorter rectangular edge of a target block are removed but replaced with addition directions along the longer edge of the rectangular target block. For directions with wide angles, reference sample smoothing is performed. Signaling can be provided to inform a corresponding decoder regarding the prediction modes and directions.

公开(公告)号：US20210195161A1

公开(公告)日：2021-06-24

申请号：US16756244

申请日：2018-10-16

Applicant: INTERDIGITAL VC HOLDINGS, INC.

Inventor： Fabien RACAPE ,  Franck GALPIN ,  Antoine ROBERT

IPC: H04N13/161 ,  H04N13/178 ,  H04N13/156 ,  H04N19/70

Abstract: Methods and apparatus enable video coding and decoding related to omnidirectional video, such as stereo omnidirectional video with equirectangular projections. For stereo images of a scene, the video image data is portioned, resampled and arranged so that portions representing both images are able to fit within a frame. A message is sent with the frame to describe either the resampling or arrangement information. In at least one embodiment, the resampling is done horizontally. In at least one embodiment, the message is sent within a Supplemental Enhancement Information message. Corresponding operations reverse the process at a decoder, enabling the two stereo images to be recreated.

公开(公告)号：US20200169752A1

公开(公告)日：2020-05-28

申请号：US16609111

申请日：2018-04-26

Applicant: INTERDIGITAL VC HOLDINGS, INC.

Inventor： Gagan RATH ,  Fabien RACAPE ,  Tangi POIRIER ,  Fabrice LELEANNEC

IPC: H04N19/593 ,  H04N19/176

Abstract: To construct an MPM set for encoding or decoding an intra prediction mode, a plurality of neighbor blocks may be used. In one implementations, two above-intermediate neighbor blocks, such as those specified by sample locations at a distance equal to the height or half of the width may be used for a flat rectangular block, or two left-intermediate neighbor blocks, such as those specified by sample locations at a distance equal to the width or half of the height may be used for a tall rectangular block. The order of searching the neighbor blocks can be based on the current block's shape, or based on the distance between a neighbor's intra prediction mode and a vertical or horizontal intra prediction mode. Both the encoder and decoder follow the same MPM set construction process. Hence, no additional syntax elements are needed to signal the neighbor blocks and the search order.

公开(公告)号：US20200169730A1

公开(公告)日：2020-05-28

申请号：US16618564

申请日：2018-05-17

Applicant: INTERDIGITAL VC HOLDINGS, INC.

Inventor： Philippe BORDES ,  Fabien RACAPE ,  Ya CHEN

IPC: H04N19/117 ,  H04N19/147 ,  H04N19/176 ,  H04N19/70

Abstract: An encoding method for encoding blocks of a picture part is disclosed in an embodiment. A reconstructed version of each block of the picture part, called reconstructed block, is determined. A plurality of candidate sets of filter parameters is obtained and an index is determined for each block of the picture part that identifies one of the candidate sets of filter parameters to be used for filtering the block. Each reconstructed block is filtered with the candidate set of filter parameters of the plurality of candidate sets of filter parameters identified by the index. The plurality of candidate sets of filter parameters, the blocks of the picture part and the index for each block are encoded in a bitstream. Advantageously, a plurality of candidate sets of filter parameters are determined such as to minimize a rate-distortion cost for each block of the picture part. For each block of the picture part, an index is determined that identifies one of the plurality of candidate sets of filter parameters to be used for filtering the block such as to minimize a rate-distortion cost for the block. The filter parameters of each candidate set of the plurality of candidate sets are refined using the reconstructed version of the blocks whose index identifies the candidate set.

公开(公告)号：US20190273918A1

公开(公告)日：2019-09-05

申请号：US16336228

申请日：2017-09-18

Applicant: INTERDIGITAL VC HOLDINGS, INC.

Inventor： Fabien RACAPE ,  Franck GALPIN ,  Tangi POIRIER

IPC: H04N19/105 ,  H04N19/11 ,  H04N19/159 ,  H04N19/132 ,  H04N19/176

Abstract: The method for intra frame prediction allows for the recovery of some intra directional modes that are otherwise rendered useless due to the classical padding process. Directional modes are recovered by filling pixel locations in the prediction unit with samples from the portion of the unit that is determined to have samples available for use using a counterpart directional mode to the one that is useless. When it is determined that reference samples are missing for a particular prediction unit or portion thereof given a particular directional mode, a determination is made about whether reference samples along another portion of the prediction unit are available. The other portion is the side of the prediction unit at an opposite end of the particular directional mode. When it is determined that such reference samples are available, it is possible to extend the number of intra directional modes by replacing the particular directional modes that are rendered useless, because of the unavailability of reference samples, with their counterpart directional modes that are oppositely directed.

公开(公告)号：US20190260989A1

公开(公告)日：2019-08-22

申请号：US16334100

申请日：2017-09-28

Applicant: INTERDIGITAL VC HOLDINGS, INC.

Inventor： Fabien RACAPE ,  Franck GALPIN ,  Philippe BORDES

IPC: H04N19/105 ,  H04N19/11 ,  H04N19/132 ,  H04N19/159 ,  H04N19/176

Abstract: In omnidirectional videos, a straight line in the rendering space may no longer appear as a straight line in the frame to be encoded, due to the projection between the encoding space and the rendering space. To adapt to the geometry of omnidirectional videos, intra prediction is performed along non-straight curves. In particular, references samples in neighboring reconstructed blocks of a current block are copied along non-straight curves to form a predicted block for the current block. The non-straight curves may be computed online based on a single intra prediction directional mode for the current block. The parameters of non-straight curves may be based on the mapping used in forming the omnidirectional videos, and the location/size of the current block. The non-straight curves may be obtained using a look-up table or an analytical function that is dependent on the location and size of the current block.

公开(公告)号：US20250159140A1

公开(公告)日：2025-05-15

申请号：US19026871

申请日：2025-01-17

Applicant: INTERDIGITAL VC HOLDINGS, INC.

Inventor： Fabrice LELEANNEC ,  Fabien RACAPE ,  Gagan RATH ,  Fabrice URBAN

IPC: H04N19/105 ,  H04N19/11 ,  H04N19/147 ,  H04N19/159 ,  H04N19/176 ,  H04N19/593 ,  H04N19/96

Abstract: A video encoder or decoder processes portions of video using intra coding and with variable block shapes. Under the general aspects, intra prediction directions are adapted to the block shape or aspect ratio. The general aspects described adaptively replace several conventional angular intra prediction modes with wide-angle intra prediction modes for non-square blocks. The total number of angular directions for any block can remain the same as in prior video coding standards or can be reduced or expanded. To keep the same number of prediction directions, directions along a shorter rectangular edge of a target block are removed but replaced with addition directions along the longer edge of the rectangular target block. For directions with wide angles, reference sample smoothing is performed. Signaling can be provided to inform a corresponding decoder regarding the prediction modes and directions.

公开(公告)号：US20240163424A1

公开(公告)日：2024-05-16

申请号：US18519573

申请日：2023-11-27

Applicant: INTERDIGITAL VC HOLDINGS, INC.

Inventor： Fabien RACAPE ,  Franck GALPIN ,  Tangi POIRIER

IPC: H04N19/105 ,  H04N19/11 ,  H04N19/132 ,  H04N19/159 ,  H04N19/176 ,  H04N19/182 ,  H04N19/593

CPC classification number: H04N19/105 ,  H04N19/11 ,  H04N19/132 ,  H04N19/159 ,  H04N19/176 ,  H04N19/182 ,  H04N19/593

Abstract: The method for intra frame prediction allows for the recovery of some intra directional modes that are otherwise rendered useless due to the classical padding process. Directional modes are recovered by filling pixel locations in the prediction unit with samples from the portion of the unit that is determined to have samples available for use using a counterpart directional mode to the one that is useless. When it is determined that reference samples are missing for a particular prediction unit or portion thereof given a particular directional mode, a determination is made about whether reference samples along another portion of the prediction unit are available. The other portion is the side of the prediction unit at an opposite end of the particular directional mode. When it is determined that such reference samples are available, it is possible to extend the number of intra directional modes by replacing the particular directional modes that are rendered useless, because of the unavailability of reference samples, with their counterpart directional modes that are oppositely directed.

公开(公告)号：US20220264095A1

公开(公告)日：2022-08-18

申请号：US17727253

申请日：2022-04-22

Applicant: InterDigital VC Holdings, Inc.

Inventor： Franck GALPIN ,  Fabien RACAPE ,  Karam NASER ,  Philippe BORDES

IPC: H04N19/13 ,  H04N19/105 ,  H04N19/132 ,  H04N19/176 ,  H04N19/46 ,  H04N19/70 ,  G06N3/02

Abstract: Methods and apparatuses for video coding and decoding are provided. The method of video encoding includes accessing a bin of a syntax element associated with a block in a picture of a video, determining a context for the bin of the syntax element associated with the syntax element and entropy encoding the bin of the syntax element based on the determined context wherein either the bin of the syntax element is based on the relevance of a prediction by a neural network of the syntax element or the probability associated to the context is determined by a neural network. A bitstream formatted to include encoded data, a computer-readable storage medium and a computer-readable program product are also described.