公开(公告)号：US20220166969A1

公开(公告)日：2022-05-26

申请号：US17540356

申请日：2021-12-02

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Krishnakanth Rapaka ,  David W. Singer

IPC: H04N19/105 ,  H04N19/172 ,  H04N19/174 ,  H04N19/184 ,  H04N19/513 ,  H04N19/70

Abstract: Techniques for encoding video with motion compensation include a compressed bitstream syntax that includes a list of all motion prediction reference frames without distinguishing between short-term reference frame and long-term reference frames. The list of reference frames may be provided in a slice header and may apply to encoded data video data within the corresponding slice. The list may be prefaced with a single number indicating the total number of reference frames. In an aspect delta POC reference numbers may be encoded with a flag indicating the sign of the delta POC when the absolute value of the POC is not equal to zero. In another aspect, a flag may be encoded for every reference frame indicating if POC information should be used when scaling prediction references, and a weighting parameter may be included when POC information should be used.

公开(公告)号：US20220103851A1

公开(公告)日：2022-03-31

申请号：US17493607

申请日：2021-10-04

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Yeping Su ,  David Singer ,  Hsi-Jung Wu

IPC: H04N19/50 ,  H04N19/184 ,  H04N19/167 ,  H04N19/436 ,  H04N19/186 ,  H04N19/132 ,  H04N19/124 ,  H04N19/13 ,  H04N19/15 ,  H04N19/30 ,  H04N19/42 ,  H04N19/48

Abstract: Video compression and decompression techniques are disclosed that provide improved bandwidth control for video compression and decompression systems. In particular, video coding and decoding techniques quantize input video in multiple dimensions. According to these techniques, pixel residuals may be generated from a comparison of an array of input data to an array of prediction data. The pixel residuals may be quantized in a first dimension. After the quantization, the quantized pixel residuals may be transformed to an array of transform coefficients. The transform coefficients may be quantized in a second dimension and entropy coded. Decoding techniques invert these processes. In still other embodiments, multiple quantizers may be provided upstream of the transform stage, either in parallel or in cascade, which provide greater flexibility to video coders to quantize data in different dimensions in an effort to balance the competing interest in compression efficiency and quality of reconstructed video.

公开(公告)号：US11252441B2

公开(公告)日：2022-02-15

申请号：US17163204

申请日：2021-01-29

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Khaled Mammou

IPC: H04N19/91 ,  H04N19/20 ,  H04N19/124 ,  G06T9/00 ,  H04N19/13

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. To compress the attribute information, multiple levels of detail are generated based on an ordering of the points according to a space filling curve and attribute values are predicted. The attribute values may be predicted simultaneously while points are being assigned to different levels of detail. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, attribute correction values may take into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.

公开(公告)号：US20210256735A1

公开(公告)日：2021-08-19

申请号：US17306863

申请日：2021-05-03

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T17/20 ,  H03M7/30 ,  G06T3/40

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.

公开(公告)号：US20210211703A1

公开(公告)日：2021-07-08

申请号：US17143882

申请日：2021-01-07

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou

IPC: H04N19/46 ,  G06T7/50

Abstract: In an example method, points that represent three-dimensional visual volumetric content are received, and patches are determined, where each patch corresponds to a respective portion of the visual volumetric content. A patch image representing a set of points corresponding to the patch projected onto a respective patch plane is generated for each patch. The patch images are packed into image frames, and the image frames are encoded. An occupancy map corresponding to the image frames is generated. The occupancy map indicates, for each image frame: locations of the patch images in the image frame, and depth information of sets of points corresponding to the patch images in the image frame. The depth information indicates, for each patch image, depths of the set of points corresponding to the patch image in a direction perpendicular to a patch plane of the patch image.

公开(公告)号：US20210211683A1

公开(公告)日：2021-07-08

申请号：US17210478

申请日：2021-03-23

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Alexandros Tourapis

IPC: H04N19/159 ,  H04N19/154 ,  H04N19/59 ,  H04N19/86 ,  H04N19/46 ,  G06T9/00 ,  G06N3/04 ,  G06N3/08 ,  H04N19/102 ,  H04N19/117 ,  H04N19/189 ,  H04N19/132 ,  H04N19/90 ,  H04N19/136 ,  H04N19/172

Abstract: System and method for improving video encoding and/or video decoding. In embodiments, a video encoding pipeline includes a main encoding pipeline that compresses source image data corresponding with an image frame by processing the source image data based at least in part on encoding parameters to generate encoded image data. Additionally the video encoding pipeline includes a machine learning block communicatively coupled to the main encoding pipeline, in which the machine learning block analyzes content of the image frame by processing the source image data based at least in part on machine learning parameters implemented in the machine learning block when the machine learning block is enabled by the encoding parameters; and the video encoding pipeline adaptively adjusts the encoding parameters based at least in part on the content expected to be present in the image frame to facilitate improving encoding efficiency.

公开(公告)号：US11010928B2

公开(公告)日：2021-05-18

申请号：US16380920

申请日：2019-04-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Alexandros Tourapis

IPC: G06K9/36 ,  G06K9/46 ,  G06T9/00 ,  G06T7/50

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.

公开(公告)号：US20210105493A1

公开(公告)日：2021-04-08

申请号：US17062446

申请日：2020-10-02

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  David Flynn ,  Alexandros Tourapis ,  Jungsun Kim

IPC: H04N19/20 ,  H04N19/119 ,  H04N19/124 ,  H04N19/136 ,  H04N19/176 ,  H04N19/50 ,  H04N19/61

Abstract: An encoder is configured to compress point cloud information using a blocks of nodes determined from a prediction tree. A prediction tree is generated for a point cloud. Segments of the prediction tree are identified. The segments are divided into blocks that are predicted by predecessor blocks within the segments. The blocks of the prediction tree may then be encoded and may be provided for transmission to a decoder that can regenerate the point cloud from the blocks of the prediction tree.

公开(公告)号：US20210092459A1

公开(公告)日：2021-03-25

申请号：US17029649

申请日：2020-09-23

Applicant: Apple Inc.

Inventor： Hye-Yeon Cheong ,  David W. Singer ,  Alexandros Tourapis

IPC: H04N19/82 ,  H04N19/137 ,  H04N19/182 ,  H04N19/107 ,  H04N19/186

Abstract: A system comprises an encoder configured to compress video data using an in-loop noise generation process that generates noise in the compression loop at a sub-image portion level of granularity, such as at a block level. The encoder includes noise model and/or noise model input parameter information in an encoded bit stream. Also, a system includes a decoder configured to receive such a bit stream and decompress the video using an in-loop noise generation process that generates noise in the decompression loop at a sub-image portion level of granularity.

公开(公告)号：US20210090301A1

公开(公告)日：2021-03-25

申请号：US17030264

申请日：2020-09-23

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G06T9/00 ,  G06T3/40 ,  G06T5/00 ,  G06T17/20 ,  H04N19/20 ,  H04N19/597 ,  H04N19/80 ,  H04N19/172

Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.