公开(公告)号：US20240205430A1

公开(公告)日：2024-06-20

申请号：US18397737

申请日：2023-12-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  David Flynn ,  Alexandros Tourapis ,  Jungsun Kim

IPC: H04N19/20 ,  G06T9/00 ,  G06T9/40 ,  H04N19/119 ,  H04N19/12 ,  H04N19/124 ,  H04N19/136 ,  H04N19/176 ,  H04N19/189 ,  H04N19/50 ,  H04N19/61 ,  H04N19/64

CPC classification number: H04N19/20 ,  G06T9/001 ,  G06T9/40 ,  H04N19/119 ,  H04N19/12 ,  H04N19/124 ,  H04N19/136 ,  H04N19/176 ,  H04N19/189 ,  H04N19/50 ,  H04N19/61 ,  H04N19/647

Abstract: An encoder is configured to compress point cloud information using a blocks of nodes determined from a prediction tree. A prediction tree is generated for a point cloud. Segments of the prediction tree are identified. The segments are divided into blocks that are predicted by predecessor blocks within the segments. The blocks of the prediction tree may then be encoded and may be provided for transmission to a decoder that can regenerate the point cloud from the blocks of the prediction tree.

公开(公告)号：US11895307B2

公开(公告)日：2024-02-06

申请号：US17062446

申请日：2020-10-02

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  David Flynn ,  Alexandros Tourapis ,  Jungsun Kim

IPC: H04N7/12 ,  H04N19/20 ,  H04N19/119 ,  H04N19/124 ,  H04N19/61 ,  H04N19/176 ,  H04N19/50 ,  H04N19/136 ,  G06T9/00 ,  H04N19/12 ,  H04N19/189 ,  H04N19/64 ,  G06T9/40

CPC classification number: H04N19/20 ,  G06T9/001 ,  G06T9/40 ,  H04N19/119 ,  H04N19/12 ,  H04N19/124 ,  H04N19/136 ,  H04N19/176 ,  H04N19/189 ,  H04N19/50 ,  H04N19/61 ,  H04N19/647

Abstract: An encoder is configured to compress point cloud information using a blocks of nodes determined from a prediction tree. A prediction tree is generated for a point cloud. Segments of the prediction tree are identified. The segments are divided into blocks that are predicted by predecessor blocks within the segments. The blocks of the prediction tree may then be encoded and may be provided for transmission to a decoder that can regenerate the point cloud from the blocks of the prediction tree.

公开(公告)号：US11863738B2

公开(公告)日：2024-01-02

申请号：US17540356

申请日：2021-12-02

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Krishnakanth Rapaka ,  David W. Singer

IPC: H04N19/105 ,  H04N19/172 ,  H04N19/174 ,  H04N19/184 ,  H04N19/513 ,  H04N19/70

CPC classification number: H04N19/105 ,  H04N19/172 ,  H04N19/174 ,  H04N19/184 ,  H04N19/513 ,  H04N19/70

Abstract: Techniques for encoding video with motion compensation include a compressed bitstream syntax that includes a list of all motion prediction reference frames without distinguishing between short-term reference frame and long-term reference frames. The list of reference frames may be provided in a slice header and may apply to encoded data video data within the corresponding slice. The list may be prefaced with a single number indicating the total number of reference frames. In an aspect delta POC reference numbers may be encoded with a flag indicating the sign of the delta POC when the absolute value of the POC is not equal to zero. In another aspect, a flag may be encoded for every reference frame indicating if POC information should be used when scaling prediction references, and a weighting parameter may be included when POC information should be used.

公开(公告)号：US11818401B2

公开(公告)日：2023-11-14

申请号：US17718647

申请日：2022-04-12

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Khaled Mammou

IPC: H04N19/96 ,  G06T9/00 ,  H04N19/176 ,  H04N19/91 ,  G06T17/00

CPC classification number: H04N19/96 ,  G06T9/00 ,  G06T17/005 ,  H04N19/176 ,  H04N19/91

Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.

公开(公告)号：US11798196B2

公开(公告)日：2023-10-24

申请号：US17145205

申请日：2021-01-08

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Khaled Mammou ,  Alexandros Tourapis

IPC: G06T9/00 ,  G06T17/20 ,  G06T3/40

CPC classification number: G06T9/001 ,  G06T3/40 ,  G06T17/20 ,  G06T2210/12

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for three-dimensional (3D) visual volumetric content and/or a decoder configured to decompress compressed attribute and/or spatial information for the 3D visual volumetric content. The encoder is configured to convert 3D visual volumetric content, such as a point cloud or mesh, into image based patch representations. The encoder is further configured to select one or more reference patches for copying or prediction, such that metadata for copying or predicting a patch based on the reference patch is signaled without explicitly signaling a full set of information for the copied or predicted patch. Likewise, a decoder is configured to receive such information and reconstruct a 3D version of the 3D visual volumetric content using both signaled and predicted or copied patches.

公开(公告)号：US20230290009A1

公开(公告)日：2023-09-14

申请号：US18166154

申请日：2023-02-08

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G06T9/00 ,  G06T17/20

CPC classification number: G06T9/001 ,  G06T17/205

Abstract: A re-meshing pre-processor for re-meshing a 3D textured mesh M(i) to generate a base mesh m(i) and displacement field d(i) for input into a mesh encoder, can include a Mesh Decimation module that includes processing hardware that reduces the number of vertices or faces of input mesh M(i), or a mesh derived therefrom, while substantially preserving the shape of the input mesh M(i), thereby producing a decimated mesh dm(i) and a projected mesh P(i); and a Fitting Subdivision Surface module that includes processing hardware that processes the input mesh M(i), the decimated mesh dm(i) or a mesh derived therefrom, and the projected mesh P(i) to produce a base mesh m(i) and the displacement field d(i) for input into a mesh encoder.

公开(公告)号：US20230290008A1

公开(公告)日：2023-09-14

申请号：US18166148

申请日：2023-02-08

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G06T9/00 ,  G06T17/20

CPC classification number: G06T9/001 ,  G06T17/205

Abstract: A method of compressing a 3D textured mesh M(i), the 3D textured mesh being defined by connectivity C(i), geometry G(i), texture coordinates T(i), and texture connectivity CT(i), wherein the mesh is associated with one or more 2D image attribute maps A(i) describing attributes associated with the mesh surface, can include pre-processing 3D textured mesh M(i) and attribute maps A(i) to generate a base mesh m(i) and displacement field d(i); and processing 3D textured mesh M(i), attribute maps A(i), base mesh m(i), and the displacement field d(i) to generate a compressed bitstream b(i).

公开(公告)号：US20230232044A1

公开(公告)日：2023-07-20

申请号：US18189099

申请日：2023-03-23

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Fabrice A. Robinet ,  Yeping Su ,  David W. Singer

IPC: H04N19/597 ,  H04N19/17

CPC classification number: H04N19/597 ,  H04N19/17 ,  G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

公开(公告)号：US11627314B2

公开(公告)日：2023-04-11

申请号：US17031792

申请日：2020-09-24

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou ,  Dominik Mehlem

IPC: H04N19/117 ,  H04N19/12 ,  H04N19/136 ,  H04N19/172 ,  H04N19/184 ,  H04N19/60 ,  H04N19/80

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder applies an attribute transfer function to attributes of an image based representation with out-of-loop smoothing such that a decoder may apply any smoothing filter supported by the decoder without being restricted to using a similar smoothing filter as the encoder.

公开(公告)号：US20230095473A1

公开(公告)日：2023-03-30

申请号：US18052803

申请日：2022-11-04

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T9/00 ,  G06T17/00 ,  G06F16/901 ,  G01S17/89

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. A point cloud attribute transfer algorithm may be used to determine distortion between an original point cloud and a reconstructed point cloud. Additionally, the point cloud attribute transfer algorithm may be used to select attribute values for a reconstructed point cloud such that distortion between an original point cloud and a reconstructed version of the original point cloud is minimized.