公开(公告)号：US20230072818A1

公开(公告)日：2023-03-09

申请号：US17935009

申请日：2022-09-23

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G01S7/4861 ,  G01S17/42 ,  H03M7/30

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. An order for the points is determined based on a space filling curve, wherein an encoder and a decoder determine a same order for the points based on the space filling curve. Levels of detail are determined by sampling the ordered points according to different sampling parameters, and attribute values are predicted for the points in the levels of detail using the determined order. The encoder determines attribute correction values based on a comparison of the predicted values to an original value prior to compression. The decoder corrects the predicted attribute values based on received attribute correction values.

公开(公告)号：US20220239956A1

公开(公告)日：2022-07-28

申请号：US17718647

申请日：2022-04-12

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Khaled Mammou

IPC: H04N19/96 ,  G06T9/00 ,  H04N19/176 ,  H04N19/91 ,  G06T17/00

Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.

公开(公告)号：US20210217203A1

公开(公告)日：2021-07-15

申请号：US17145205

申请日：2021-01-08

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Khaled Mammou ,  Alexandros Tourapis

IPC: G06T9/00 ,  G06T3/40 ,  G06T17/20

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for three-dimensional (3D) visual volumetric content and/or a decoder configured to decompress compressed attribute and/or spatial information for the 3D visual volumetric content. The encoder is configured to convert 3D visual volumetric content, such as a point cloud or mesh, into image based patch representations. The encoder is further configured to select one or more reference patches for copying or prediction, such that metadata for copying or predicting a patch based on the reference patch is signaled without explicitly signaling a full set of information for the copied or predicted patch. Likewise, a decoder is configured to receive such information and reconstruct a 3D version of the 3D visual volumetric content using both signaled and predicted or copied patches.

公开(公告)号：US11044478B2

公开(公告)日：2021-06-22

申请号：US16459485

申请日：2019-07-01

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Fabrice A. Robinet ,  Khaled Mammou ,  Valery G. Valentin ,  Yeping Su

IPC: H04N19/14 ,  H04N19/184 ,  H04N19/172 ,  H04N19/124 ,  H04N19/80 ,  H04N19/117

Abstract: A system comprises an encoder configured to compress images, such as image frames comprising attribute information and/or spatial for a point cloud and/or an occupancy map for the point cloud. Also, a system includes a decoder configured to decompress compressed image frames, such as image frames comprising compressed attribute and/or spatial information for the point cloud or an occupancy map for the point cloud. Additionally, the encoder may map N-bit data to M-bit code words, where M is less than N. Alternatively the encoder may map N-bit data to M-bit code words, where M is greater than N. In a similar manner, a decoder may map the M-bit code words back to the N-bit data.

公开(公告)号：US20210150766A1

公开(公告)日：2021-05-20

申请号：US17163188

申请日：2021-01-29

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim

IPC: G06T9/00 ,  G06T17/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder may be configured to further compress points omitted from the image based representation. Also, in some embodiments, a decoder may be configured to decode points compressed outside of an image based representation or in a separate image based representation.

公开(公告)号：US20210097726A1

公开(公告)日：2021-04-01

申请号：US17119938

申请日：2020-12-11

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T9/00 ,  G06T17/00 ,  G06F16/901

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. A point cloud attribute transfer algorithm may be used to determine distortion between an original point cloud and a reconstructed point cloud. Additionally, the point cloud attribute transfer algorithm may be used to select attribute values for a reconstructed point cloud such that distortion between an original point cloud and a reconstructed version of the original point cloud is minimized.

公开(公告)号：US10939129B2

公开(公告)日：2021-03-02

申请号：US16380922

申请日：2019-04-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim

IPC: H04N19/20 ,  H04N19/597 ,  H04N19/46 ,  H04N19/174 ,  G06T7/11 ,  G06T7/246 ,  H04N19/176 ,  H04N19/86 ,  H04N19/70

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder generates an occupancy map and may also encode the occupancy map as an image based representation. In some embodiments, a video encoder encodes image based representations of spatial information for the points of the point cloud, image based representations of attribute values for points of the point cloud, and an image based representation of an occupancy map for the spatial and attribute images.

公开(公告)号：US20210029383A1

公开(公告)日：2021-01-28

申请号：US17067458

申请日：2020-10-09

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Khaled Mammou

IPC: H04N19/96 ,  G06T9/00 ,  H04N19/176 ,  H04N19/91

Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.

公开(公告)号：US20210006833A1

公开(公告)日：2021-01-07

申请号：US16912617

申请日：2020-06-25

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou ,  David W. Singer ,  Fabrice A. Robinet

IPC: H04N19/597 ,  H04N19/467

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.

公开(公告)号：US20200314435A1

公开(公告)日：2020-10-01

申请号：US16736715

申请日：2020-01-07

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Jungsun Kim

IPC: H04N19/172 ,  H04N19/147 ,  H04N19/124 ,  H04N19/117 ,  G06T7/73

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder generates an occupancy map and may adjust a size or placement of a patch in the occupancy map to reduce or eliminate redundant points caused by down-sampling and up-sampling of the occupancy map.