公开(公告)号：US20210029383A1

公开(公告)日：2021-01-28

申请号：US17067458

申请日：2020-10-09

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Khaled Mammou

IPC: H04N19/96 ,  G06T9/00 ,  H04N19/176 ,  H04N19/91

Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.

公开(公告)号：US20210006833A1

公开(公告)日：2021-01-07

申请号：US16912617

申请日：2020-06-25

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou ,  David W. Singer ,  Fabrice A. Robinet

IPC: H04N19/597 ,  H04N19/467

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.

公开(公告)号：US20200314435A1

公开(公告)日：2020-10-01

申请号：US16736715

申请日：2020-01-07

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Jungsun Kim

IPC: H04N19/172 ,  H04N19/147 ,  H04N19/124 ,  H04N19/117 ,  G06T7/73

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder generates an occupancy map and may adjust a size or placement of a patch in the occupancy map to reduce or eliminate redundant points caused by down-sampling and up-sampling of the occupancy map.

公开(公告)号：US10789733B2

公开(公告)日：2020-09-29

申请号：US16198634

申请日：2018-11-21

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T7/50 ,  G06T9/00 ,  G06T7/20 ,  H04N19/172 ,  G06T5/00 ,  G06T19/20

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder is configured project the point cloud on to patch planes to compress the point cloud, and supports multiple layered patch planes. For example, some point clouds may have a depth, and points at different depths may be assigned to different layered patch planes.

公开(公告)号：US20200273208A1

公开(公告)日：2020-08-27

申请号：US15931349

申请日：2020-05-13

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T7/70 ,  G06T7/50 ,  G06T7/20

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.

公开(公告)号：US20200219290A1

公开(公告)日：2020-07-09

申请号：US16736765

申请日：2020-01-07

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou

IPC: G06T9/00 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Auxiliary information is signaled for use in identifying patches in an image frame. The auxiliary information may be signaled using a syntax that includes a header portion and data portion, which may enable temporal prediction and timing information to be signaled.

公开(公告)号：US10607373B2

公开(公告)日：2020-03-31

申请号：US16198630

申请日：2018-11-21

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T7/00 ,  G06T9/00 ,  G06K9/62 ,  G06T5/00 ,  G06T19/20

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A closed-loop color conversion process is used to improve compression while taking into consideration distortion introduced throughout the point cloud compression process.

公开(公告)号：US20200014953A1

公开(公告)日：2020-01-09

申请号：US16503933

申请日：2019-07-05

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/463 ,  H04N19/85

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.

公开(公告)号：US20190313110A1

公开(公告)日：2019-10-10

申请号：US16380922

申请日：2019-04-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim

IPC: H04N19/20 ,  H04N19/597 ,  H04N19/176 ,  H04N19/70 ,  H04N19/46 ,  H04N19/86 ,  H04N19/91

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder generates an occupancy map and may also encode the occupancy map as an image based representation. In some embodiments, a video encoder encodes image based representations of spatial information for the points of the point cloud, image based representations of attribute values for points of the point cloud, and an image based representation of an occupancy map for the spatial and attribute images.

公开(公告)号：US20190311502A1

公开(公告)日：2019-10-10

申请号：US16380931

申请日：2019-04-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T9/00 ,  G06F16/901 ,  G06T17/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. A point cloud attribute transfer algorithm may be used to determine distortion between an original point cloud and a reconstructed point cloud. Additionally, the point cloud attribute transfer algorithm may be used to select attribute values for a reconstructed point cloud such that distortion between an original point cloud and a reconstructed version of the original point cloud is minimized.