公开(公告)号：US20230094734A1

公开(公告)日：2023-03-30

申请号：US18046861

申请日：2022-10-14

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Khaled Mammou ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/124 ,  H04N19/30 ,  H04N19/46

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for volumetric visual content and/or a decoder configured to decompress compressed attribute and/or spatial information for the volumetric visual content. The encoder is configured to convert a 3D representation of the visual volumetric content into a 2D image based representation. The encoder is further configured to scale the patch in 2D space independent of any scaling in 3D space. Auxiliary information is signaled for use in identifying 2D scaled or unscaled patches in an image frame, mapping the patches into 3D space, and adjusting for any scaling factors applied at the encoder.

公开(公告)号：US20230030913A1

公开(公告)日：2023-02-02

申请号：US17933065

申请日：2022-09-16

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G06T9/00 ,  G06T3/40 ,  G06T5/00 ,  H04N19/20 ,  H04N19/597 ,  H04N19/80 ,  H04N19/172 ,  G06T17/20

Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.

公开(公告)号：US11508095B2

公开(公告)日：2022-11-22

申请号：US17163194

申请日：2021-01-29

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Fabrice A. Robinet ,  Valery G. Valentin ,  Yeping Su

IPC: G06T9/00 ,  G06T17/00

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, multiple levels of detail are generated based on spatial information. Also, attribute values are predicted based on the level of details. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, an update operation is performed to smooth attribute correction values taking into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.

公开(公告)号：US11494947B2

公开(公告)日：2022-11-08

申请号：US17119938

申请日：2020-12-11

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T9/00 ,  G06T17/00 ,  G06F16/901 ,  G01S17/89

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. A point cloud attribute transfer algorithm may be used to determine distortion between an original point cloud and a reconstructed point cloud. Additionally, the point cloud attribute transfer algorithm may be used to select attribute values for a reconstructed point cloud such that distortion between an original point cloud and a reconstructed version of the original point cloud is minimized.

公开(公告)号：US11477483B2

公开(公告)日：2022-10-18

申请号：US17145192

申请日：2021-01-08

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Khaled Mammou ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/124 ,  H04N19/30 ,  H04N19/46

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for volumetric visual content and/or a decoder configured to decompress compressed attribute and/or spatial information for the volumetric visual content. The encoder is configured to convert a 3D representation of the visual volumetric content into a 2D image based representation. The encoder is further configured to scale the patch in 2D space independent of any scaling in 3D space. Auxiliary information is signaled for use in identifying 2D scaled or unscaled patches in an image frame, mapping the patches into 3D space, and adjusting for any scaling factors applied at the encoder.

公开(公告)号：US20220292722A1

公开(公告)日：2022-09-15

申请号：US17804477

申请日：2022-05-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim ,  Fabrice A. Robinet ,  Valery G. Valentin

IPC: G06T9/00 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Various compression strategies may be used to encode an occupancy map and related block-to-patch information indicating which portions of the image frame correspond to which packed patches. Packed image frames comprising patches and padding, along with an encoded occupancy map and related block-to-patch information are sent to a decoder. The decoder is configured to generate a decompressed point cloud based on the packed image frames, compressed occupancy map, and related block-to-patch information.

公开(公告)号：US11430155B2

公开(公告)日：2022-08-30

申请号：US16593994

申请日：2019-10-05

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Fabrice A. Robinet ,  Jungsun Kim ,  Khaled Mammou ,  Valery G. Valentin ,  Yeping Su

IPC: G06T9/00 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. The encoder is also configured to determine quantized minimum depths and/or maximum depths patch images in the image frames, wherein depth information is signaled relative to the quantized minimum depth.

公开(公告)号：US11196988B2

公开(公告)日：2021-12-07

申请号：US16669385

申请日：2019-10-30

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Krishnakanth Rapaka ,  David W. Singer

IPC: H04N19/105 ,  H04N19/172 ,  H04N19/174 ,  H04N19/184 ,  H04N19/513 ,  H04N19/70

Abstract: Techniques for encoding video with motion compensation include a compressed bitstream syntax that includes a list of all motion prediction reference frames without distinguishing between short-term reference frame and long-term reference frames. The list of reference frames may be provided in a slice header and may apply to encoded data video data within the corresponding slice. The list may be prefaced with a single number indicating the total number of reference frames. In an aspect delta POC reference numbers may be encoded with a flag indicating the sign of the delta POC when the absolute value of the POC is not equal to zero. In another aspect, a flag may be encoded for every reference frame indicating if POC information should be used when scaling prediction references, and a weighting parameter may be included when POC information should be used.

公开(公告)号：US11132818B2

公开(公告)日：2021-09-28

申请号：US16586785

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su

IPC: G06T9/00

Abstract: Attributes for point cloud compression may be predicted according to a space filling curve. An order for selecting points of a point cloud to be compressed in order to predict attributes of the points may be determined according to values of a space filling curve applied to spatial information for the points. A point of the point cloud may be selected according to the determined ordering. A prediction technique may be performed with respect to the selected point based on a set of neighboring points in the point cloud also selected according to the ordering. Predicted attribute values and correction values may be determined for the predicted values. The correction values may be encoded as part of a compressed version of the point cloud.

公开(公告)号：US20210264640A1

公开(公告)日：2021-08-26

申请号：US17318273

申请日：2021-05-12

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Alexandros Tourapis

IPC: G06T9/00 ,  G06T7/50

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.