公开(公告)号：US20210312670A1

公开(公告)日：2021-10-07

申请号：US17225081

申请日：2021-04-07

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  David Flynn ,  Alexandros Tourapis

IPC: G06T9/40

Abstract: A system receives encoded data regarding a points in a point cloud. The data includes a prediction tree having a nodes generated based on spatial information regarding the points and properties of a sensor system that obtained the spatial information. A value of each node represents first spatial coordinates of a respective one of the points according to a first coordinate system, and the value of at least a first node in the prediction tree is determined based on ancestor nodes of the first node and the properties of the sensor system. The system decodes the data to determine first data, including the first spatial coordinates of at least some of the points, and quantization parameters associated with the first spatial coordinates. The system determines second data based on the first data, including second spatial coordinates of at least some of the points according to a second coordinate system.

公开(公告)号：US20210266597A1

公开(公告)日：2021-08-26

申请号：US17319019

申请日：2021-05-12

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Fabrice A. Robinet ,  Yeping Su ,  David W. Singer

IPC: H04N19/597 ,  H04N19/17

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

公开(公告)号：US20210243451A1

公开(公告)日：2021-08-05

申请号：US16834693

申请日：2020-03-30

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jun Xin ,  Hsi-Jung Wu ,  Alexandros Tourapis ,  Krishnakanth Rapaka

IPC: H04N19/159 ,  H04N19/176 ,  H04N19/182

Abstract: Techniques are disclosed for deriving prediction pixel blocks for use in intra-coding video and combined inter- and intra-coding video. In a first aspect, the techniques may include deriving value(s) for pixel location(s) of the prediction pixel block by, when a prediction direction vector assigned to the prediction vector points to quadrants I or III of a Cartesian plane, deriving the pixel location's value from pixel values in two regions of previously-decoded pixel data intercepted by extending the prediction direction vector in two opposite directions through the pixel location. When the prediction direction vector points toward quadrants II of the Cartesian plane, deriving the pixel location's value from pixel values in one region intercepted by the prediction direction vector through the pixel location, and from a second region intercepted by a vector that is orthogonal to the prediction direction vector.

公开(公告)号：US20210195246A1

公开(公告)日：2021-06-24

申请号：US17127921

申请日：2020-12-18

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Hye-Yeon Cheong ,  David William Singer ,  Dominik Mehlem

IPC: H04N19/66 ,  H04N19/61 ,  H04N19/147 ,  H04N19/19 ,  H04N19/176

Abstract: A system comprises an encoder configured to compress media objects using a compression loop that includes a residual decomposition component that decomposes a residual signal for a block of the media object being compressed into multiple sub-error signals. The encoder is further configured to enable different transformation and/or quantization processes to be specified to be applied to different ones of the sub-errors. A corresponding decoder is configured to apply inverse transformation/quantization processing to the sub-error signals, based on the transformation/quantization processes that were applied at the encoder. The decoder then recreates a residual signal from the processed sub-error signals and uses the re-created residual signal to correct predicted values at the decoder.

公开(公告)号：US20210185331A1

公开(公告)日：2021-06-17

申请号：US17187439

申请日：2021-02-26

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim

IPC: H04N19/20 ,  H04N19/597 ,  H04N19/46 ,  H04N19/174 ,  G06T7/11 ,  G06T7/246

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder generates an occupancy map and may also encode the occupancy map as an image based representation. In some embodiments, a video encoder encodes image based representations of spatial information for the points of the point cloud, image based representations of attribute values for points of the point cloud, and an image based representation of an occupancy map for the spatial and attribute images.

公开(公告)号：US20210150765A1

公开(公告)日：2021-05-20

申请号：US17157833

申请日：2021-01-25

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su

IPC: G06T9/00 ,  H03M7/30

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.

公开(公告)号：US10986341B2

公开(公告)日：2021-04-20

申请号：US16294229

申请日：2019-03-06

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Guy Cote

IPC: H04N19/30 ,  H04N19/15 ,  H04N19/126 ,  H04N19/186 ,  H04N19/51 ,  H04N19/13 ,  H04N19/70 ,  H04N19/159 ,  H04N19/157 ,  H04N19/124 ,  H04N19/136 ,  H04N19/61 ,  H04N19/86 ,  H04N19/172 ,  H04N19/176 ,  H04N19/96

Abstract: A method of signaling additional chroma QP offset values that are specific to quantization groups is provided, in which each quantization group explicitly specifies its own set of chroma QP offset values. Alternatively, a table of possible sets of chroma QP offset values is specified in the header area of the picture, and each quantization group uses an index to select an entry from the table for determining its own set of chroma QP offset values. The quantization group specific chroma QP offset values are then used to determine the chroma QP values for blocks within the quantization group in addition to chroma QP offset values already specified for higher levels of the video coding hierarchy.

公开(公告)号：US20210103780A1

公开(公告)日：2021-04-08

申请号：US17061460

申请日：2020-10-01

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  David Flynn ,  Zhenzhen Gao

IPC: G06K9/62 ,  G06T7/70 ,  G06T11/20

Abstract: A search space for performing nearest neighbor searches for encoding point cloud data may be trimmed. Ranges of a space filling curve may be used to identify search space to exclude or reuse, instead of generating nearest neighbor search results for at least some of the points of a point cloud located within some of the ranges of the space filling curve. Additionally, neighboring voxels may be searched to identify any neighboring points missed during the trimmed search based on the ranges of the space filling curve.

公开(公告)号：US20210097725A1

公开(公告)日：2021-04-01

申请号：US17119893

申请日：2020-12-11

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06K9/62 ,  G06T5/00 ,  G06T19/20 ,  G06T7/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A closed-loop color conversion process is used to improve compression while taking into consideration distortion introduced throughout the point cloud compression process.

公开(公告)号：US20210082152A1

公开(公告)日：2021-03-18

申请号：US17104383

申请日：2020-11-25

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Khaled Mammou ,  Jungsun Kim ,  Yeping Su

IPC: G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. In order to improve computing efficiency and/or repeatability, fixed-point number representations are used when determining predicted attribute values and attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file using fixed-point number representations.