公开(公告)号：US20140029663A1

公开(公告)日：2014-01-30

申请号：US13707404

申请日：2012-12-06

Applicant: APPLE INC.

Inventor： Yeping Su ,  Hsi-Jung Wu ,  Hao Pan

IPC: H04N7/26

CPC classification number: H04N19/10 ,  H04N19/117 ,  H04N19/14 ,  H04N19/17 ,  H04N19/176 ,  H04N19/463 ,  H04N19/577 ,  H04N19/61 ,  H04N19/80

Abstract: Video encoders often produce banding artifacts on areas with smooth gradients and low levels of detail/noise. In this disclosure, a video encoding system identifies the banded areas and adjusts coding parameters accordingly. The video coder may include a pre-coding banding detector and a post-coding banding detector. The pre-coding detector may identify regions in the input picture with smooth gradients that are likely to have banding artifacts after encoding. The post-coding detector may identify regions in the reconstructed picture with visible banding. Usage of pre-coding detector and/or post-coding detector depends on how an encoder operates. In a single-pass encoding or during the first pass of a multi-pass encoding, the pre-coding detection maps are used. During picture re-encoding or during later passes of a multi-pass encoding, the post-coding detector maps are used.

Abstract translation: 视频编码器经常在平滑梯度和低细节/噪音水平的区域产生带状伪影。 在本公开中，视频编码系统识别带状区域并相应地调整编码参数。 视频编码器可以包括预编码带状检测器和后编码条带检测器。 预编码检测器可以在编码后可能具有可能具有带状伪影的平滑梯度来识别输入图像中的区域。 后编码检测器可以用可见条带识别重建图像中的区域。 预编码检测器和/或后编码检测器的使用取决于编码器如何工作。 在单遍编码中或在多遍编码的第一遍期间，使用预编码检测图。 在图像重新编码期间或在多遍编码的稍后通过期间，使用后编码检测器图。

公开(公告)号：US11647226B2

公开(公告)日：2023-05-09

申请号：US17319019

申请日：2021-05-12

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Fabrice A. Robinet ,  Yeping Su ,  David W. Singer

IPC: H04N19/597 ,  H04N19/17 ,  G06T9/00

CPC classification number: H04N19/597 ,  H04N19/17 ,  G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

公开(公告)号：US20230125227A1

公开(公告)日：2023-04-27

申请号：US18063592

申请日：2022-12-08

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su

IPC: G06T9/00 ,  H03M7/30

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.

公开(公告)号：US11363309B2

公开(公告)日：2022-06-14

申请号：US17067458

申请日：2020-10-09

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Khaled Mammou

IPC: H04N19/96 ,  H04N19/91 ,  G06T9/00 ,  H04N19/176 ,  G06T17/00

Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.

公开(公告)号：US11276203B2

公开(公告)日：2022-03-15

申请号：US17104383

申请日：2020-11-25

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Khaled Mammou ,  Jungsun Kim ,  Yeping Su

IPC: G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. In order to improve computing efficiency and/or repeatability, fixed-point number representations are used when determining predicted attribute values and attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file using fixed-point number representations.

公开(公告)号：US11202098B2

公开(公告)日：2021-12-14

申请号：US16503933

申请日：2019-07-05

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/85 ,  H04N19/463

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.

公开(公告)号：US20210377547A1

公开(公告)日：2021-12-02

申请号：US17404452

申请日：2021-08-17

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Yeping Su ,  David W. Singer ,  Hsi-Jung Wu

IPC: H04N19/186 ,  H04N19/189 ,  H04N9/64 ,  H04N11/20 ,  H04N19/70 ,  H04N19/46 ,  H04N19/117 ,  H04N19/132 ,  H04N19/154 ,  H04N19/59 ,  H04N9/67 ,  H04N19/82 ,  H04N19/147 ,  H04N19/80 ,  H04N19/85 ,  H04N19/44

Abstract: A method of adaptive chroma downsampling is presented. The method comprises converting a source image to a converted image in an output color format, applying a plurality of downsample filters to the converted image and estimating a distortion for each filter chose the filter that produces the minimum distortion. The distortion estimation includes applying an upsample filter, and a pixel is output based on the chosen filter. Methods for closed loop conversions are also presented.

公开(公告)号：US11166027B2

公开(公告)日：2021-11-02

申请号：US15614881

申请日：2017-06-06

Applicant: Apple Inc.

Inventor： Yeping Su ,  Xingyu Zhang ,  Chris Chung ,  Jun Xin ,  Hsi-Jung Wu

IPC: H04B1/66 ,  H04N19/136 ,  H04N19/103 ,  G06N20/00 ,  H04N19/179 ,  H04N21/845 ,  H04N21/2343

Abstract: Techniques are disclosed by which a coding parameter is determined to encode video data resulting in encoded video data possessing a highest possible video quality. Features may be extracted from an input video sequence. The extracted features may be compared to features described in a model of coding parameters generated by a machine learning algorithm from reviews of previously-coded videos, extracted features of the previously-coded videos, and coding parameters of the previously-coded videos. When a match is detected between the extracted features of the input video sequence and extracted features represented in the model, a determination may be made as to whether coding parameters that correspond to the matching extracted feature correspond to a tier of service to which the input video sequence is to be coded. When the coding parameters that correspond to the matching extracted feature correspond to the tier of service to which the input video sequence is to be coded, the input video sequence may be coded according to the coding parameters.

公开(公告)号：US20210266597A1

公开(公告)日：2021-08-26

申请号：US17319019

申请日：2021-05-12

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Fabrice A. Robinet ,  Yeping Su ,  David W. Singer

IPC: H04N19/597 ,  H04N19/17

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

公开(公告)号：US20210185331A1

公开(公告)日：2021-06-17

申请号：US17187439

申请日：2021-02-26

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim

IPC: H04N19/20 ,  H04N19/597 ,  H04N19/46 ,  H04N19/174 ,  G06T7/11 ,  G06T7/246

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder generates an occupancy map and may also encode the occupancy map as an image based representation. In some embodiments, a video encoder encodes image based representations of spatial information for the points of the point cloud, image based representations of attribute values for points of the point cloud, and an image based representation of an occupancy map for the spatial and attribute images.