公开(公告)号：US20160360231A1

公开(公告)日：2016-12-08

申请号：US14732393

申请日：2015-06-05

Applicant: Apple Inc.

Inventor： Hang Yuan ,  Chris Y. Chung ,  Jae Hoon Kim ,  Yeping Su ,  Jiefu Zhai ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/55 ,  H04N19/126 ,  H04N19/172 ,  H04N19/85 ,  H04N19/159

CPC classification number: H04N19/85 ,  H04N19/33 ,  H04N19/503 ,  H04N19/88

Abstract: Coding techniques for image data may cause a still image to be converted to a “phantom” video sequence, which is coded by motion compensated prediction techniques. Thus, coded video data obtained from the coding operation may include temporal prediction references between frames of the video sequence. Metadata may be generated that identifies allocations of content from the still image to the frames of the video sequence. The coded data and the metadata may be transmitted to another device, whereupon it may be decoded by motion compensated prediction techniques and converted back to a still image data. Other techniques may involve coding an image in both a base layer representation and at least one coded enhancement layer representation. The enhancement layer representation may be coded predictively with reference to the base layer representation. The coded base layer representation may be partitioned into a plurality of individually-transmittable segments and stored. Prediction references of elements of the enhancement layer representation may be confined to segments of the base layer representation that correspond to a location of those elements. Meaning, when a pixel block of an enhancement layer maps to a given segment of the base layer representation, prediction references are confined to that segment and do not reference portions of the base layer representation that may be found in other segment(s).

Abstract translation: 用于图像数据的编码技术可以使静止图像被转换成通过运动补偿预测技术编码的“幻影”视频序列。 因此，从编码操作获得的编码视频数据可以包括视频序列的帧之间的时间预测参考。 可以生成元数据，其识别从静止图像到视频序列的帧的内容的分配。 编码数据和元数据可以被发送到另一个设备，于是可以通过运动补偿预测技术对其进行解码并转换成静止图像数据。 其他技术可以包括在基本层表示和至少一个编码的增强层表示中对图像进行编码。 增强层表示可以参考基本层表示预测地编码。 编码的基本层表示可以被划分成多个可单独传送的段并被存储。 增强层表示的元素的预测参考可以被限制为对应于那些元素的位置的基本层表示的段。 意思是，当增强层的像素块映射到基本层表示的给定段时，预测参考限于该段，并且不引用可能在其他段中找到的基本层表示的部分。

公开(公告)号：US20150016804A1

公开(公告)日：2015-01-15

申请号：US13941174

申请日：2013-07-12

Applicant: Apple Inc.

Inventor： David L. Biderman ,  Xiaosong Zhou ,  Douglas Scott Price ,  Yeping Su ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Zhenheng Li ,  John Su ,  James D. Batson

IPC: G11B27/30 ,  G11B27/00

CPC classification number: H04N21/6125 ,  G06K9/00718 ,  G06K2009/00738 ,  G11B27/005 ,  G11B27/3081 ,  H04N21/262 ,  H04N21/440281 ,  H04N21/6587 ,  H04N21/8456

Abstract: System and methods for improved playback of a video stream are presented. Video snippets are identified that include a number of consecutive frames for playback. Snippets may be evenly temporally spaced in the video stream or may be content adaptive. Then the first frame of a snippet may be selected as the first frame of a scene or other appropriate stopping point. Scene detection, object detection, motion detection, video metadata, or other information generated during encoding or decoding of the video stream may aid in appropriate snippet selection.

Abstract translation: 介绍了改进视频流播放的系统和方法。 识别包括多个连续帧进行播放的视频片段。 片段可以在视频流中均匀地间隔开，或者可以是内容自适应的。 然后，片段的第一帧可以被选择为场景或其他适当停止点的第一帧。 在视频流的编码或解码过程中产生的场景检测，对象检测，运动检测，视频元数据或其他信息可能有助于适当的片段选择。

公开(公告)号：US20250054197A1

公开(公告)日：2025-02-13

申请号：US18806983

申请日：2024-08-16

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Fabrice A. Robinet ,  Jungsun Kim ,  Khaled Mammou ,  Valery G. Valentin ,  Yeping Su

IPC: G06T9/00 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. The encoder is also configured to determine quantized minimum depths and/or maximum depths patch images in the image frames, wherein depth information is signaled relative to the quantized minimum depth.

公开(公告)号：US20240412419A1

公开(公告)日：2024-12-12

申请号：US18807049

申请日：2024-08-16

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T9/00 ,  G01S17/89 ,  G06F16/901 ,  G06T17/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. A point cloud attribute transfer algorithm may be used to determine distortion between an original point cloud and a reconstructed point cloud. Additionally, the point cloud attribute transfer algorithm may be used to select attribute values for a reconstructed point cloud such that distortion between an original point cloud and a reconstructed version of the original point cloud is minimized.

公开(公告)号：US11922665B2

公开(公告)日：2024-03-05

申请号：US18063592

申请日：2022-12-08

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su

IPC: G06T9/00 ,  H03M7/30

CPC classification number: G06T9/001 ,  H03M7/30 ,  H03M7/3059 ,  H03M7/70

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.

公开(公告)号：US11748916B2

公开(公告)日：2023-09-05

申请号：US17804477

申请日：2022-05-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim ,  Fabrice A. Robinet ,  Valery G. Valentin

IPC: G06T9/00 ,  H04N19/597

CPC classification number: G06T9/001 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Various compression strategies may be used to encode an occupancy map and related block-to-patch information indicating which portions of the image frame correspond to which packed patches. Packed image frames comprising patches and padding, along with an encoded occupancy map and related block-to-patch information are sent to a decoder. The decoder is configured to generate a decompressed point cloud based on the packed image frames, compressed occupancy map, and related block-to-patch information.

公开(公告)号：US11727603B2

公开(公告)日：2023-08-15

申请号：US17318273

申请日：2021-05-12

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Alexandros Tourapis

IPC: G06T9/00 ,  G06T7/50

CPC classification number: G06T9/00 ,  G06T7/50 ,  G06T2207/10012 ,  G06T2207/10028

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.

公开(公告)号：US11663744B2

公开(公告)日：2023-05-30

申请号：US17306863

申请日：2021-05-03

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T3/40 ,  H03M7/30 ,  G06T17/20

CPC classification number: G06T9/00 ,  G06T3/40 ,  G06T17/20 ,  H03M7/6005 ,  H03M7/6011

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.

公开(公告)号：US11539974B2

公开(公告)日：2022-12-27

申请号：US17493607

申请日：2021-10-04

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Yeping Su ,  David Singer ,  Hsi-Jung Wu

IPC: H04N19/50 ,  H04N19/184 ,  H04N19/167 ,  H04N19/436 ,  H04N19/186 ,  H04N19/132 ,  H04N19/124 ,  H04N19/13 ,  H04N19/15 ,  H04N19/30 ,  H04N19/42 ,  H04N19/48 ,  H04N19/182

Abstract: Video compression and decompression techniques are disclosed that provide improved bandwidth control for video compression and decompression systems. In particular, video coding and decoding techniques quantize input video in multiple dimensions. According to these techniques, pixel residuals may be generated from a comparison of an array of input data to an array of prediction data. The pixel residuals may be quantized in a first dimension. After the quantization, the quantized pixel residuals may be transformed to an array of transform coefficients. The transform coefficients may be quantized in a second dimension and entropy coded. Decoding techniques invert these processes. In still other embodiments, multiple quantizers may be provided upstream of the transform stage, either in parallel or in cascade, which provide greater flexibility to video coders to quantize data in different dimensions in an effort to balance the competing interest in compression efficiency and quality of reconstructed video.

公开(公告)号：US11386524B2

公开(公告)日：2022-07-12

申请号：US16586872

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Yeping Su ,  David W. Singer ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T3/40 ,  G06T5/00 ,  G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding, wherein pixel values for the padding are determined based on neighboring pixels values such that the padding is smoothed in the image frame. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.