公开(公告)号：US20220353543A1

公开(公告)日：2022-11-03

申请号：US17867644

申请日：2022-07-18

Applicant: Apple Inc.

Inventor： Hye-Yeon Cheong ,  David W. Singer ,  Alexandros Tourapis

IPC: H04N19/82 ,  H04N19/107 ,  H04N19/137 ,  H04N19/182 ,  H04N19/186

Abstract: A system comprises an encoder configured to compress video data using an in-loop noise generation process that generates noise in the compression loop at a sub-image portion level of granularity, such as at a block level. The encoder includes noise model and/or noise model input parameter information in an encoded bit stream. Also, a system includes a decoder configured to receive such a bit stream and decompress the video using an in-loop noise generation process that generates noise in the decompression loop at a sub-image portion level of granularity.

公开(公告)号：US11454710B2

公开(公告)日：2022-09-27

申请号：US16736703

申请日：2020-01-07

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G01S7/4861 ,  G01S17/42 ,  H03M7/30

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. An order for the points is determined based on a space filling curve, wherein an encoder and a decoder determine a same order for the points based on the space filling curve. Levels of detail are determined by sampling the ordered points according to different sampling parameters, and attribute values are predicted for the points in the levels of detail using the determined order. The encoder determines attribute correction values based on a comparison of the predicted values to an original value prior to compression. The decoder corrects the predicted attribute values based on received attribute correction values.

公开(公告)号：US11450030B2

公开(公告)日：2022-09-20

申请号：US17030264

申请日：2020-09-23

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G06V20/00 ,  G06T9/00 ,  G06T3/40 ,  G06T5/00 ,  H04N19/20 ,  H04N19/597 ,  H04N19/80 ,  H04N19/172 ,  G06T17/20

Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.

公开(公告)号：US20220279181A1

公开(公告)日：2022-09-01

申请号：US17747368

申请日：2022-05-18

Applicant: Apple Inc.

Inventor： Alexandros Tourapis

IPC: H04N19/12 ,  H04N19/70 ,  H04N19/136 ,  H04N19/17 ,  H04N19/625 ,  H04N19/186

Abstract: An encoder system may include an analyzer that analyzes a current image area in an input video to select a transform. A selectable residue transformer, controlled by the analyzer, may perform the selectable transform on a residue image generated from the current image area and a predicted current image area, to generate a transformed residue image. An encoder may encode the transformed residue image to generate output data. The analyzer controls the encoder to encode information to identify the selectable transform and to indicate that the selectable transform for the current image area is different from a transform of a previous image area of the input video. A decoder system may include components appropriate for decoding the output data from the encoder system.

公开(公告)号：US11386524B2

公开(公告)日：2022-07-12

申请号：US16586872

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Yeping Su ,  David W. Singer ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T3/40 ,  G06T5/00 ,  G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding, wherein pixel values for the padding are determined based on neighboring pixels values such that the padding is smoothed in the image frame. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.

公开(公告)号：US11368688B2

公开(公告)日：2022-06-21

申请号：US16807879

申请日：2020-03-03

Applicant: Apple Inc.

Inventor： Alexandros Tourapis

IPC: H04N19/17 ,  H04N19/12 ,  H04N19/70 ,  H04N19/136 ,  H04N19/625 ,  H04N19/186

Abstract: An encoder system may include an analyzer that analyzes a current image area in an input video to select a transform. A selectable residue transformer, controlled by the analyzer, may perform the selectable transform on a residue image generated from the current image area and a predicted current image area, to generate a transformed residue image. An encoder may encode the transformed residue image to generate output data. The analyzer controls the encoder to encode information to identify the selectable transform and to indicate that the selectable transform for the current image area is different from a transform of a previous image area of the input video. A decoder system may include components appropriate for decoding the output data from the encoder system.

公开(公告)号：US11367224B2

公开(公告)日：2022-06-21

申请号：US16591530

申请日：2019-10-02

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim ,  Fabrice A Robinet ,  Valery G. Valentin

IPC: G06T9/00 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Various compression strategies may be used to encode an occupancy map and related block-to-patch information indicating which portions of the image frame correspond to which packed patches. Packed image frames comprising patches and padding, along with an encoded occupancy map and related block-to-patch information are sent to a decoder. The decoder is configured to generate a decompressed point cloud based on the packed image frames, compressed occupancy map, and related block-to-patch information.

公开(公告)号：US11361471B2

公开(公告)日：2022-06-14

申请号：US15931349

申请日：2020-05-13

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T7/50 ,  G06T9/00 ,  G06T7/70 ,  G06T7/20 ,  A01C3/02 ,  G08B1/00 ,  G09B1/00 ,  G06T1/00 ,  G11B7/002

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.

公开(公告)号：US11323730B2

公开(公告)日：2022-05-03

申请号：US16561478

申请日：2019-09-05

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jun Xin ,  Yeping Su ,  Hsi-Jung Wu ,  Alexandros Tourapis

IPC: G01R31/34 ,  H02P29/024 ,  H01H71/70 ,  H04N19/44 ,  H04N19/159 ,  H04N19/177 ,  H04N19/172 ,  H04N19/46

Abstract: Techniques for video exchange are disclosed in which a video source sends redundant copies of video coded at a given presentation time. A decoder may determine, from metadata stored with a first decoded frame, whether other decoded frames have been designated as correlated to the first decoded frame. If so, the decoder may fetch other decoding frames using time indicator values of other decoded frames in metadata stored with the first decoded frame. When other decoded frame(s) are found, the decoder may blend content of the first coded frame and the other decoded frame(s). The decoder may render the blended frame. When one such coded frame is an intra-coded frame, the proposed technique may alleviate beating artifacts by blending recovered data of the intra-coded frame with recovered data of another frame, which may be inter-coded.

公开(公告)号：US20220109857A1

公开(公告)日：2022-04-07

申请号：US17554587

申请日：2021-12-17

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Athanasios Leontaris

IPC: H04N19/176 ,  H04N19/14 ,  H04N19/117 ,  H04N19/86

Abstract: Video coding schemes may include one or more filters to reduce coding artifacts and improve video quality. These filters may be applied to decode video data in a predetermined sequence. The output from one or more of these filters may be selected for different images, blocks, or sets of video data and then copied and/or routed to a display or a buffer storing reference data that is used to decode other video data in a data stream. Providing the ability to select which filter output is used for display and as a reference may result in better video quality for multiple types of video data. The filters that are selected for display and for reference may be different and may vary for different images, blocks, and data sets.