公开(公告)号：US10602143B2

公开(公告)日：2020-03-24

申请号：US15680118

申请日：2017-08-17

Applicant: Apple Inc.

Inventor： Alexandros Tourapis

IPC: H04N19/12 ,  H04N19/70 ,  H04N19/136 ,  H04N19/17 ,  H04N19/625 ,  H04N19/186

Abstract: An encoder system may include an analyzer that analyzes a current image area in an input video to select a transform. A selectable residue transformer, controlled by the analyzer, may perform the selectable transform on a residue image generated from the current image area and a predicted current image area, to generate a transformed residue image. An encoder may encode the transformed residue image to generate output data. The analyzer controls the encoder to encode information to identify the selectable transform and to indicate that the selectable transform for the current image area is different from a transform of a previous image area of the input video. A decoder system may include components appropriate for decoding the output data from the encoder system.

公开(公告)号：US20200092571A1

公开(公告)日：2020-03-19

申请号：US16132219

申请日：2018-09-14

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/29 ,  H04N21/44 ,  G09G5/14 ,  H04N19/103

Abstract: Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source.

公开(公告)号：US20200021847A1

公开(公告)日：2020-01-16

申请号：US16510706

申请日：2019-07-12

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Fabrice A. Robinet ,  Yeping Su ,  David W. Singer

IPC: H04N19/597 ,  H04N19/17

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

公开(公告)号：US20200007867A1

公开(公告)日：2020-01-02

申请号：US16459485

申请日：2019-07-01

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Fabrice A. Robinet ,  Khaled Mammou ,  Valery G. Valentin ,  Yeping Su

IPC: H04N19/14 ,  H04N19/184 ,  H04N19/172 ,  H04N19/124 ,  H04N19/80 ,  H04N19/117

Abstract: A system comprises an encoder configured to compress images, such as image frames comprising attribute information and/or spatial for a point cloud and/or an occupancy map for the point cloud. Also, a system includes a decoder configured to decompress compressed image frames, such as image frames comprising compressed attribute and/or spatial information for the point cloud or an occupancy map for the point cloud. Additionally, the encoder may map N-bit data to M-bit code words, where M is less than N. Alternatively the encoder may map N-bit data to M-bit code words, where M is greater than N. In a similar manner, a decoder may map the M-bit code words back to the N-bit data.

公开(公告)号：US20190394496A1

公开(公告)日：2019-12-26

申请号：US16449171

申请日：2019-06-21

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Khaled Mammou

IPC: H04N19/96 ,  H04N19/91 ,  H04N19/176 ,  G06T9/00

Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.

公开(公告)号：US20190311501A1

公开(公告)日：2019-10-10

申请号：US16380930

申请日：2019-04-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Fabrice A. Robinet ,  Valery G. Valentin ,  Yeping Su

IPC: G06T9/00 ,  G06T17/00

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, multiple levels of detail are generated based on spatial information. Also, attribute values are predicted based on the level of details. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, an update operation is performed to smooth attribute correction values taking into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.

公开(公告)号：US20190311500A1

公开(公告)日：2019-10-10

申请号：US16380928

申请日：2019-04-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim

IPC: G06T9/00 ,  G06T17/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder may be configured to further compress points omitted from the image based representation. Also, in some embodiments, a decoder may be configured to decode points compressed outside of an image based representation or in a separate image based representation.

公开(公告)号：US20190208205A1

公开(公告)日：2019-07-04

申请号：US16294258

申请日：2019-03-06

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Guy Cote

IPC: H04N19/124 ,  H04N19/61 ,  H04N19/159 ,  H04N19/30 ,  H04N19/86 ,  H04N19/157 ,  H04N19/15 ,  H04N19/126 ,  H04N19/136 ,  H04N19/70 ,  H04N19/51 ,  H04N19/13 ,  H04N19/186

CPC classification number: H04N19/124 ,  H04N19/126 ,  H04N19/13 ,  H04N19/136 ,  H04N19/15 ,  H04N19/157 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/186 ,  H04N19/30 ,  H04N19/51 ,  H04N19/61 ,  H04N19/70 ,  H04N19/86 ,  H04N19/96

Abstract: A method of signaling additional chroma QP offset values that are specific to quantization groups is provided, in which each quantization group explicitly specifies its own set of chroma QP offset values. Alternatively, a table of possible sets of chroma QP offset values is specified in the header area of the picture, and each quantization group uses an index to select an entry from the table for determining its own set of chroma QP offset values. The quantization group specific chroma QP offset values are then used to determine the chroma QP values for blocks within the quantization group in addition to chroma QP offset values already specified for higher levels of the video coding hierarchy.

公开(公告)号：US20190156519A1

公开(公告)日：2019-05-23

申请号：US16198634

申请日：2018-11-21

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T7/20 ,  G06T7/50

CPC classification number: G06T9/00 ,  G06T5/006 ,  G06T7/20 ,  G06T7/50 ,  G06T19/20 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2219/2012 ,  H04N19/172

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder is configured project the point cloud on to patch planes to compress the point cloud, and supports multiple layered patch planes. For example, some point clouds may have a depth, and points at different depths may be assigned to different layered patch planes.