公开(公告)号：US10999583B2

公开(公告)日：2021-05-04

申请号：US16132219

申请日：2018-09-14

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/29 ,  H04N19/103 ,  G09G5/14 ,  H04N21/44

Abstract: Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source.

公开(公告)号：US20210099701A1

公开(公告)日：2021-04-01

申请号：US17031792

申请日：2020-09-24

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou ,  Dominik Mehlem

IPC: H04N19/117 ,  H04N19/60 ,  H04N19/80 ,  H04N19/136 ,  H04N19/12 ,  H04N19/172 ,  H04N19/184

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder applies an attribute transfer function to attributes of an image based representation with out-of-loop smoothing such that a decoder may apply any smoothing filter supported by the decoder without being restricted to using a similar smoothing filter as the encoder.

公开(公告)号：US20210097723A1

公开(公告)日：2021-04-01

申请号：US17031787

申请日：2020-09-24

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Chao Cao ,  Marius Preda

IPC: G06T9/00 ,  G06T5/00 ,  G06T7/73 ,  H04N19/137 ,  H04N19/60 ,  H04N19/80 ,  H04N19/172

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder generates time-consistent patches for multiple version of the point cloud at multiple moments in time and uses the time-consistent patches to generate image based representations of the point cloud at the multiple moments in time.

公开(公告)号：US20210012536A1

公开(公告)日：2021-01-14

申请号：US17032711

申请日：2020-09-25

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T7/20 ,  G06T7/50 ,  H04N19/172

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder is configured project the point cloud on to patch planes to compress the point cloud, and supports multiple layered patch planes. For example, some point clouds may have a depth, and points at different depths may be assigned to different layered patch planes.

公开(公告)号：US10853973B2

公开(公告)日：2020-12-01

申请号：US16592711

申请日：2019-10-03

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Khaled Mammou ,  Jungsun Kim ,  Yeping Su

IPC: G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. In order to improve computing efficiency and/or repeatability, fixed-point number representations are used when determining predicted attribute values and attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file using fixed-point number representations.

公开(公告)号：US10805646B2

公开(公告)日：2020-10-13

申请号：US16449171

申请日：2019-06-21

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Khaled Mammou

IPC: H04N19/96 ,  H04N19/91 ,  G06T9/00 ,  H04N19/176

Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.

公开(公告)号：US20200221089A1

公开(公告)日：2020-07-09

申请号：US16823064

申请日：2020-03-18

Applicant: Apple Inc.

Inventor： Alexandros Tourapis

IPC: H04N19/12 ,  H04N19/70 ,  H04N19/136 ,  H04N19/17 ,  H04N19/625 ,  H04N19/186

Abstract: An encoder system may include an analyzer that analyzes a current image area in an input video to select a transform. A selectable residue transformer, controlled by the analyzer, may perform the selectable transform on a residue image generated from the current image area and a predicted current image area, to generate a transformed residue image. An encoder may encode the transformed residue image to generate output data. The analyzer controls the encoder to encode information to identify the selectable transform and to indicate that the selectable transform for the current image area is different from a transform of a previous image area of the input video. A decoder system may include components appropriate for decoding the output data from the encoder system.

公开(公告)号：US10699444B2

公开(公告)日：2020-06-30

申请号：US16198635

申请日：2018-11-21

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T7/20 ,  G06T9/00 ,  G06T7/70 ,  G06T7/50

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.

公开(公告)号：US10659816B2

公开(公告)日：2020-05-19

申请号：US16569433

申请日：2019-09-12

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet ,  Andrea Cremaschi ,  Alexandros Tourapis

IPC: H04N19/60 ,  H04N19/597 ,  H04N19/59 ,  H04N19/182 ,  H04N19/132 ,  G06T17/00 ,  H04N19/119 ,  H04N19/167

Abstract: A system comprises an encoder configured to compress a point cloud comprising a plurality of points each point comprising spatial information for the point. The encoder is configured to sub-sample the points and determine subdivision locations for the subsampled points. Also, the encoder is configured to determine, for respective subdivision location, if a point is to be included, not included, or relocated relative to the subdivision location. The encoder encodes spatial information for the sub-sampled points and encodes subdivision location point inclusion/relocation information to generate a compressed point cloud. A decoder recreates an original or near replica of an original point cloud based on the spatial information and the subdivision location inclusion/relocation information included in the compressed point cloud.

公开(公告)号：US20200099942A1

公开(公告)日：2020-03-26

申请号：US16583153

申请日：2019-09-25

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Yeping Su ,  Khaled Mammou ,  Jungsun Kim ,  David W. Singer ,  Fabrice A. Robinet ,  Guy Cote ,  Jim C. Chou ,  Hsi-Jung Wu

IPC: H04N19/186 ,  H04N19/124 ,  H04N19/176 ,  H04N19/159

Abstract: Support for additional components may be specified in a coding scheme for image data. A layer of a coding scheme that specifies color components may also specify additional components. Characteristics of the components may be specified in the same layer or a different layer of the coding scheme. An encoder or decoder may identify the specified components and determine the respective characteristics to perform encoding and decoding of image data.