公开(公告)号：US20210227236A1

公开(公告)日：2021-07-22

申请号：US17221299

申请日：2021-04-02

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/29 ,  H04N19/103 ,  G09G5/14 ,  H04N21/44

Abstract: Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source.

公开(公告)号：US20210183112A1

公开(公告)日：2021-06-17

申请号：US17163194

申请日：2021-01-29

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Fabrice A. Robinet ,  Valery G. Valentin ,  Yeping Su

IPC: G06T9/00 ,  G06T17/00

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, multiple levels of detail are generated based on spatial information. Also, attribute values are predicted based on the level of details. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, an update operation is performed to smooth attribute correction values taking into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.

公开(公告)号：US11012713B2

公开(公告)日：2021-05-18

申请号：US16510706

申请日：2019-07-12

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Fabrice A. Robinet ,  Yeping Su ,  David W. Singer

IPC: H04N19/597 ,  H04N19/17

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

公开(公告)号：US10979718B2

公开(公告)日：2021-04-13

申请号：US15874655

申请日：2018-01-18

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Alexandros Tourapis

IPC: H04N19/159 ,  H04N19/154 ,  H04N19/59 ,  H04N19/86 ,  H04N19/46 ,  G06T9/00 ,  G06N3/04 ,  G06N3/08 ,  H04N19/102 ,  H04N19/117 ,  H04N19/189 ,  H04N19/132 ,  H04N19/90 ,  H04N19/136 ,  H04N19/172 ,  H04N19/436

Abstract: System and method for improving video encoding and/or video decoding. In embodiments, a video encoding pipeline includes a main encoding pipeline that compresses source image data corresponding with an image frame by processing the source image data based at least in part on encoding parameters to generate encoded image data. Additionally the video encoding pipeline includes a machine learning block communicatively coupled to the main encoding pipeline, in which the machine learning block analyzes content of the image frame by processing the source image data based at least in part on machine learning parameters implemented in the machine learning block when the machine learning block is enabled by the encoding parameters; and the video encoding pipeline adaptively adjusts the encoding parameters based at least in part on the content expected to be present in the image frame to facilitate improving encoding efficiency.

公开(公告)号：US20210105022A1

公开(公告)日：2021-04-08

申请号：US17061411

申请日：2020-10-01

Applicant: Apple Inc.

Inventor： David Flynn ,  Alexandros Tourapis ,  Khaled Mammou

IPC: H03M7/40

Abstract: A system comprises an encoder configured to entropy encode a bitstream comprising both compressible and non-compressible symbols. The encoder parses the bitstream into a compressible symbol sub-stream and a non-compressible sub-stream. The non-compressible symbol sub-stream bypass an entropy encoding component of the encoder while the compressible symbol sub-stream is entropy encoded. When a quantity of bytes of entropy encoded symbols and bypass symbols is accumulated a chunk of fixed or known size is formed using the accumulated entropy encoded symbol bytes and the bypass bytes without waiting on the full bitstream to be processed by the encoder. In a complementary manner, a decoder reconstructs the bitstream from the packets or chunks.

公开(公告)号：US20210099711A1

公开(公告)日：2021-04-01

申请号：US17031782

申请日：2020-09-24

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou ,  Liviu Traian Christian Tulvan ,  Marius Preda

IPC: H04N19/139 ,  H04N19/107 ,  H04N19/147 ,  G06T9/00 ,  H04N19/96

Abstract: A system comprises an encoder configured to compress attribute information for a dynamic point cloud and/or a decoder configured to decompress compressed attribute information for a dynamic point cloud. The dynamic point cloud may include multiple versions of the point cloud at multiple moments in time Attribute values for the point cloud may be compressed at a reference frame using an intra-prediction process and may be compressed at one or more reference frames using an inter-prediction process that takes advantage of temporal relationships between different frames (e.g. versions) of the dynamic point cloud at the different moments in time.

公开(公告)号：US20210097722A1

公开(公告)日：2021-04-01

申请号：US16586785

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su

IPC: G06T9/00

Abstract: Attributes for point cloud compression may be predicted according to a space filling curve. An order for selecting points of a point cloud to be compressed in order to predict attributes of the points may be determined according to values of a space filling curve applied to spatial information for the points. A point of the point cloud may be selected according to the determined ordering. A prediction technique may be performed with respect to the selected point based on a set of neighboring points in the point cloud also selected according to the ordering. Predicted attribute values and correction values may be determined for the predicted values. The correction values may be encoded as part of a compressed version of the point cloud.

公开(公告)号：US10939139B2

公开(公告)日：2021-03-02

申请号：US16204792

申请日：2018-11-29

Applicant: Apple Inc.

Inventor： Xiaohua Yang ,  Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/52 ,  H04N19/90 ,  H04N19/597 ,  H04N21/2343 ,  G06F3/01

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US10812801B2

公开(公告)日：2020-10-20

申请号：US14631410

申请日：2015-02-25

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  David Singer

IPC: H04N19/52 ,  H04N19/182 ,  H04N19/14 ,  H04N19/176 ,  G06F3/14 ,  G09G5/02 ,  G09G5/10 ,  H04N1/64 ,  H04N5/20 ,  H04N5/235 ,  H04N19/172 ,  H04N19/102 ,  H04N19/137 ,  H04N19/177 ,  H04N19/124 ,  H04N19/154 ,  H04N19/17 ,  H04N19/98 ,  H04N21/422 ,  H04N21/431 ,  G06T5/00 ,  G09G3/20 ,  G09G5/00 ,  H04N1/60 ,  H04N5/50 ,  H04N9/64 ,  H04N9/67 ,  H04N19/136 ,  H04N19/184 ,  H04N19/186 ,  H04N19/169 ,  H04N19/44 ,  H04N19/30 ,  H04N19/33 ,  H04N19/86 ,  H04N19/463 ,  H04N21/4223 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/485

Abstract: A video encoding and decoding system that implements an adaptive transfer function method internally within the codec for signal representation. A focus dynamic range representing an effective dynamic range of the human visual system may be dynamically determined for each scene, sequence, frame, or region of input video. The video data may be cropped and quantized into the bit depth of the codec according to a transfer function for encoding within the codec. The transfer function may be the same as the transfer function of the input video data or may be a transfer function internal to the codec. The encoded video data may be decoded and expanded into the dynamic range of display(s). The adaptive transfer function method enables the codec to use fewer bits for the internal representation of the signal while still representing the entire dynamic range of the signal in output.

公开(公告)号：US20200275125A1

公开(公告)日：2020-08-27

申请号：US16872280

申请日：2020-05-11

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet ,  Andrea Cremaschi ,  Alexandros Tourapis

IPC: H04N19/597 ,  G06T17/00 ,  H04N19/119 ,  H04N19/167 ,  H04N19/182 ,  H04N19/59 ,  H04N19/132

Abstract: A system comprises an encoder configured to compress a point cloud comprising a plurality of points each point comprising spatial information for the point. The encoder is configured to sub-sample the points and determine subdivision locations for the subsampled points. Also, the encoder is configured to determine, for respective subdivision location, if a point is to be included, not included, or relocated relative to the subdivision location. The encoder encodes spatial information for the sub-sampled points and encodes subdivision location point inclusion/relocation information to generate a compressed point cloud. A decoder recreates an original or near replica of an original point cloud based on the spatial information and the subdivision location inclusion/relocation information included in the compressed point cloud.