-
公开(公告)号:US20240048776A1
公开(公告)日:2024-02-08
申请号:US17956444
申请日:2022-09-29
Applicant: Apple Inc.
Inventor: Yixin Du , Alexandros Tourapis , Alican Nalci , Guoxin Jin , Hilmi Enes Egilmez , Hsi-Jung Wu , Jun Xin , Yeqing Wu , Yunfei Zheng
IPC: H04N19/86 , H04N19/117 , H04N19/139 , H04N19/176
CPC classification number: H04N19/86 , H04N19/117 , H04N19/139 , H04N19/176
Abstract: Disclosed is a method that includes receiving an image frame having a plurality of coded blocks, determining a prediction unit (PU) from the plurality of coded blocks, determining one or more motion compensation units arranged in an array within the PU, and applying a filter to one or more boundaries of the one or more motion compensation units. Also disclosed is a method that includes receiving a reference frame that includes a reference block, determining a timing for deblocking a current block, performing motion compensation on the reference frame to obtain a predicted frame that includes a predicted block, performing reconstruction on the predicted frame to obtain a reconstructed frame that includes a reconstructed PU, and applying, at the timing for deblocking the current block, a deblocking filter based on one or more parameters to the reference block, the predicted block, or the reconstructed PU.
-
公开(公告)号:US20240040151A1
公开(公告)日:2024-02-01
申请号:US18312077
申请日:2023-05-04
Applicant: Apple Inc.
Inventor: Alican Nalci , Yunfei Zheng , Hilmi E. Egilmez , Yeqing WU , Yixin Du , Alexis Tourapis , Jun Xin , Hsi-Jung Wu
IPC: H04N19/60 , H04N19/124 , H04N19/18 , H04N19/172
CPC classification number: H04N19/60 , H04N19/124 , H04N19/18 , H04N19/172
Abstract: Techniques are described for express and implied signaling of transform mode selections in video coding. Information derived from coefficient samples in a given transform unit (TU) or prediction unit (PU) may constrain or modify signaling of certain syntax elements at the coding block (CB), TU, or PU levels. For instance, based on the spatial locations of decoded coefficients, the spatial patterns of coefficients, or the correlation with the coefficients in neighboring blocks, various syntax elements such as the transform type and related flags/indices or secondary transform modes/flags indices, a residual coding mode, intra and inter prediction modes, and scanning order may be disabled or constrained. In another case, if the coefficient samples match a desired spatial pattern or have other desired properties then a default transform type, a default secondary transform type, a default intra and inter prediction mode or other block level modes may be inferred at the decoder side. Similar ideas may be extended to infer intra-block copy (IBC) flags/modes/indices from coefficient samples, or to infer flags and modes related to predictive coding techniques such as block-wise differential pulse code modulation (BDPCM), i.e., horizontal and vertical BDPCM modes, palette mode syntax and other block level flags/indices.
-
公开(公告)号:US11663744B2
公开(公告)日:2023-05-30
申请号:US17306863
申请日:2021-05-03
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Khaled Mammou , Yeping Su , Jungsun Kim , Valery G. Valentin , David W. Singer , Fabrice A. Robinet , Hsi-Jung Wu
CPC classification number: G06T9/00 , G06T3/40 , G06T17/20 , H03M7/6005 , H03M7/6011
Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.
-
公开(公告)号:US20230117742A1
公开(公告)日:2023-04-20
申请号:US18083468
申请日:2022-12-16
Applicant: Apple Inc.
Inventor: Fanyi Duanmu , Jun Xin , Hsi-Jung Wu , Xiaosong Zhou
IPC: H04N13/117 , H04N21/218 , H04N21/24 , H04N13/178
Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.
-
公开(公告)号:US11539974B2
公开(公告)日:2022-12-27
申请号:US17493607
申请日:2021-10-04
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Yeping Su , David Singer , Hsi-Jung Wu
IPC: H04N19/50 , H04N19/184 , H04N19/167 , H04N19/436 , H04N19/186 , H04N19/132 , H04N19/124 , H04N19/13 , H04N19/15 , H04N19/30 , H04N19/42 , H04N19/48 , H04N19/182
Abstract: Video compression and decompression techniques are disclosed that provide improved bandwidth control for video compression and decompression systems. In particular, video coding and decoding techniques quantize input video in multiple dimensions. According to these techniques, pixel residuals may be generated from a comparison of an array of input data to an array of prediction data. The pixel residuals may be quantized in a first dimension. After the quantization, the quantized pixel residuals may be transformed to an array of transform coefficients. The transform coefficients may be quantized in a second dimension and entropy coded. Decoding techniques invert these processes. In still other embodiments, multiple quantizers may be provided upstream of the transform stage, either in parallel or in cascade, which provide greater flexibility to video coders to quantize data in different dimensions in an effort to balance the competing interest in compression efficiency and quality of reconstructed video.
-
公开(公告)号:US20220329756A1
公开(公告)日:2022-10-13
申请号:US17846896
申请日:2022-06-22
Applicant: Apple Inc.
Inventor: Jae Hoon Kim , Chris Y. Chung , Dazhong Zhang , Hang Yuan , Hsi-Jung Wu , Xiaosong Zhou , Jiefu Zhai
IPC: H04N7/14 , H04N7/15 , G06F3/0488
Abstract: Embodiments of the present disclosure provide systems and methods for perspective shifting in a video conferencing session. In one exemplary method, a video stream may be generated. A foreground element may be identified in a frame of the video stream and distinguished from a background element of the frame. Data may be received representing a viewing condition at a terminal that will display the generated video stream. The frame of the video stream may be modified based on the received data to shift of the foreground element relative to the background element. The modified video stream may be displayed at the displaying terminal.
-
公开(公告)号:US11361471B2
公开(公告)日:2022-06-14
申请号:US15931349
申请日:2020-05-13
Applicant: Apple Inc.
Inventor: Khaled Mammou , Yeping Su , David W. Singer , Alexandros Tourapis , Fabrice A. Robinet , Hsi-Jung Wu
IPC: G06T7/50 , G06T9/00 , G06T7/70 , G06T7/20 , A01C3/02 , G08B1/00 , G09B1/00 , G06T1/00 , G11B7/002
Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.
-
118.
公开(公告)号:US11323730B2
公开(公告)日:2022-05-03
申请号:US16561478
申请日:2019-09-05
Applicant: Apple Inc.
Inventor: Mei Guo , Jun Xin , Yeping Su , Hsi-Jung Wu , Alexandros Tourapis
IPC: G01R31/34 , H02P29/024 , H01H71/70 , H04N19/44 , H04N19/159 , H04N19/177 , H04N19/172 , H04N19/46
Abstract: Techniques for video exchange are disclosed in which a video source sends redundant copies of video coded at a given presentation time. A decoder may determine, from metadata stored with a first decoded frame, whether other decoded frames have been designated as correlated to the first decoded frame. If so, the decoder may fetch other decoding frames using time indicator values of other decoded frames in metadata stored with the first decoded frame. When other decoded frame(s) are found, the decoder may blend content of the first coded frame and the other decoded frame(s). The decoder may render the blended frame. When one such coded frame is an intra-coded frame, the proposed technique may alleviate beating artifacts by blending recovered data of the intra-coded frame with recovered data of another frame, which may be inter-coded.
-
公开(公告)号:US20220070493A1
公开(公告)日:2022-03-03
申请号:US17523826
申请日:2021-11-10
Applicant: Apple Inc.
Inventor: Khaled Mammou , Yeping Su , Jungsun Kim , Valery G. Valentin , David W. Singer , Fabrice A. Robinet , Hsi-Jung Wu , Alexandros Tourapis
IPC: H04N19/597 , H04N19/85 , H04N19/463
Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.
-
公开(公告)号:US11240492B2
公开(公告)日:2022-02-01
申请号:US16254528
申请日:2019-01-22
Applicant: Apple Inc.
Inventor: Jiefu Zhai , Xingyu Zhang , Xiaosong Zhou , Jun Xin , Hsi-Jung Wu , Yeping Su
IPC: H04N19/105 , H04N19/61 , H04N19/147 , H04N19/159 , H04N19/176 , G06N3/08
Abstract: Systems and methods disclosed for video compression, utilizing neural networks for predictive video coding. Processes employed combine multiple banks of neural networks with codec system components to carry out the coding and decoding of video data.
-
-
-
-
-
-
-
-
-