公开(公告)号：US11818394B2

公开(公告)日：2023-11-14

申请号：US17207267

申请日：2021-03-19

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Xiaosong Zhou ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/176 ,  H04N19/105 ,  H04N19/597 ,  H04N19/547

CPC classification number: H04N19/597 ,  H04N19/105 ,  H04N19/176 ,  H04N19/547

Abstract: Techniques are disclosed for coding video data predictively based on predictions made from spherical-domain projections of input pictures to be coded and reference pictures that are prediction candidates. Spherical projection of an input picture and the candidate reference pictures may be generated. Thereafter, a search may be conducted for a match between the spherical-domain representation of a pixel block to be coded and a spherical-domain representation of the reference picture. On a match, an offset may be determined between the spherical-domain representation of the pixel block to a matching portion of the of the reference picture in the spherical-domain representation. The spherical-domain offset may be transformed to a motion vector in a source-domain representation of the input picture, and the pixel block may be coded predictively with reference to a source-domain representation of the matching portion of the reference picture.

公开(公告)号：US20200296426A1

公开(公告)日：2020-09-17

申请号：US16890245

申请日：2020-06-02

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.

公开(公告)号：US10708623B2

公开(公告)日：2020-07-07

申请号：US16050744

申请日：2018-07-31

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.

公开(公告)号：US10402226B2

公开(公告)日：2019-09-03

申请号：US15173047

申请日：2016-06-03

Applicant: Apple Inc.

Inventor： Albert Keinath ,  Ke Zhang ,  Yunfei Zheng ,  Shujie Liu ,  Jiefu Zhai ,  Chris Y. Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/48 ,  H04L29/08 ,  H04N21/443 ,  H04N21/414

Abstract: A system for processing media on a resource restricted device, the system including a memory to store data representing media assets and associated descriptors, and program instructions representing an application and a media processing system, and a processor to execute the program instructions, wherein the program instructions represent the media processing system, in response to a call from an application defining a plurality of services to be performed on an asset, determine a tiered schedule of processing operations to be performed upon the asset based on a processing budget associated therewith, and iteratively execute the processing operations on a tier-by-tier basis, unless interrupted.

公开(公告)号：US10382830B2

公开(公告)日：2019-08-13

申请号：US15296156

申请日：2016-10-18

Applicant: Apple Inc.

Inventor： David L. Biderman ,  Xiaosong Zhou ,  Douglas Scott Price ,  Yeping Su ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Zhenheng Li ,  John Su ,  James D. Batson

IPC: H04N21/61 ,  G06K9/00 ,  H04N21/262 ,  H04N21/845 ,  H04N21/6587 ,  H04N21/4402 ,  G11B27/30 ,  G11B27/00

Abstract: System and methods for improved playback of a video stream are presented. Video snippets are identified that include a number of consecutive frames for playback. Snippets may be evenly temporally spaced in the video stream or may be content adaptive. Then the first frame of a snippet may be selected as the first frame of a scene or other appropriate stopping point. Scene detection, object detection, motion detection, video metadata, or other information generated during encoding or decoding of the video stream may aid in appropriate snippet selection.

公开(公告)号：US10366497B2

公开(公告)日：2019-07-30

申请号：US15618967

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Ke Zhang ,  Jiefu Zhai ,  Yunfei Zheng ,  Shujie Liu ,  Albert E. Keinath ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: G06T5/00 ,  G06T7/194 ,  G06T7/11 ,  G11B27/031

Abstract: Techniques for cropping images containing an occlusion are presented. A method for image editing is presented comprising, when an occlusion is detected in an original digital image, determining an area occupied by the occlusion, assigning importance scores to different content elements of the original digital image, defining a cropping window around an area of the original digital image that does not include the area occupied by the occlusion and that is based on the importance scores, and cropping the original digital image to the cropping window.

公开(公告)号：US20190132594A1

公开(公告)日：2019-05-02

申请号：US15796313

申请日：2017-10-27

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Mei Guo ,  Hsi-Jung Wu ,  Jingteng Xue ,  Jun Xin

IPC: H04N19/147 ,  H04N19/105 ,  H04N19/176 ,  H04N19/117 ,  H04N19/196 ,  H04N19/82

CPC classification number: H04N19/147 ,  H04N19/103 ,  H04N19/105 ,  H04N19/117 ,  H04N19/154 ,  H04N19/176 ,  H04N19/196 ,  H04N19/82

Abstract: Techniques are disclosed for coding pixel blocks of an input frame in which coding costs of a plurality of candidate coding modes are estimated, in which estimates of distortion include an estimate of noise of each respective candidate coding mode. Thus, evaluation of each coding mode may involve searching for a prediction reference for a pixel block according to the mode, and estimating coding cost of the respective candidate coding mode based at least in part on an estimate of noise associated with the respective coding mode. A coding mode for the input pixel block may be selected based on a comparison of the coding costs of the candidate coding modes, and the input pixel block may be coded according to the selected coding mode. By estimating noise associated with the candidate coding modes and, in particular, employing techniques to maintain consistent levels of noise across different frames of a coded video sequence, it is expected that perceived quality of coding will be improved.

公开(公告)号：US20180352264A1

公开(公告)日：2018-12-06

申请号：US15612806

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Mei Guo ,  Feng Yi ,  Jun Xin ,  Chris Y. Chung ,  Yeping Su ,  Xiaosong Zhou ,  Jun Xu ,  Hsi-Jung Wu ,  Jingteng Xue

IPC: H04N19/86 ,  H04N19/117

CPC classification number: H04N19/86 ,  H04N19/117 ,  H04N19/159

Abstract: Methods of in-loop deblocking filter for high dynamic range (HDR) video compression are disclosed. HDR processing and standard dynamic range (SDR) processing adopt different electro-optical transfer function (EOTF) to convert digital code words to linear luminance. For compressing HDR video, EOTF is proposed to be involved in the selection of two deblocking parameters, β and tC, which control the strength of deblocking filter. In local activity checking for filter decisions, the calculated local signal characteristics and the thresholds are adjusted according to EOTF. After deblocking filter, the clipping range is modified based on EOTF. The chroma deblocking filter is also extended to inter-inter block boundary.

公开(公告)号：US20180338161A1

公开(公告)日：2018-11-22

申请号：US16050744

申请日：2018-07-31

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N19/82 ,  H04N19/186

CPC classification number: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.

公开(公告)号：US09967581B2

公开(公告)日：2018-05-08

申请号：US14290432

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Dazhong Zhang

IPC: H04N7/12 ,  H04N19/46 ,  H04N19/156 ,  H04N19/172 ,  H04N19/132 ,  H04N19/154 ,  H04N19/164 ,  H04N19/587

CPC classification number: H04N19/46 ,  H04N19/132 ,  H04N19/154 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/587

Abstract: During video coding, frame rate conversion (FRC) capabilities of a decoder may be estimated. Based on the estimated FRC capabilities, an encoder may select a frame rate for a video coding session and may alter a frame rate of source video to match the selected frame rate. Thereafter, the resultant video may be coded and output to a channel. By incorporating knowledge of a decoder's FRC capabilities as source video is being coded, an encoder may reduce the frame rate of source video opportunistically. Bandwidth that is conserved by avoiding coding of video data in excess of the selected frame rate may be directed to coding of the remaining video at a higher bitrate, which can lead to increased quality of the coding session as a whole.