公开(公告)号：US10366497B2

公开(公告)日：2019-07-30

申请号：US15618967

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Ke Zhang ,  Jiefu Zhai ,  Yunfei Zheng ,  Shujie Liu ,  Albert E. Keinath ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: G06T5/00 ,  G06T7/194 ,  G06T7/11 ,  G11B27/031

Abstract: Techniques for cropping images containing an occlusion are presented. A method for image editing is presented comprising, when an occlusion is detected in an original digital image, determining an area occupied by the occlusion, assigning importance scores to different content elements of the original digital image, defining a cropping window around an area of the original digital image that does not include the area occupied by the occlusion and that is based on the importance scores, and cropping the original digital image to the cropping window.

公开(公告)号：US10349064B2

公开(公告)日：2019-07-09

申请号：US15066992

申请日：2016-03-10

Applicant: Apple Inc.

Inventor： Alexandros Michael Tourapis ,  Yeping Su ,  David William Singer ,  Hsi-Jung Wu

IPC: H04N19/186 ,  H04N19/189 ,  H04N9/64 ,  H04N11/20 ,  H04N19/70 ,  H04N19/147 ,  H04N19/46 ,  H04N19/117 ,  H04N19/132 ,  H04N19/154 ,  H04N19/80 ,  H04N19/85 ,  H04N19/59 ,  H04N19/44 ,  H04N9/67

Abstract: A method of adaptive chroma downsampling is presented. The method comprises converting a source image to a converted image in an output color format, applying a plurality of downsample filters to the converted image and estimating a distortion for each filter chose the filter that produces the minimum distortion. The distortion estimation includes applying an upsample filter, and a pixel is output based on the chosen filter. Methods for closed loop conversions are also presented.

公开(公告)号：US20190156519A1

公开(公告)日：2019-05-23

申请号：US16198634

申请日：2018-11-21

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T7/20 ,  G06T7/50

CPC classification number: G06T9/00 ,  G06T5/006 ,  G06T7/20 ,  G06T7/50 ,  G06T19/20 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2219/2012 ,  H04N19/172

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder is configured project the point cloud on to patch planes to compress the point cloud, and supports multiple layered patch planes. For example, some point clouds may have a depth, and points at different depths may be assigned to different layered patch planes.

公开(公告)号：US20190132594A1

公开(公告)日：2019-05-02

申请号：US15796313

申请日：2017-10-27

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Mei Guo ,  Hsi-Jung Wu ,  Jingteng Xue ,  Jun Xin

IPC: H04N19/147 ,  H04N19/105 ,  H04N19/176 ,  H04N19/117 ,  H04N19/196 ,  H04N19/82

CPC classification number: H04N19/147 ,  H04N19/103 ,  H04N19/105 ,  H04N19/117 ,  H04N19/154 ,  H04N19/176 ,  H04N19/196 ,  H04N19/82

Abstract: Techniques are disclosed for coding pixel blocks of an input frame in which coding costs of a plurality of candidate coding modes are estimated, in which estimates of distortion include an estimate of noise of each respective candidate coding mode. Thus, evaluation of each coding mode may involve searching for a prediction reference for a pixel block according to the mode, and estimating coding cost of the respective candidate coding mode based at least in part on an estimate of noise associated with the respective coding mode. A coding mode for the input pixel block may be selected based on a comparison of the coding costs of the candidate coding modes, and the input pixel block may be coded according to the selected coding mode. By estimating noise associated with the candidate coding modes and, in particular, employing techniques to maintain consistent levels of noise across different frames of a coded video sequence, it is expected that perceived quality of coding will be improved.

公开(公告)号：US20190020876A1

公开(公告)日：2019-01-17

申请号：US16120242

申请日：2018-09-01

Applicant: Apple Inc.

Inventor： Thomas Pun ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC: H04N19/126 ,  H04N19/176 ,  H04N19/196 ,  H04N19/149 ,  H04N19/61 ,  H04N19/146 ,  H04N19/625

Abstract: Method For Implementing A Quantizer In A Multimedia Compression And Encoding System is disclosed. In the Quantizer system of the present invention, several new quantization ideas are disclosed. In one embodiment, adjacent macroblocks are grouped together into macroblock groups. The macroblock groups are then assigned a common quantizer value. The common quantizer value may be selected based upon how the macroblocks are encoded, the type of macroblocks within the macroblock group (intra-blocks or inter-blocks), the history of the motion vectors associated with the macroblocks in the macroblock group, the residuals of the macroblocks in the macroblock group, and the energy of the macroblocks in the macroblock group. The quantizer value may be adjusted in a manner that is dependent on the current quantizer value. Specifically, if the quantizer value is at the low end of the quantizer scale, then only small adjustments are made. If the quantizer value is at the high end then larger adjustments may be made to the quantizer. Finally, in one embodiment, the quantizer is implemented along with an inverse quantizer for efficient operation.

公开(公告)号：US20180352264A1

公开(公告)日：2018-12-06

申请号：US15612806

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Mei Guo ,  Feng Yi ,  Jun Xin ,  Chris Y. Chung ,  Yeping Su ,  Xiaosong Zhou ,  Jun Xu ,  Hsi-Jung Wu ,  Jingteng Xue

IPC: H04N19/86 ,  H04N19/117

CPC classification number: H04N19/86 ,  H04N19/117 ,  H04N19/159

Abstract: Methods of in-loop deblocking filter for high dynamic range (HDR) video compression are disclosed. HDR processing and standard dynamic range (SDR) processing adopt different electro-optical transfer function (EOTF) to convert digital code words to linear luminance. For compressing HDR video, EOTF is proposed to be involved in the selection of two deblocking parameters, β and tC, which control the strength of deblocking filter. In local activity checking for filter decisions, the calculated local signal characteristics and the thresholds are adjusted according to EOTF. After deblocking filter, the clipping range is modified based on EOTF. The chroma deblocking filter is also extended to inter-inter block boundary.

公开(公告)号：US20180352259A1

公开(公告)日：2018-12-06

申请号：US15613081

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jun Xin ,  Yeping Su ,  Chris Chung ,  Dazhong Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/61 ,  H04N19/52 ,  H04N19/122 ,  H04N19/18 ,  H04N19/82 ,  H04N19/182 ,  H04N19/124 ,  H04N19/91

Abstract: Techniques are disclosed for coding high dynamic range (HDR) data. According to such techniques, HDR data may be converted to a domain of uniform luminance data. The uniform domain data may be coded by motion compensated predictive coding. The HDR data also may be coded by motion compensated predictive coding, using a coding parameter that is derived from a counterpart coding parameter of the coding of the uniform domain data. In another technique, HDR data may be coded using coding parameters that are derived from HDR domain processing but distortion measurements may be performed in a uniform domain.

公开(公告)号：US20180349705A1

公开(公告)日：2018-12-06

申请号：US15613130

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Hang Yuan ,  Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Chung ,  Hsi-Jung Wu

IPC: G06K9/00 ,  G06T7/292 ,  G06K9/32

Abstract: Techniques are disclosed for managing display of content from multi-view video data. According to these techniques, an object may be identified from content of the multi-view video. The object's location may be tracked across a sequence of multi-view video. The technique may extract a sub-set of video that is contained within a view window that is shifted in an image space of the multi-view video in correspondence to the tracked object's location. These techniques may be implemented either in an image source device or an image sink device.

公开(公告)号：US20180338161A1

公开(公告)日：2018-11-22

申请号：US16050744

申请日：2018-07-31

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N19/82 ,  H04N19/186

CPC classification number: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.

公开(公告)号：US10104375B2

公开(公告)日：2018-10-16

申请号：US15648329

申请日：2017-07-12

Applicant: Apple Inc.

Inventor： Thomas Pun ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC: H04N19/00 ,  H04N19/126 ,  H04N19/61 ,  H04N19/149 ,  H04N19/625 ,  H04N19/176 ,  H04N19/196 ,  H04N19/146

Abstract: Method For Implementing A Quantizer In A Multimedia Compression And Encoding System is disclosed. In the Quantizer system of the present invention, several new quantization ideas are disclosed. In one embodiment, adjacent macroblocks are grouped together into macroblock groups. The macroblock groups are then assigned a common quantizer value. The common quantizer value may be selected based upon how the macroblocks are encoded, the type of macroblocks within the macroblock group (intra-blocks or inter-blocks), the history of the motion vectors associated with the macroblocks in the macroblock group, the residuals of the macroblocks in the macroblock group, and the energy of the macroblocks in the macroblock group. The quantizer value may be adjusted in a manner that is dependent on the current quantizer value. Specifically, if the quantizer value is at the low end of the quantizer scale, then only small adjustments are made. If the quantizer value is at the high end then larger adjustments may be made to the quantizer. Finally, in one embodiment, the quantizer is implemented along with an inverse quantizer for efficient operation.