公开(公告)号：US11093752B2

公开(公告)日：2021-08-17

申请号：US15613130

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Hang Yuan ,  Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Chung ,  Hsi-Jung Wu

IPC: G06K9/00 ,  G06T7/292 ,  G06K9/32

Abstract: Techniques are disclosed for managing display of content from multi-view video data. According to these techniques, an object may be identified from content of the multi-view video. The object's location may be tracked across a sequence of multi-view video. The technique may extract a sub-set of video that is contained within a view window that is shifted in an image space of the multi-view video in correspondence to the tracked object's location. These techniques may be implemented either in an image source device or an image sink device.

公开(公告)号：US10178394B2

公开(公告)日：2019-01-08

申请号：US15179728

申请日：2016-06-10

Applicant: Apple Inc.

Inventor： Jingteng Xue ,  Yeping Su ,  Chris Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/167 ,  H04N19/70 ,  H04N19/40 ,  H04N19/44

Abstract: Video coding techniques are disclosed for resource-limited destination display devices. Input video data may be coded by converting a first representation of the input video to a resolution of a destination display and base layer coding the converted representation. Additionally, a region of interest may be predicted from within the input video. The predicted ROI may be converted to a resolution of the destination display, and the converted ROI may be enhancement layer coded. The base layer coded data and the enhancement layer data may be transmitted to the destination display where the coded base layer data is decoded and displayed until a zoom event occurs. When a zoom event occurs, both the coded base layer data and the coded enhancement layer data may be decoded and displayed. Thus, the switchover from a first field of view to an ROI view may be performed quickly.

公开(公告)号：US20220030244A1

公开(公告)日：2022-01-27

申请号：US17492789

申请日：2021-10-04

Applicant: Apple Inc.

Inventor： Yeping Su ,  Xingyu Zhang ,  Chris Chung ,  Jun Xin ,  Hsi-Jung Wu

IPC: H04N19/136 ,  H04N19/103 ,  G06N20/00 ,  H04N19/179

Abstract: Techniques are disclosed by which a coding parameter is determined to encode video data resulting in encoded video data possessing a highest possible video quality. Features may be extracted from an input video sequence. The extracted features may be compared to features described in a model of coding parameters generated by a machine learning algorithm from reviews of previously-coded videos, extracted features of the previously-coded videos, and coding parameters of the previously-coded videos. When a match is detected between the extracted features of the input video sequence and extracted features represented in the model, a determination may be made as to whether coding parameters that correspond to the matching extracted feature correspond to a tier of service to which the input video sequence is to be coded. When the coding parameters that correspond to the matching extracted feature correspond to the tier of service to which the input video sequence is to be coded, the input video sequence may be coded according to the coding parameters.

公开(公告)号：US20180091812A1

公开(公告)日：2018-03-29

申请号：US15275076

申请日：2016-09-23

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jae Hoon Kim ,  Jun Xin ,  Feng Yi ,  Yeping Su ,  Dazhong Zhang ,  Chris Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/117 ,  H04N19/86 ,  H04N19/14 ,  H04N19/15 ,  H04N19/61 ,  H04N19/124 ,  H04N19/13 ,  H04N19/159

CPC classification number: H04N19/117 ,  H04N19/124 ,  H04N19/13 ,  H04N19/134 ,  H04N19/136 ,  H04N19/14 ,  H04N19/15 ,  H04N19/159 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182 ,  H04N19/184 ,  H04N19/186 ,  H04N19/61 ,  H04N19/82 ,  H04N19/86

Abstract: Techniques are disclosed for selecting deblocking filter parameters in a video decoding system. According to these techniques, a boundary strength parameter may be determined based, at least in part, on a bit depth of decoded video data. Activity of a pair of decoded pixel blocks may be classified based, at least in part, on the determined boundary strength parameter, and when a level of activity indicates that deblocking filtering is to be applied to the pair of pixel blocks, pixel block content at a boundary between the pair of pixel blocks may be filtered using filtering parameters derived at least in part based on the bit depth of the decoded video data. The filtering parameters may decrease strength with increasing bit depth of the decoded video data, which improves quality of the decoded video data.

公开(公告)号：US12149699B2

公开(公告)日：2024-11-19

申请号：US17492789

申请日：2021-10-04

Applicant: Apple Inc.

Inventor： Yeping Su ,  Xingyu Zhang ,  Chris Chung ,  Jun Xin ,  Hsi-Jung Wu

IPC: H04N19/136 ,  G06N20/00 ,  H04N19/103 ,  H04N19/179 ,  H04N21/2343 ,  H04N21/845

Abstract: Techniques are disclosed by which a coding parameter is determined to encode video data resulting in encoded video data possessing a highest possible video quality. Features may be extracted from an input video sequence. The extracted features may be compared to features described in a model of coding parameters generated by a machine learning algorithm from reviews of previously-coded videos, extracted features of the previously-coded videos, and coding parameters of the previously-coded videos. When a match is detected between the extracted features of the input video sequence and extracted features represented in the model, a determination may be made as to whether coding parameters that correspond to the matching extracted feature correspond to a tier of service to which the input video sequence is to be coded. When the coding parameters that correspond to the matching extracted feature correspond to the tier of service to which the input video sequence is to be coded, the input video sequence may be coded according to the coding parameters.

公开(公告)号：US10070143B2

公开(公告)日：2018-09-04

申请号：US15168872

申请日：2016-05-31

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Jae Hoon Kim ,  Peikang Song ,  Xiaosong Zhou ,  Chris Chung ,  Hsi-Jung Wu

IPC: H04N19/46 ,  H04N19/68 ,  H04L5/00 ,  H04L29/06 ,  H04L12/741

CPC classification number: H04N19/46 ,  H04L5/0055 ,  H04L45/745 ,  H04L65/602 ,  H04L65/607 ,  H04L65/608 ,  H04L65/80 ,  H04N19/68

Abstract: Coding and decoding techniques are disclosed in which a plurality of coding parameter sets is transmitted between an encoder and a decoder, each of which is distinguishable from the others by a respective identifier. When a new frame of video is to be coded, an encoder may identify a coding parameter set to be applied during coding, it may code the new frame according to the identified coding parameter set, and it may transmit the coded frame to the decoder along with an identifier of the coding parameter set used during the coding. A plurality of coding parameter sets is persistent at an encoder and the decoder simultaneously.

公开(公告)号：US20170357871A1

公开(公告)日：2017-12-14

申请号：US15618909

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Ke Zhang ,  Yunfei Zheng ,  Shujie Liu ,  Albert Keinath ,  Xiaosong Zhou ,  Chris Chung ,  Hsi-Jung Wu

IPC: G06K9/46 ,  G06K9/62 ,  G06K9/00

CPC classification number: G06K9/4642 ,  G06K9/00711 ,  G06K9/03 ,  G06K9/52 ,  G06K9/6256 ,  G06K9/6267 ,  G06K9/627

Abstract: Techniques are disclosed for estimating quality of images in an automated fashion. According to these techniques, a source image may be downsampled to generate at least two downsampled images at different levels of downsampling. Blurriness of the images may be estimated starting with a most-heavily downsampled image. Blocks of a given image may be evaluated for blurriness and, when a block of a given image is estimated to be blurry, the block of the image and co-located blocks of higher resolution image(s) may be designated as blurry. Thereafter, a blurriness score may be calculated for the source image from the number of blocks of the source image designated as blurry.

公开(公告)号：US10757428B2

公开(公告)日：2020-08-25

申请号：US16156193

申请日：2018-10-10

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jun Xin ,  Jun Xu ,  Yeping Su ,  Chris Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/33 ,  H04N19/186 ,  H04N19/51 ,  H04N19/136 ,  H04N19/12

Abstract: Systems and methods are disclosed for reshaping HDR video content to improve compression efficiency while using standard encoding/decoding techniques. Input HDR video frames, e.g., represented in an IPT color space, may be reshaped before the encoding/decoding process and the corresponding reconstructed HDR video frames may then be reverse reshaped. The disclosed reshaping methods may be combinations of scene-based or segment-based methods.

公开(公告)号：US10402677B2

公开(公告)日：2019-09-03

申请号：US15618909

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Ke Zhang ,  Yunfei Zheng ,  Shujie Liu ,  Albert Keinath ,  Xiaosong Zhou ,  Chris Chung ,  Hsi-Jung Wu

IPC: G06K9/00 ,  G06K9/46 ,  G06K9/62

Abstract: Techniques are disclosed for estimating quality of images in an automated fashion. According to these techniques, a source image may be downsampled to generate at least two downsampled images at different levels of downsampling. Blurriness of the images may be estimated starting with a most-heavily downsampled image. Blocks of a given image may be evaluated for blurriness and, when a block of a given image is estimated to be blurry, the block of the image and co-located blocks of higher resolution image(s) may be designated as blurry. Thereafter, a blurriness score may be calculated for the source image from the number of blocks of the source image designated as blurry.

公开(公告)号：US20180352259A1

公开(公告)日：2018-12-06

申请号：US15613081

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jun Xin ,  Yeping Su ,  Chris Chung ,  Dazhong Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/61 ,  H04N19/52 ,  H04N19/122 ,  H04N19/18 ,  H04N19/82 ,  H04N19/182 ,  H04N19/124 ,  H04N19/91

Abstract: Techniques are disclosed for coding high dynamic range (HDR) data. According to such techniques, HDR data may be converted to a domain of uniform luminance data. The uniform domain data may be coded by motion compensated predictive coding. The HDR data also may be coded by motion compensated predictive coding, using a coding parameter that is derived from a counterpart coding parameter of the coding of the uniform domain data. In another technique, HDR data may be coded using coding parameters that are derived from HDR domain processing but distortion measurements may be performed in a uniform domain.