公开(公告)号：US11140407B2

公开(公告)日：2021-10-05

申请号：US16222254

申请日：2018-12-17

Applicant: Apple Inc.

Inventor： Xiang Fu ,  Xiaohua Yang ,  Linfeng Guo ,  Francesco Iacopino ,  Felix Chou ,  Ying Jian He

IPC: H04N19/172 ,  H04N19/52 ,  H04N19/176 ,  H04N19/182 ,  H04N19/55 ,  H04N19/167 ,  H04N19/119

Abstract: Techniques for encoding video with reduced frame-boundary artifacts are presented. The techniques include a video encoding method, where, when skip mode is selected as a motion prediction coding mode for a pixel block predicted from a reference block of a reference frame, estimating an amount of the reference block that extends beyond the edge of the reference frame. If the amount beyond the edge does not exceed a threshold, the prediction may be coded with skip mode. If the amount beyond the edge exceeds a threshold, the pixel block may be partitioned, and the partitioned blocks may be coded with motion prediction.

公开(公告)号：US10567768B2

公开(公告)日：2020-02-18

申请号：US15487853

申请日：2017-04-14

Applicant: Apple Inc.

Inventor： Xiang Fu ,  Xiaohua Yang ,  Linfeng Guo ,  Francesco Iacopino ,  Krishna Rapaka ,  Felix Chou ,  Mukta Gore

IPC: H04N19/124 ,  H04L29/06 ,  H04N19/105 ,  H04N19/117 ,  H04N19/176 ,  H04N19/61 ,  H04N19/85

Abstract: Techniques are disclosed for developing quantization matrices for use in video coding. According to these techniques a first quantization matrix may be derived from a second quantization matrix by scaling quantization values of the second quantization matrix by scaling parameters. The scaling parameters may increase according to distance between each matrix position and a matrix origin, they may be derived from characteristics of a video sequence to be coded, or both. The first quantization matrix may be communicated to a decoder. Thereafter, a video sequence may be coded predictively. As part of the coding, pixel data of the video sequence may be transformed to a plurality of frequency domain coefficients, and the frequency domain coefficients may be quantized according to the first quantization matrix.

公开(公告)号：US20200053362A1

公开(公告)日：2020-02-13

申请号：US16100310

申请日：2018-08-10

Applicant: Apple Inc.

Inventor： Xiang Fu ,  Linfeng Guo ,  Haiyan He ,  Wei Li ,  Xu Gang Zhao ,  Hao Pan ,  Xiaohua Yang ,  Krishnakanth Rapaka ,  Munehiro Nakazato ,  Haitao Guo

IPC: H04N19/176 ,  H04N19/126 ,  G06N3/08 ,  G06T7/13

Abstract: Techniques are disclosed for coding image data adaptively at different levels of downscaling. Such techniques may involve partitioning input data into pixel blocks for coding and performing content analysis on the pixel blocks. The pixel blocks may be input to block coders that operate at different pixel block sizes, which may code the pixel blocks input to them at their respective sizes. Except when a block coder operates at the partitioning size, block coders that operate at different pixel block sizes may perform downscaling of the pixel blocks to match their size with the block coders' respective coding size. A block decoder may invert the coding operations performed by the block coders, decoding coded image data at respective pixel block sizes, then upscaling decoded image data obtained therefrom to a common pixel block size. Image reconstruction may synthesize a resultant image from the decode pixel block data output by the decoders. Quality enhancements may be added by neural network processing systems that have been trained to other segmented images.

公开(公告)号：US20180352240A1

公开(公告)日：2018-12-06

申请号：US15613172

申请日：2017-06-03

Applicant: Apple Inc.

Inventor： Krishnakanth Rapaka ,  Mukta Gore ,  Sunder Venkateswaran ,  Xiaohua Yang ,  Xiang Fu ,  Francesco Iacopino ,  Linfeng Guo

IPC: H04N19/187 ,  H04N19/51 ,  H04N19/31 ,  H04N19/39

Abstract: Techniques for encoding video with temporal layering are described, comprising predicting a sequence of pictures with a motion prediction reference pattern having a number of virtual temporal layers, and encoding the sequence of pictures into an encoded bitstream with a temporal layering syntax, wherein a number of signaled temporal layers is less than the number of virtual temporal layers. The number of signaled temporal layers may be determined from a target highest frame rate, a target base layer frame rate, and the number of virtual temporal layers.

公开(公告)号：US20180302621A1

公开(公告)日：2018-10-18

申请号：US15487853

申请日：2017-04-14

Applicant: Apple Inc.

Inventor： Xiang Fu ,  Xiaohua Yang ,  Linfeng Guo ,  Francesco Iacopino ,  Krishna Rapaka ,  Felix Chou ,  Mukta Gore

IPC: H04N19/124 ,  H04L29/06 ,  H04N19/105 ,  H04N19/117 ,  H04N19/176 ,  H04N19/61 ,  H04N19/85

CPC classification number: H04N19/124 ,  H04L65/4069 ,  H04L65/602 ,  H04L65/607 ,  H04N19/105 ,  H04N19/117 ,  H04N19/126 ,  H04N19/136 ,  H04N19/154 ,  H04N19/176 ,  H04N19/463 ,  H04N19/61 ,  H04N19/85

Abstract: Techniques are disclosed for developing quantization matrices for use in video coding. According to these techniques a first quantization matrix may be derived from a second quantization matrix by scaling quantization values of the second quantization matrix by scaling parameters. The scaling parameters may increase according to distance between each matrix position and a matrix origin, they may be derived from characteristics of a video sequence to be coded, or both. The first quantization matrix may be communicated to a decoder. Thereafter, a video sequence may be coded predictively. As part of the coding, pixel data of the video sequence may be transformed to a plurality of frequency domain coefficients, and the frequency domain coefficients may be quantized according to the first quantization matrix.

公开(公告)号：US10764588B2

公开(公告)日：2020-09-01

申请号：US16100310

申请日：2018-08-10

Applicant: Apple Inc.

Inventor： Xiang Fu ,  Linfeng Guo ,  Haiyan He ,  Wei Li ,  Xu Gang Zhao ,  Hao Pan ,  Xiaohua Yang ,  Krishnakanth Rapaka ,  Munehiro Nakazato ,  Haitao Guo

IPC: H04N19/176 ,  H04N19/126 ,  G06T7/13 ,  G06N3/08

Abstract: Techniques are disclosed for coding image data adaptively at different levels of downscaling. Such techniques may involve partitioning input data into pixel blocks for coding and performing content analysis on the pixel blocks. The pixel blocks may be input to block coders that operate at different pixel block sizes, which may code the pixel blocks input to them at their respective sizes. Except when a block coder operates at the partitioning size, block coders that operate at different pixel block sizes may perform downscaling of the pixel blocks to match their size with the block coders' respective coding size. A block decoder may invert the coding operations performed by the block coders, decoding coded image data at respective pixel block sizes, then upscaling decoded image data obtained therefrom to a common pixel block size. Image reconstruction may synthesize a resultant image from the decode pixel block data output by the decoders. Quality enhancements may be added by neural network processing systems that have been trained to other segmented images.