Method And Apparatus Of Collaborative Video Processing Through Learned Resolution Scaling

    公开(公告)号:US20200162789A1

    公开(公告)日:2020-05-21

    申请号:US16688786

    申请日:2019-11-19

    申请人: Zhan Ma Ming Lu

    发明人: Zhan Ma Ming Lu

    摘要: In a collaborative video processing method and system, a high resolution video input is optionally downscaled to a low resolution video using a down-sampling filter, followed by an end-to-end video coding system to encode the low resolution video for streaming over the Internet. The original high resolution is obtained at the client end by upscaling the low resolution video using a deep learning based high resolution scaling model, which can be trained in a pre-defined progressive order with low resolution videos having different compression parameters and downscaling factors.

    Method and Apparatus for the Single Input Multiple Output (SIMO) Media Adaptation
    2.
    发明申请
    Method and Apparatus for the Single Input Multiple Output (SIMO) Media Adaptation 审中-公开
    单输入多输出(SIMO)媒体适应的方法和装置

    公开(公告)号:US20170064311A1

    公开(公告)日:2017-03-02

    申请号:US15249281

    申请日:2016-08-26

    申请人: Zhan Ma

    发明人: Zhan Ma

    摘要: A method and apparatus for the single input multiple output based media adaptation is disclosed. In one embodiment, such adaption is performed in two steps. On step 1, content correlation between different compression schemes is used to perform the inter-format adaptation of a stream of a compression format to an intermediate output stream of another compression scheme with the same quality level. On step 2, content correlation between different quality levels is used to perform the intra-format adaptation of the intermediate output stream to multiple output streams at different quality levels with the same compression format. In one embodiment, content correlation is used to limit the search for mode candidates when performing both steps.

    摘要翻译: 公开了一种用于基于单输入多输出的媒体适配的方法和装置。 在一个实施例中,这种适应在两个步骤中执行。 在步骤1中,使用不同压缩方案之间的内容相关性来执行压缩格式的流的格式间格式适配到具有相同质量级别的另一压缩方案的中间输出流。 在步骤2中,使用不同质量级别之间的内容相关性,以相同的压缩格式,以不同的质量级别对中间输出流进行格式内适配。 在一个实施例中,当执行两个步骤时,使用内容相关来限制对模式候选的搜索。

    Methods and Apparatus for Motion Compensation with Smooth Reference Frame in Bit Depth Scalability
    5.
    发明申请
    Methods and Apparatus for Motion Compensation with Smooth Reference Frame in Bit Depth Scalability 有权
    用于运动补偿的平滑参考框架在位深度可扩展性的方法和装置

    公开(公告)号:US20110293013A1

    公开(公告)日:2011-12-01

    申请号:US13138342

    申请日:2009-12-11

    IPC分类号: H04N7/32 H04N7/26

    摘要: Methods and apparatus are provided for motion compensation with a smooth reference frame in bit depth scalability. An apparatus includes an encoder for encoding picture data for at least a portion of a picture by generating an inter-layer residue prediction for the portion using an inverse tone mapping operation performed in the pixel domain for bit depth scalability. The inverse tone mapping operation is shifted from a residue domain to the pixel domain.

    摘要翻译: 为比特深度可扩展性的平滑参考帧提供运动补偿的方法和装置。 一种装置包括:编码器,用于通过使用在像素域中进行的逆色调映射操作生成用于比特深度可缩放性的部分的该部分的层间残差预测,对图像的至少一部分进行图像数据的编码。 逆色调映射操作从残留域移动到像素域。

    Methods and Apparatus for Use of Adaptive Prediction Resolution in Video Coding
    7.
    发明申请
    Methods and Apparatus for Use of Adaptive Prediction Resolution in Video Coding 审中-公开
    在视频编码中使用自适应预测分辨率的方法和装置

    公开(公告)号:US20160323600A1

    公开(公告)日:2016-11-03

    申请号:US15143624

    申请日:2016-05-01

    申请人: Zhan Ma

    发明人: Zhan Ma

    摘要: A method and apparatus for use of an adaptive prediction resolution in video coding is disclosed. One or more adaptive flags are provided in one or more syntaxes of a prediction scheme in encoding and decoding video signals. In one embodiment, the adaptive flags are suitable to indicate whether a subset or a full set of intra prediction modes is used at a slice level or a coding block level. In one embodiment, the adaptive flags are suitable to indicate whether integer or fractional motion vector resolution is used at a slice level or a coding block level.

    摘要翻译: 公开了一种在视频编码中使用自适应预测分辨率的方法和装置。 在编码和解码视频信号中的预测方案的一个或多个语法中提供一个或多个自适应标志。 在一个实施例中,自适应标志适于指示在片级或编码块级别是使用子集还是全集帧内预测模式。 在一个实施例中,自适应标志适合于指示是否在限幅电平或编码块级使用整数或分数运动矢量分辨率。

    APPARATUS AND METHOD FOR LOW-COMPLEXITY OPTIMAL TRANSFORM SELECTION
    10.
    发明申请
    APPARATUS AND METHOD FOR LOW-COMPLEXITY OPTIMAL TRANSFORM SELECTION 审中-公开
    用于低复杂度最优变换选择的装置和方法

    公开(公告)号:US20120320972A1

    公开(公告)日:2012-12-20

    申请号:US13494810

    申请日:2012-06-12

    IPC分类号: H04N7/30 H04N7/50 H04N7/40

    摘要: A video processing system includes prediction primary transforms, quantization, entropy coding and filtering configured to receive and compress video information and output compressed video information corresponding to the received video information. The compressed video information comprising prediction mode, transform block size, quantization parameter, and filtering type. The video processing system also includes a secondary transform configured to receive and compress the compressed video information. The video processing system also includes a quantization stage configured to receive and compress the transformed coefficients. The video processing system also includes an entropy coding stage configured to convert the compressed video information into binary bits. The video processing system also includes a filtering stage configured to improve the reconstructed video information for better prediction.

    摘要翻译: 视频处理系统包括预测一次变换,量化,熵编码和滤波,被配置为接收和压缩视频信息并输出与所接收的视频信息相对应的压缩视频信息。 压缩视频信息包括预测模式,变换块大小,量化参数和滤波类型。 视频处理系统还包括被配置为接收和压缩压缩视频信息的次级变换。 视频处理系统还包括被配置为接收和压缩经变换的系数的量化级。 视频处理系统还包括熵编码级,被配置为将压缩视频信息转换为二进制位。 视频处理系统还包括被配置为改善重建的视频信息以便更好地预测的滤波级。