公开(公告)号：US20160007038A1

公开(公告)日：2016-01-07

申请号：US14322711

申请日：2014-07-02

Applicant: APPLE INC.

Inventor： Jim C. Chou ,  Guy Cote

IPC: H04N19/46 ,  H04N19/176 ,  H04N19/124 ,  H04N19/182

CPC classification number: H04N19/46 ,  H04N19/103 ,  H04N19/124 ,  H04N19/139 ,  H04N19/157 ,  H04N19/167 ,  H04N19/176 ,  H04N19/182 ,  H04N19/40 ,  H04N19/439

Abstract: The video encoders described herein may determine an initial designation of a mode in which to encode a block of pixels in an early stage of a block processing pipeline. A component of a late stage of the block processing pipeline (one that precedes the transcoder) may determine a different mode designation for the block of pixels based on coded block pattern information, motion vector information, the position of the block in a row of such blocks, the order in which such blocks are processed in the pipeline, or other encoding related syntax elements. The component in the late stage may communicate information to the transcoder usable in coding the block of pixels, such as modified syntax elements or an end of row marker. The transcoder may encode the block of pixels in accordance with the different mode designation or may change the mode again, dependent on the communicated information.

Abstract translation: 本文描述的视频编码器可以确定在块处理流水线的早期阶段对像素块进行编码的模式的初始指定。 块处理流水线（在代码转换器之前的一个）的后期阶段的分量可以基于编码的块模式信息，运动矢量信息，一行中的块的位置来确定对于像素块的不同模式指定 块，这些块在流水线中被处理的顺序，或其他编码相关的语法元素。 后期的组件可以将信息传送到可用于编码像素块的代码转换器，例如修改的语法元素或行标记的结束。 代码转换器可以根据不同的模式指定对像素块进行编码，或者可以根据所传送的信息再次改变模式。

公开(公告)号：US09224187B2

公开(公告)日：2015-12-29

申请号：US14039859

申请日：2013-09-27

Applicant: Apple Inc.

Inventor： Guy Cote ,  Jim C. Chou ,  Timothy John Millet ,  Manching Ko ,  Weichun Ku

IPC: G06T1/20 ,  G06F13/00 ,  G06T1/60

CPC classification number: B60R3/007 ,  G06T1/20 ,  G06T1/60 ,  H04N19/40 ,  H04N19/433 ,  H04N19/436 ,  H04N19/91

Abstract: Blocks of pixels from a video frame may be encoded in a block processing pipeline using wavefront ordering, e.g. according to knight's order. Each of the encoded blocks may be written to a particular one of multiple buffers such that the blocks written to each of the buffers represent consecutive blocks of the frame in scan order. Stitching information may be written to the buffers at the end of each row. A stitcher may read the rows from the buffers in order and generate a scan order output stream for the frame. The stitcher component may read the stitching information at the end of each row and apply the stitching information to one or more blocks at the beginning of a next row to stitch the next row to the previous row. Stitching may involve modifying pixel(s) of the blocks and/or modifying metadata for the blocks.

Abstract translation: 来自视频帧的像素块可以使用波前排序在块处理流水线中进行编码，例如， 根据骑士的命令。 每个编码块可被写入多个缓冲器中的特定一个缓冲器，使得写入每个缓冲器的块以扫描顺序表示帧的连续块。 拼接信息可以写入每行末尾的缓冲区。 拼接器可以按顺序从缓冲器中读取行，并为该帧生成扫描顺序输出流。 缝合器部件可以读取每行末端的缝合信息，并将缝合信息应用于下一行开始处的一个或多个块，以将下一行缝合到前一行。 缝合可以涉及修改块的像素和/或修改块的元数据。

公开(公告)号：US09106888B2

公开(公告)日：2015-08-11

申请号：US14036852

申请日：2013-09-25

Applicant: Apple Inc.

Inventor： Jim C. Chou

IPC: G06K9/36 ,  G06K9/46 ,  G06K9/00 ,  H04N19/126 ,  H04N19/176 ,  H04N19/119 ,  H04N19/117 ,  H04N19/86

CPC classification number: H04N19/126 ,  H04N19/117 ,  H04N19/119 ,  H04N19/129 ,  H04N19/154 ,  H04N19/176 ,  H04N19/186 ,  H04N19/40 ,  H04N19/48 ,  H04N19/61 ,  H04N19/86 ,  H04N19/91

Abstract: The forward transform and quantization components of the video encoders described herein may modify the quantization typically performed by video encoders to reduce quantization artifacts. For example, for a given pixel in an image macroblock, noise may be generated based on information about pixels in the neighborhood of the given pixel (e.g., DC transform coefficients or quantization errors of the neighbor pixels and corresponding programmable weighting coefficient values for the neighbor pixels) and this noise may be added to the DC transform coefficient for the given pixel prior to performing quantization. The weighting coefficient values may be chosen to shape the noise added to the DC transform coefficient values (e.g., to apply a filter operation). When applied to a chroma component of an image frame, this neighbor-data-based dithering approach may reduce color banding artifacts. When applied to the luma component, it may reduce blocking artifacts.

Abstract translation: 本文描述的视频编码器的正向变换和量化分量可以修改通常由视频编码器执行的量化，以减少量化伪像。 例如，对于图像宏块中的给定像素，可以基于关于给定像素的邻域中的像素的信息生成噪声（例如，相邻像素的DC变换系数或量化误差以及相邻的相应的可编程加权系数值 像素），并且可以在执行量化之前将该噪声添加到给定像素的DC变换系数。 可以选择加权系数值来形成加到DC变换系数值的噪声（例如，应用滤波器操作）。 当应用于图像帧的色度分量时，该基于邻居数据的抖动方法可以减少色带伪影。 当应用于亮度组件时，可以减少块状伪影。

公开(公告)号：US20150092834A1

公开(公告)日：2015-04-02

申请号：US14039900

申请日：2013-09-27

Applicant: Apple Inc.

Inventor： Guy Cote ,  Weichun Ku ,  Jim C. Chou

IPC: H04N19/13 ,  H04N19/176 ,  H04N19/423 ,  H04N19/70

CPC classification number: H04N19/13 ,  H04N19/129 ,  H04N19/176 ,  H04N19/40 ,  H04N19/423 ,  H04N19/436 ,  H04N19/463 ,  H04N19/70

Abstract: A video encoder may include a context-adaptive binary arithmetic coding (CABAC) encode component that converts each syntax element of a representation of a block of pixels to binary code, serializes it, and codes it mathematically, after which the resulting bit stream is output. A lookup table in memory and a context cache may store probability values for supported contexts, which may be retrieved from the table or cache for use in coding syntax elements. Depending on the results of a syntax element coding, the probability value for its context may be modified (e.g., increased or decreased) in the cache and, subsequently, in the table. After coding multiple syntax elements, and based on observed access patterns for probability values, a mapping or indexing for the cache or the table may be modified to improve cache performance (e.g., to reduce cache misses or access data for related contexts using fewer accesses).

Abstract translation: 视频编码器可以包括上下文自适应二进制算术编码（CABAC）编码组件，其将像素块的表示的每个语法元素转换成二进制码，将其串行化并对其进行数学编码，之后输出所得到的比特流 。 存储器和上下文高速缓存中的查找表可以存储支持的上下文的概率值，其可以从表或高速缓存中检索以用于编码语法元素。 取决于语法元素编码的结果，其上下文的概率值可以在高速缓存中以及随后的表中被修改（例如增加或减少）。 在编码多个语法元素之后，并且基于观察到的概率值的访问模式，可以修改高速缓存或表的映射或索引以提高缓存性能（例如，减少高速缓存未命中或使用较少访问来访问相关上下文的数据） 。

公开(公告)号：US20150091927A1

公开(公告)日：2015-04-02

申请号：US14039859

申请日：2013-09-27

Applicant: Apple Inc.

Inventor： Guy Cote ,  Jim C. Chou ,  Timothy John Millet ,  Manching Ko ,  Weichun Ku

IPC: G06T1/60

CPC classification number: B60R3/007 ,  G06T1/20 ,  G06T1/60 ,  H04N19/40 ,  H04N19/433 ,  H04N19/436 ,  H04N19/91

Abstract: Blocks of pixels from a video frame may be encoded in a block processing pipeline using wavefront ordering, e.g. according to knight's order. Each of the encoded blocks may be written to a particular one of multiple buffers such that the blocks written to each of the buffers represent consecutive blocks of the frame in scan order. Stitching information may be written to the buffers at the end of each row. A stitcher may read the rows from the buffers in order and generate a scan order output stream for the frame. The stitcher component may read the stitching information at the end of each row and apply the stitching information to one or more blocks at the beginning of a next row to stitch the next row to the previous row. Stitching may involve modifying pixel(s) of the blocks and/or modifying metadata for the blocks.

Abstract translation: 来自视频帧的像素块可以使用波前排序在块处理流水线中进行编码，例如， 根据骑士的命令。 每个编码块可被写入多个缓冲器中的特定一个缓冲器，使得写入每个缓冲器的块以扫描顺序表示帧的连续块。 拼接信息可以写入每行末尾的缓冲区。 拼接器可以按顺序从缓冲器中读取行，并为该帧生成扫描顺序输出流。 缝合器部件可以读取每行末端的缝合信息，并将缝合信息应用于下一行开始处的一个或多个块，以将下一行缝合到前一行。 缝合可以涉及修改块的像素和/或修改块的元数据。

公开(公告)号：US20150085921A1

公开(公告)日：2015-03-26

申请号：US14036852

申请日：2013-09-25

Applicant: APPLE INC.

Inventor： Jim C. Chou

IPC: H04N19/126 ,  H04N19/86 ,  H04N19/117 ,  H04N19/176 ,  H04N19/119

CPC classification number: H04N19/126 ,  H04N19/117 ,  H04N19/119 ,  H04N19/129 ,  H04N19/154 ,  H04N19/176 ,  H04N19/186 ,  H04N19/40 ,  H04N19/48 ,  H04N19/61 ,  H04N19/86 ,  H04N19/91

Abstract: The forward transform and quantization components of the video encoders described herein may modify the quantization typically performed by video encoders to reduce quantization artifacts. For example, for a given pixel in an image macroblock, noise may be generated based on information about pixels in the neighborhood of the given pixel (e.g., DC transform coefficients or quantization errors of the neighbor pixels and corresponding programmable weighting coefficient values for the neighbor pixels) and this noise may be added to the DC transform coefficient for the given pixel prior to performing quantization. The weighting coefficient values may be chosen to shape the noise added to the DC transform coefficient values (e.g., to apply a filter operation). When applied to a chroma component of an image frame, this neighbor-data-based dithering approach may reduce color banding artifacts. When applied to the luma component, it may reduce blocking artifacts.

Abstract translation: 本文描述的视频编码器的正向变换和量化分量可以修改通常由视频编码器执行的量化，以减少量化伪像。 例如，对于图像宏块中的给定像素，可以基于关于给定像素的邻域中的像素的信息生成噪声（例如，相邻像素的DC变换系数或量化误差以及相邻的相应的可编程加权系数值 像素），并且可以在执行量化之前将该噪声添加到给定像素的DC变换系数。 可以选择加权系数值来形成加到DC变换系数值的噪声（例如，应用滤波器操作）。 当应用于图像帧的色度分量时，该基于邻居数据的抖动方法可以减少色带伪影。 当应用于亮度组件时，可以减少块状伪影。

公开(公告)号：US20150084968A1

公开(公告)日：2015-03-26

申请号：US14037313

申请日：2013-09-25

Applicant: Apple Inc.

Inventor： Joseph J. Cheng ,  Guy Cote ,  Marc A. Schaub ,  Jim C. Chou

IPC: G06T1/20 ,  G06T1/60

CPC classification number: G06T1/20 ,  G06T1/60 ,  H04N19/423 ,  H04N19/436 ,  H04N19/61

Abstract: Methods and apparatus for caching neighbor data in a block processing pipeline that processes blocks in knight's order with quadrow constraints. Stages of the pipeline may maintain two local buffers that contain data from neighbor blocks of a current block. A first buffer contains data from the last C blocks processed at the stage. A second buffer contains data from neighbor blocks on the last row of a previous quadrow. Data for blocks on the bottom row of a quadrow are stored to an external memory at the end of the pipeline. When a block on the top row of a quadrow is input to the pipeline, neighbor data from the bottom row of the previous quadrow is read from the external memory and passed down the pipeline, each stage storing the data in its second buffer and using the neighbor data in the second buffer when processing the block.

Abstract translation: 用于在块处理管道中缓存邻居数据的方法和装置，其以四限制约束以骑士顺序处理块。 管道的阶段可以维护两个包含当前块的相邻块的数据的本地缓冲器。 第一个缓冲区包含在该阶段处理的最后一个C块的数据。 第二个缓冲区包含来自前一个四边形最后一行的相邻块的数据。 四边形底行中的块的数据存储在流水线末端的外部存储器中。 当四边形的顶行上的块被输入到流水线时，从外部存储器读取来自前一个四边形的底行的邻居数据，并将其传送到流水线，每个级将数据存储在其第二缓冲器中，并使用 处理块时第二个缓冲区中的邻居数据。