Skip thresholding in pipelined video encoders
    71.
    发明授权
    Skip thresholding in pipelined video encoders 有权
    在流水线视频编码器中跳过阈值

    公开(公告)号:US09473778B2

    公开(公告)日:2016-10-18

    申请号:US14039871

    申请日:2013-09-27

    Applicant: Apple Inc.

    Abstract: The video encoders described herein may make an initial determination to designate a macroblock as a skip macroblock, but may subsequently reverse that decision based on additional information. For example, an initial skip mode decision may be based on aggregate distortion metrics for the luma component of the macroblock (e.g., SAD, SATD, or SSD), then reversed based on an individual pixel difference metric, an aggregate or individual pixel metric for a chroma component of the macroblock, or on the position of the macroblock within a macroblock row. The final skip mode decision may be based, at least in part, on the maximum difference between any pixel in the macroblock (or in a region of interest within the macroblock) and the corresponding pixel in a reference frame. The initial skip mode decision may be made during an early stage of a pipelined video encoding process and reversed in a later stage.

    Abstract translation: 本文描述的视频编码器可以进行初始确定以将宏块指定为跳过宏块,但是随后可以基于附加信息来反转该决定。 例如,初始跳过模式决定可以基于宏块的亮度分量(例如,SAD,SATD或SSD)的聚合失真度量,然后基于单独的像素差异度量来反转,聚合或单独的像素度量用于 宏块的色度分量,或宏块行内宏块的位置。 至少部分地,最终跳过模式决定基于宏块中的任何像素(或宏块内的感兴趣区域)与参考帧中的相应像素之间的最大差异。 初始跳过模式决定可以在流水线视频编码处理的早期阶段进行,并且在稍后的阶段中反转。

    SOURCE PIXEL COMPONENT PASSTHROUGH
    72.
    发明申请
    SOURCE PIXEL COMPONENT PASSTHROUGH 有权
    源像素组件PASSTHROUGH

    公开(公告)号:US20160293137A1

    公开(公告)日:2016-10-06

    申请号:US14676544

    申请日:2015-04-01

    Applicant: Apple Inc.

    Abstract: Systems, apparatuses, and methods for passing source pixel data through a display control unit. A display control unit includes N-bit pixel component processing lanes for processing source pixel data. When the display control unit receives M-bit source pixel components, wherein ‘M’ is greater than ‘N’, the display control unit may assign the M-bit source pixel components to the N-bit processing lanes. Then, the M-bit source pixel components may passthrough the pixel component processing elements of the display control unit without being modified.

    Abstract translation: 用于通过显示控制单元传送源像素数据的系统,装置和方法。 显示控制单元包括用于处理源像素数据的N位像素分量处理通道。 当显示控制单元接收M位大于'N'的M位源像素分量时,显示控制单元可以将M位源像素分量分配给N位处理通道。 然后,M位源像素分量可以直接通过显示控制单元的像素分量处理元件而不被修改。

    Context re-mapping in CABAC encoder
    73.
    发明授权
    Context re-mapping in CABAC encoder 有权
    CABAC编码器中的上下文重映射

    公开(公告)号:US09351003B2

    公开(公告)日:2016-05-24

    申请号:US14039900

    申请日:2013-09-27

    Applicant: Apple Inc.

    Abstract: A video encoder may include a context-adaptive binary arithmetic coding (CABAC) encode component that converts each syntax element of a representation of a block of pixels to binary code, serializes it, and codes it mathematically, after which the resulting bit stream is output. A lookup table in memory and a context cache may store probability values for supported contexts, which may be retrieved from the table or cache for use in coding syntax elements. Depending on the results of a syntax element coding, the probability value for its context may be modified (e.g., increased or decreased) in the cache and, subsequently, in the table. After coding multiple syntax elements, and based on observed access patterns for probability values, a mapping or indexing for the cache or the table may be modified to improve cache performance (e.g., to reduce cache misses or access data for related contexts using fewer accesses).

    Abstract translation: 视频编码器可以包括上下文自适应二进制算术编码(CABAC)编码组件,其将像素块的表示的每个语法元素转换成二进制码,将其串行化并对其进行数学编码,之后输出所得到的比特流 。 存储器和上下文高速缓存中的查找表可以存储支持的上下文的概率值,其可以从表或高速缓存中检索以用于编码语法元素。 取决于语法元素编码的结果,其上下文的概率值可以在高速缓存中以及随后的表中被修改(例如增加或减少)。 在编码多个语法元素之后,并且基于观察到的概率值的访问模式,可以修改高速缓存或表的映射或索引以提高缓存性能(例如,减少高速缓存未命中或使用较少访问来访问相关上下文的数据) 。

    Wavefront encoding with parallel bit stream encoding
    74.
    发明授权
    Wavefront encoding with parallel bit stream encoding 有权
    具有并行位流编码的波前编码

    公开(公告)号:US09336558B2

    公开(公告)日:2016-05-10

    申请号:US14039845

    申请日:2013-09-27

    Applicant: Apple Inc.

    Abstract: In the video encoders described herein, blocks of pixels from a video frame may be encoded (e.g., using CAVLC encoding) in a block processing pipeline using wavefront ordering (e.g., in knight's order). Each of the encoded blocks may be written to a particular one of multiple DMA buffers such that the encoded blocks written to each of the buffers represent consecutive blocks of the video frame in scan order. A transcode pipeline may operate in parallel with (or at least overlapping) the operation of the block processing pipeline. The transcode pipeline may read encoded blocks from the buffers in scan order and merge them into a single bit stream (in scan order). A transcoder core of the transcode pipeline may decode the encoded blocks and encode them using a different encoding process (e.g., CABAC). In some cases, the transcoder may be bypassed.

    Abstract translation: 在本文描述的视频编码器中,来自视频帧的像素块可以使用波前排序(例如骑士顺序)在块处理流水线中进行编码(例如,使用CAVLC编码)。 每个编码块可以被写入多个DMA缓冲器中的特定一个,使得写入每个缓冲器的编码块以扫描顺序表示视频帧的连续块。 代码流水线可以与(或至少重叠)块处理流水线的操作并行操作。 代码流水线可以以扫描顺序从缓冲器读取编码块,并将它们合并成单个位流(按扫描顺序)。 代码转换流水线的代码转换器核心可以解码编码的块,并使用不同的编码过程(例如,CABAC)对它们进行编码。 在某些情况下,代码转换器可能被旁路。

    METADATA HINTS TO SUPPORT BEST EFFORT DECODING FOR GREEN MPEG APPLICATIONS
    75.
    发明申请
    METADATA HINTS TO SUPPORT BEST EFFORT DECODING FOR GREEN MPEG APPLICATIONS 审中-公开
    元数据提示支持绿色MPEG应用程序的最佳效果解码

    公开(公告)号:US20160105675A1

    公开(公告)日:2016-04-14

    申请号:US14687316

    申请日:2015-04-15

    Applicant: Apple Inc.

    Abstract: In a coding system, an encoder codes video data according to a predetermined protocol, which, when decoded causes an associated decoder to perform a predetermined sequence of decoding operations. The encoder may perform local decodes of the coded video data, both in the manner dictated by the coding protocol that is at work and also by one or more alternative decoding operations. The encoder may estimate relative performance of the alternative decoding operations as compared to a decoding operation that is mandated by the coding protocol. The encoder may provide identifiers in metadata that is associated with the coded video data to identify such levels of distortion and/or levels of resources conserved. A decoder may refer to such identifiers when determining when to engage alternative decoding operations as may be warranted under resource conservation policies.

    Abstract translation: 在编码系统中,编码器根据预定的协议对视频数据进行编码,当预定协议被解码时,相关解码器执行预定的解码操作序列。 编码器可以以由正在工作的编码协议所指定的方式以及通过一个或多个替代解码操作来执行编码视频数据的本地解码。 与由编码协议强制的解码操作相比,编码器可以估计替代解码操作的相对性能。 编码器可以提供与编码的视频数据相关联的元数据中的标识符,以识别所保存的资源的失真和/或资源级别。 当确定什么时候参与在资源节约策略下可能需要的替代解码操作时,解码器可以参考这样的标识符。

    Neighbor context processing in block processing pipelines
    76.
    发明授权
    Neighbor context processing in block processing pipelines 有权
    块处理流水线中的相邻上下文处理

    公开(公告)号:US09299122B2

    公开(公告)日:2016-03-29

    申请号:US14037316

    申请日:2013-09-25

    Applicant: Apple Inc.

    CPC classification number: G06T1/20 G06T1/60 H04N19/423 H04N19/436 H04N19/61

    Abstract: A block processing pipeline in which blocks are input to and processed according to row groups so that adjacent blocks on a row are not concurrently at adjacent stages of the pipeline. A stage of the pipeline may process a current block according to neighbor pixels from one or more neighbor blocks. Since adjacent blocks are not concurrently at adjacent stages, the left neighbor of the current block is at least two stages downstream from the stage. Thus, processed pixels from the left neighbor can be passed back to the stage for use in processing the current block without the need to wait for the left neighbor to complete processing at a next stage of the pipeline. In addition, the neighbor blocks may include blocks from the row above the current block. Information from these neighbor blocks may be passed to the stage from an upstream stage of the pipeline.

    Abstract translation: 块处理流水线,其中块被输入并根据行组进行处理,使得一行上的相邻块不是在管道的相邻阶段同时进行。 流水线的一个阶段可以根据一个或多个相邻块的相邻像素处理当前块。 由于相邻块不是在相邻阶段同时进行,所以当前块的左邻近位于级的下游至少两级。 因此,来自左邻居的经处理的像素可被传回到用于处理当前块的阶段,而不需要等待左邻居在流水线的下一阶段完成处理。 此外,相邻块可以包括来自当前块上方的行的块。 来自这些相邻块的信息可以从流水线的上游级传递到级。

    LATE-STAGE MODE CONVERSIONS IN PIPELINED VIDEO ENCODERS
    78.
    发明申请
    LATE-STAGE MODE CONVERSIONS IN PIPELINED VIDEO ENCODERS 有权
    管道视频编码器中的最后阶段模式转换

    公开(公告)号:US20160007038A1

    公开(公告)日:2016-01-07

    申请号:US14322711

    申请日:2014-07-02

    Applicant: APPLE INC.

    Abstract: The video encoders described herein may determine an initial designation of a mode in which to encode a block of pixels in an early stage of a block processing pipeline. A component of a late stage of the block processing pipeline (one that precedes the transcoder) may determine a different mode designation for the block of pixels based on coded block pattern information, motion vector information, the position of the block in a row of such blocks, the order in which such blocks are processed in the pipeline, or other encoding related syntax elements. The component in the late stage may communicate information to the transcoder usable in coding the block of pixels, such as modified syntax elements or an end of row marker. The transcoder may encode the block of pixels in accordance with the different mode designation or may change the mode again, dependent on the communicated information.

    Abstract translation: 本文描述的视频编码器可以确定在块处理流水线的早期阶段对像素块进行编码的模式的初始指定。 块处理流水线(在代码转换器之前的一个)的后期阶段的分量可以基于编码的块模式信息,运动矢量信息,一行中的块的位置来确定对于像素块的不同模式指定 块,这些块在流水线中被处理的顺序,或其他编码相关的语法元素。 后期的组件可以将信息传送到可用于编码像素块的代码转换器,例如修改的语法元素或行标记的结束。 代码转换器可以根据不同的模式指定对像素块进行编码,或者可以根据所传送的信息再次改变模式。

    Wavefront order to scan order synchronization
    79.
    发明授权
    Wavefront order to scan order synchronization 有权
    Wavefront顺序扫描订单同步

    公开(公告)号:US09224187B2

    公开(公告)日:2015-12-29

    申请号:US14039859

    申请日:2013-09-27

    Applicant: Apple Inc.

    Abstract: Blocks of pixels from a video frame may be encoded in a block processing pipeline using wavefront ordering, e.g. according to knight's order. Each of the encoded blocks may be written to a particular one of multiple buffers such that the blocks written to each of the buffers represent consecutive blocks of the frame in scan order. Stitching information may be written to the buffers at the end of each row. A stitcher may read the rows from the buffers in order and generate a scan order output stream for the frame. The stitcher component may read the stitching information at the end of each row and apply the stitching information to one or more blocks at the beginning of a next row to stitch the next row to the previous row. Stitching may involve modifying pixel(s) of the blocks and/or modifying metadata for the blocks.

    Abstract translation: 来自视频帧的像素块可以使用波前排序在块处理流水线中进行编码,例如, 根据骑士的命令。 每个编码块可被写入多个缓冲器中的特定一个缓冲器,使得写入每个缓冲器的块以扫描顺序表示帧的连续块。 拼接信息可以写入每行末尾的缓冲区。 拼接器可以按顺序从缓冲器中读取行,并为该帧生成扫描顺序输出流。 缝合器部件可以读取每行末端的缝合信息,并将缝合信息应用于下一行开始处的一个或多个块,以将下一行缝合到前一行。 缝合可以涉及修改块的像素和/或修改块的元数据。

Patent Agency Ranking