CONTEXT RE-MAPPING IN CABAC ENCODER
    81.
    发明申请
    CONTEXT RE-MAPPING IN CABAC ENCODER 有权
    CABAC编码器中的背景重新映射

    公开(公告)号:US20150092834A1

    公开(公告)日:2015-04-02

    申请号:US14039900

    申请日:2013-09-27

    Applicant: Apple Inc.

    Abstract: A video encoder may include a context-adaptive binary arithmetic coding (CABAC) encode component that converts each syntax element of a representation of a block of pixels to binary code, serializes it, and codes it mathematically, after which the resulting bit stream is output. A lookup table in memory and a context cache may store probability values for supported contexts, which may be retrieved from the table or cache for use in coding syntax elements. Depending on the results of a syntax element coding, the probability value for its context may be modified (e.g., increased or decreased) in the cache and, subsequently, in the table. After coding multiple syntax elements, and based on observed access patterns for probability values, a mapping or indexing for the cache or the table may be modified to improve cache performance (e.g., to reduce cache misses or access data for related contexts using fewer accesses).

    Abstract translation: 视频编码器可以包括上下文自适应二进制算术编码(CABAC)编码组件,其将像素块的表示的每个语法元素转换成二进制码,将其串行化并对其进行数学编码,之后输出所得到的比特流 。 存储器和上下文高速缓存中的查找表可以存储支持的上下文的概率值,其可以从表或高速缓存中检索以用于编码语法元素。 取决于语法元素编码的结果,其上下文的概率值可以在高速缓存中以及随后的表中被修改(例如增加或减少)。 在编码多个语法元素之后,并且基于观察到的概率值的访问模式,可以修改高速缓存或表的映射或索引以提高缓存性能(例如,减少高速缓存未命中或使用较少访问来访问相关上下文的数据) 。

    WAVEFRONT ORDER TO SCAN ORDER SYNCHRONIZATION
    82.
    发明申请
    WAVEFRONT ORDER TO SCAN ORDER SYNCHRONIZATION 有权
    WAVEFRONT订购扫描订单同步

    公开(公告)号:US20150091927A1

    公开(公告)日:2015-04-02

    申请号:US14039859

    申请日:2013-09-27

    Applicant: Apple Inc.

    Abstract: Blocks of pixels from a video frame may be encoded in a block processing pipeline using wavefront ordering, e.g. according to knight's order. Each of the encoded blocks may be written to a particular one of multiple buffers such that the blocks written to each of the buffers represent consecutive blocks of the frame in scan order. Stitching information may be written to the buffers at the end of each row. A stitcher may read the rows from the buffers in order and generate a scan order output stream for the frame. The stitcher component may read the stitching information at the end of each row and apply the stitching information to one or more blocks at the beginning of a next row to stitch the next row to the previous row. Stitching may involve modifying pixel(s) of the blocks and/or modifying metadata for the blocks.

    Abstract translation: 来自视频帧的像素块可以使用波前排序在块处理流水线中进行编码,例如, 根据骑士的命令。 每个编码块可被写入多个缓冲器中的特定一个缓冲器,使得写入每个缓冲器的块以扫描顺序表示帧的连续块。 拼接信息可以写入每行末尾的缓冲区。 拼接器可以按顺序从缓冲器中读取行,并为该帧生成扫描顺序输出流。 缝合器部件可以读取每行末端的缝合信息,并将缝合信息应用于下一行开始处的一个或多个块,以将下一行缝合到前一行。 缝合可以涉及修改块的像素和/或修改块的元数据。

    MEMORY LATENCY TOLERANCE IN BLOCK PROCESSING PIPELINES
    83.
    发明申请
    MEMORY LATENCY TOLERANCE IN BLOCK PROCESSING PIPELINES 有权
    在块加工管道中的存储容忍度

    公开(公告)号:US20150091920A1

    公开(公告)日:2015-04-02

    申请号:US14039804

    申请日:2013-09-27

    Applicant: Apple Inc.

    Abstract: Memory latency tolerance methods and apparatus for maintaining an overall level of performance in block processing pipelines that prefetch reference data into a search window. In a general memory latency tolerance method, search window processing in the pipeline may be monitored. If status of search window processing changes in a way that affects pipeline throughput, then pipeline processing may be modified. The modification may be performed according to no stall methods, stall recovery methods, and/or stall prevention methods. In no stall methods, a block may be processed using the data present in the search window without waiting for the missing reference data. In stall recovery methods, the pipeline is allowed to stall, and processing is modified for subsequent blocks to speed up the pipeline and catch up in throughput. In stall prevention methods, processing is adjusted in advance of the pipeline encountering a stall condition.

    Abstract translation: 存储器延迟容限方法和装置,用于在预处理参考数据到搜索窗口的块处理管线中维持整体性能水平。 在通用存储器延迟容限方法中,可以监视流水线中的搜索窗口处理。 如果搜索窗口处理的状态以影响流水线吞吐量的方式改变,则可以修改流水线处理。 修改可以根据没有失速方法,失速恢复方法和/或失速预防方法进行。 在没有停止方法的情况下,可以使用搜索窗口中存在的数据来处理块,而不用等待丢失的参考数据。 在失速恢复方法中,允许管道停止,并且修改后续块的处理以加速管道并追赶吞吐量。 在失速预防方法中,在遇到失速状况的管道之前调整处理。

    NEIGHBOR CONTEXT CACHING IN BLOCK PROCESSING PIPELINES
    84.
    发明申请
    NEIGHBOR CONTEXT CACHING IN BLOCK PROCESSING PIPELINES 有权
    相邻处理管道中的邻域语音缓存

    公开(公告)号:US20150084968A1

    公开(公告)日:2015-03-26

    申请号:US14037313

    申请日:2013-09-25

    Applicant: Apple Inc.

    CPC classification number: G06T1/20 G06T1/60 H04N19/423 H04N19/436 H04N19/61

    Abstract: Methods and apparatus for caching neighbor data in a block processing pipeline that processes blocks in knight's order with quadrow constraints. Stages of the pipeline may maintain two local buffers that contain data from neighbor blocks of a current block. A first buffer contains data from the last C blocks processed at the stage. A second buffer contains data from neighbor blocks on the last row of a previous quadrow. Data for blocks on the bottom row of a quadrow are stored to an external memory at the end of the pipeline. When a block on the top row of a quadrow is input to the pipeline, neighbor data from the bottom row of the previous quadrow is read from the external memory and passed down the pipeline, each stage storing the data in its second buffer and using the neighbor data in the second buffer when processing the block.

    Abstract translation: 用于在块处理管道中缓存邻居数据的方法和装置,其以四限制约束以骑士顺序处理块。 管道的阶段可以维护两个包含当前块的相邻块的数据的本地缓冲器。 第一个缓冲区包含在该阶段处理的最后一个C块的数据。 第二个缓冲区包含来自前一个四边形最后一行的相邻块的数据。 四边形底行中的块的数据存储在流水线末端的外部存储器中。 当四边形的顶行上的块被输入到流水线时,从外部存储器读取来自前一个四边形的底行的邻居数据,并将其传送到流水线,每个级将数据存储在其第二缓冲器中,并使用 处理块时第二个缓冲区中的邻居数据。

    SYSTEMS AND METHODS FOR STATISTICS COLLECTION USING CLIPPED PIXEL TRACKING
    85.
    发明申请
    SYSTEMS AND METHODS FOR STATISTICS COLLECTION USING CLIPPED PIXEL TRACKING 有权
    使用剪辑像素跟踪统计收集的系统和方法

    公开(公告)号:US20140010480A1

    公开(公告)日:2014-01-09

    申请号:US14023359

    申请日:2013-09-10

    Applicant: Apple Inc.

    CPC classification number: G06T1/20 H04N17/002

    Abstract: Systems and methods are provided for selectively performing image statistics processing based at least partly on whether a pixel has been clipped. In one example, an image signal processor may include statistics collection logic. The statistics collection logic may include statistics image processing logic and a statistics core. The statistics image processing logic may perform initial image processing on image pixels, at least occasionally causing some of the image pixels to become clipped. The statistics core may obtain image statistics from the image pixels. The statistics core may obtain at least one of the image statistics using only pixels that have not been clipped and excluding pixels that have been clipped.

    Abstract translation: 系统和方法被提供用于至少部分地基于是否已经剪切像素来选择性地执行图像统计处理。 在一个示例中,图像信号处理器可以包括统计信息收集逻辑。 统计信息采集逻辑可以包括统计图像处理逻辑和统计核心。 统计图像处理逻辑可以对图像像素执行初始图像处理,至少偶尔导致一些图像像素被削波。 统计核心可以从图像像素获取图像统计。 统计核心可以仅使用未被裁剪的像素并且排除已经被裁剪的像素来获得至少一个图像统计信息。

    IMAGE BLENDING MODES SYSTEMS AND METHODS

    公开(公告)号:US20240404187A1

    公开(公告)日:2024-12-05

    申请号:US18799821

    申请日:2024-08-09

    Applicant: Apple Inc.

    Abstract: A device may include an electronic display to display an image frame based on blended image data and image processing circuitry to generate the blended image data by combining first image data and second image data via a blend operation. The blend operation may include receiving graphics alpha data indicative of a transparency factor to be applied to the first image data to generate a first layer of the blend operation. The blend operation may also include overlaying the first layer onto a second layer that is based on the second image data. Overlaying the first layer onto the second layer may include adding first pixel values of the first image data that include negative pixel values and are augmented by the transparency factor to second pixel values of the second image data to generate blended pixel values of the blended image data.

    Video Pipeline
    87.
    发明申请

    公开(公告)号:US20240394952A1

    公开(公告)日:2024-11-28

    申请号:US18797340

    申请日:2024-08-07

    Applicant: Apple Inc.

    Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

    Systems and method for reducing fixed pattern noise in image data

    公开(公告)号:US11689826B2

    公开(公告)日:2023-06-27

    申请号:US17377308

    申请日:2021-07-15

    Applicant: Apple Inc.

    CPC classification number: H04N25/67

    Abstract: The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.

Patent Agency Ranking