ESTIMATING RATE COSTS IN VIDEO ENCODING OPERATIONS USING ENTROPY ENCODING STATISTICS
    91.
    发明申请
    ESTIMATING RATE COSTS IN VIDEO ENCODING OPERATIONS USING ENTROPY ENCODING STATISTICS 有权
    使用熵编码统计在视频编码操作中估算费用

    公开(公告)号:US20160007046A1

    公开(公告)日:2016-01-07

    申请号:US14322720

    申请日:2014-07-02

    Applicant: Apple Inc.

    Inventor: Jim C. Chou

    CPC classification number: H04N19/13 H04N19/103 H04N19/149 H04N19/1887

    Abstract: A component of an entropy encoding stage of a block processing pipeline (e.g., a CABAC encoder) may, for a block of pixels in a video frame, accumulate counts indicating the number of times each of two possible symbols is used in encoding a syntax element bin. An empirical probability for each symbol, an estimated entropy, and an estimated rate cost for encoding the bin may be computed, dependent on the symbol counts. A pipeline stage that precedes the entropy encoding stage may, upon receiving another block of pixels for the video frame, calculate and use the estimated rate cost when making encoding decisions for the other block of pixels based on a cost function that includes a rate cost term. The symbol counts or empirical probabilities may be passed to the earlier pipeline stage or written to a shared memory, from which components of the earlier stage may obtain them.

    Abstract translation: 块处理流水线(例如,CABAC编码器)的熵编码级的分量可以对于视频帧中的像素块累积计数,其指示在编码语法元素中使用两个可能符号中的每一个的次数 bin。 取决于符号计数,可以计算每个符号的经验概率,估计熵和用于编码仓的估计速率成本。 在熵编码阶段之前的流水线阶段可以在接收到用于视频帧的另一个像素块时,基于包括速率成本项的成本函数来对其它像素块进行编码决定时计算并使用估计的速率成本 。 符号计数或经验概率可以传递到较早的流水线阶段或写入共享存储器,较早阶段的组件可以从其获得它们。

    PROCESSING ORDER IN BLOCK PROCESSING PIPELINES
    92.
    发明申请
    PROCESSING ORDER IN BLOCK PROCESSING PIPELINES 有权
    块加工管道中的加工订单

    公开(公告)号:US20150091914A1

    公开(公告)日:2015-04-02

    申请号:US14039820

    申请日:2013-09-27

    Applicant: Apple Inc.

    CPC classification number: G06T1/20 H04N19/423 H04N19/436 H04N19/61

    Abstract: A knight's order processing method for block processing pipelines in which the next block input to the pipeline is taken from the row below and one or more columns to the left in the frame. The knight's order method may provide spacing between adjacent blocks in the pipeline to facilitate feedback of data from a downstream stage to an upstream stage. The rows of blocks in the input frame may be divided into sets of rows that constrain the knight's order method to maintain locality of neighbor block data. Invalid blocks may be input to the pipeline at the left of the first set of rows and at the right of the last set of rows, and the sets of rows may be treated as if they are horizontally arranged rather than vertically arranged, to maintain continuity of the knight's order algorithm.

    Abstract translation: 一种用于块处理管线的骑士订单处理方法,其中从管线的下一个块输入下一个块,并且在该帧中从左侧获取一个或多个列。 骑士的订单方法可以在管道中的相邻块之间提供间隔,以便于数据从下游阶段到上游阶段的反馈。 输入帧中的块行可以被划分为限制骑士命令方法以维持相邻块数据的位置的行的集合。 无效的块可以被输入到第一组行的左侧和最后一组行的右侧的流水线,并且这些行的集合可以被视为水平排列而不是垂直排列,以保持连续性 的骑士秩序算法。

    Point-of-view image warp systems and methods

    公开(公告)号:US12236563B2

    公开(公告)日:2025-02-25

    申请号:US18631844

    申请日:2024-04-10

    Applicant: Apple Inc.

    Abstract: An electronic device may include an electronic display to display an image based on processed image data. The electronic device may also include image processing circuitry to generate the processed image data. The image processing circuitry may receive input image data corresponding to an image in a first perspective and warp the input image data from the first perspective to a second perspective, generating warped image data. Additionally, the image processing circuitry may determine one or more occluded regions in the second perspective and determine fill-data corresponding to the occluded regions. The processed image data may be generated by combining the warped image data and the fill-data.

    DYNAMIC FOVEATED PIPELINE
    94.
    发明申请

    公开(公告)号:US20250014143A1

    公开(公告)日:2025-01-09

    申请号:US18898295

    申请日:2024-09-26

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.

    FOVEATED DISPLAY IMAGE ENHANCEMENT SYSTEMS AND METHODS

    公开(公告)号:US20240404009A1

    公开(公告)日:2024-12-05

    申请号:US18326630

    申请日:2023-05-31

    Applicant: Apple Inc.

    Abstract: A system may include a display for displaying an image frame that is divided into regions having respective resolutions based on display image data. The system may also include image processing circuitry to generate the display image data based on multi-resolution image data of the image frame. Generating the display image data may include determining an enhancement to be applied to a portion of the multi-resolution image data and adjusting the determined enhancement to be applied to the portion of the multi-resolution image data based on boundary data associated with locations of boundaries between the regions.

    Dynamic foveated pipeline
    96.
    发明授权

    公开(公告)号:US12131437B2

    公开(公告)日:2024-10-29

    申请号:US18510916

    申请日:2023-11-16

    Applicant: Apple Inc.

    CPC classification number: G06T3/18 G06T3/40 G06T9/001

    Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.

    POINT-OF-VIEW IMAGE WARP SYSTEMS AND METHODS
    98.
    发明公开

    公开(公告)号:US20240257321A1

    公开(公告)日:2024-08-01

    申请号:US18631844

    申请日:2024-04-10

    Applicant: Apple Inc.

    CPC classification number: G06T5/80 G06N20/00 G06T3/18

    Abstract: An electronic device may include an electronic display to display an image based on processed image data. The electronic device may also include image processing circuitry to generate the processed image data. The image processing circuitry may receive input image data corresponding to an image in a first perspective and warp the input image data from the first perspective to a second perspective, generating warped image data. Additionally, the image processing circuitry may determine one or more occluded regions in the second perspective and determine fill-data corresponding to the occluded regions. The processed image data may be generated by combining the warped image data and the fill-data.

    Stacked image warp operations systems and methods

    公开(公告)号:US12026858B2

    公开(公告)日:2024-07-02

    申请号:US17356219

    申请日:2021-06-23

    Applicant: Apple Inc.

    CPC classification number: G06T5/80 G06F3/013 G06T3/18

    Abstract: An electronic device may include an electronic display to display an image based on compensated image data in a panel space. The electronic device may also include image processing circuitry to generate the compensated image data. Further, generating the compensated image data may include determining a first inverse mapping of a pixel grid from the panel space to a rendering space and determining a forward mapping of the pixel grid from the rendering space to the panel space based on the first inverse mapping. The forward mapping may include corrections for multiple different warp operations stacked in a single warp operation. Additionally, the image processing circuitry may apply the forward mapping to input image data to generate the compensated image data.

    Multiple transcode engine systems and methods

    公开(公告)号:US11924478B2

    公开(公告)日:2024-03-05

    申请号:US18129043

    申请日:2023-03-30

    Applicant: Apple Inc.

    Abstract: Systems and methods for improving determination of encoded image data using a video encoding pipeline, which includes a first transcode engine that entropy encodes a first portion of a bin stream to determine a first bit stream including first encoded image data that indicates a first coding group row and that determines first characteristic data corresponding to the first bit stream to facilitate communicating a combined bit stream; and a second transcode engine that entropy encodes a second portion of the bin stream to determine a second bit stream including second encoded image data that indicates a second coding group row while the first transcode engine entropy encodes the first portion of the bin stream and that determines second characteristic data corresponding to the second bit stream to facilitate communicating the combined bit stream, which includes the first bit stream and the second bit stream, to a decoding device.

Patent Agency Ranking