Point-of-view image warp systems and methods

    公开(公告)号:US11989854B2

    公开(公告)日:2024-05-21

    申请号:US17356223

    申请日:2021-06-23

    Applicant: Apple Inc.

    CPC classification number: G06T5/006 G06N20/00 G06T3/0093

    Abstract: An electronic device may include an electronic display to display an image based on processed image data. The electronic device may also include image processing circuitry to generate the processed image data. The image processing circuitry may receive input image data corresponding to an image in a first perspective and warp the input image data from the first perspective to a second perspective, generating warped image data. Additionally, the image processing circuitry may determine one or more occluded regions in the second perspective and determine fill-data corresponding to the occluded regions. The processed image data may be generated by combining the warped image data and the fill-data.

    VIDEO ENCODING SYSTEM
    73.
    发明公开

    公开(公告)号:US20230254510A1

    公开(公告)日:2023-08-10

    申请号:US18301737

    申请日:2023-04-17

    Applicant: Apple Inc.

    Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder. The encoded frequency data is packetized and transmitted to a receiving device. On the receiving device, the encoded data is decoded to recover the frequency bands. Wavelet synthesis is then performed on the frequency bands to reconstruct the pixel data for display. The system may encode parts of frames (tiles or slices) using one or more encoders and transmit the encoded parts as they are ready. A pre-filter component may perform a lens warp on the pixel data prior to the wavelet transform.

    Multiple transcode engine systems and methods

    公开(公告)号:US11638041B2

    公开(公告)日:2023-04-25

    申请号:US17385549

    申请日:2021-07-26

    Applicant: Apple Inc.

    Abstract: Systems and methods for improving determination of encoded image data using a video encoding pipeline, which includes a first transcode engine that entropy encodes a first portion of a bin stream to determine a first bit stream including first encoded image data that indicates a first coding group row and that determines first characteristic data corresponding to the first bit stream to facilitate communicating a combined bit stream; and a second transcode engine that entropy encodes a second portion of the bin stream to determine a second bit stream including second encoded image data that indicates a second coding group row while the first transcode engine entropy encodes the first portion of the bin stream and that determines second characteristic data corresponding to the second bit stream to facilitate communicating the combined bit stream, which includes the first bit stream and the second bit stream, to a decoding device.

    Hierarchical Grid Interpolation Systems and Methods

    公开(公告)号:US20220414824A1

    公开(公告)日:2022-12-29

    申请号:US17356216

    申请日:2021-06-23

    Applicant: Apple Inc.

    Abstract: An electronic device may include an electronic display to display an image based on processed image data. The electronic device may also include image processing circuitry to determine a hierarchical grid having multiple grid points divided into grid partitions. A first set of grid points associated with a first set of grid partitions may include a first set of mappings to corresponding coordinates of input image data in a source frame. The image processing circuitry may also interpolate between the first set of grid points to determine a second set of grid points of having a second set of mappings to corresponding coordinates of the input image data based on the first set of mappings. The image processing circuitry may also generate the processed image data by applying the first set of mappings and the second set of mappings to the input image data.

    Neural network-based image processing with artifact compensation

    公开(公告)号:US11367167B2

    公开(公告)日:2022-06-21

    申请号:US17000260

    申请日:2020-08-21

    Applicant: Apple Inc.

    Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.

    Low-latency context switch systems and methods

    公开(公告)号:US11335296B2

    公开(公告)日:2022-05-17

    申请号:US17020710

    申请日:2020-09-14

    Applicant: Apple Inc.

    Abstract: An electronic device includes a display panel and image processing circuitry. The image processing circuitry receives input image data corresponding to an image to display on the display panel, modifies the input image data by executing a first context task (e.g., lower priority task), and receives a context switch request. The image processing circuitry also pauses modification of the input image data by pausing execution of the first context task and then switches to modifying the input image data by executing a second context task (e.g., higher priority task).

    MULTIPLE TRANSCODE ENGINE SYSTEMS AND METHODS

    公开(公告)号:US20220086505A1

    公开(公告)日:2022-03-17

    申请号:US17385549

    申请日:2021-07-26

    Applicant: Apple Inc.

    Abstract: Systems and methods for improving determination of encoded image data using a video encoding pipeline, which includes a first transcode engine that entropy encodes a first portion of a bin stream to determine a first bit stream including first encoded image data that indicates a first coding group row and that determines first characteristic data corresponding to the first bit stream to facilitate communicating a combined bit stream; and a second transcode engine that entropy encodes a second portion of the bin stream to determine a second bit stream including second encoded image data that indicates a second coding group row while the first transcode engine entropy encodes the first portion of the bin stream and that determines second characteristic data corresponding to the second bit stream to facilitate communicating the combined bit stream, which includes the first bit stream and the second bit stream, to a decoding device.

    LOW-LATENCY CONTEXT SWITCH SYSTEMS AND METHODS

    公开(公告)号:US20220084482A1

    公开(公告)日:2022-03-17

    申请号:US17020710

    申请日:2020-09-14

    Applicant: Apple Inc.

    Abstract: An electronic device includes a display panel and image processing circuitry. The image processing circuitry receives input image data corresponding to an image to display on the display panel, modifies the input image data by executing a first context task (e.g., lower priority task), and receives a context switch request. The image processing circuitry also pauses modification of the input image data by pausing execution of the first context task and then switches to modifying the input image data by executing a second context task (e.g., higher priority task).

    NEURAL NETWORK-BASED IMAGE PROCESSING WITH ARTIFACT COMPENSATION

    公开(公告)号:US20220058773A1

    公开(公告)日:2022-02-24

    申请号:US17000260

    申请日:2020-08-21

    Applicant: Apple Inc.

    Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.

Patent Agency Ranking