IMAGE BLENDING MODES SYSTEMS AND METHODS

    公开(公告)号:US20240404187A1

    公开(公告)日:2024-12-05

    申请号:US18799821

    申请日:2024-08-09

    Applicant: Apple Inc.

    Abstract: A device may include an electronic display to display an image frame based on blended image data and image processing circuitry to generate the blended image data by combining first image data and second image data via a blend operation. The blend operation may include receiving graphics alpha data indicative of a transparency factor to be applied to the first image data to generate a first layer of the blend operation. The blend operation may also include overlaying the first layer onto a second layer that is based on the second image data. Overlaying the first layer onto the second layer may include adding first pixel values of the first image data that include negative pixel values and are augmented by the transparency factor to second pixel values of the second image data to generate blended pixel values of the blended image data.

    DIRECTIONAL SCALING SYSTEMS AND METHODS
    2.
    发明公开

    公开(公告)号:US20240233094A1

    公开(公告)日:2024-07-11

    申请号:US18416654

    申请日:2024-01-18

    Applicant: Apple Inc.

    Abstract: An electronic device may include scaling circuitry to scale input pixel data to a greater resolution. The directional scaling circuitry may include first interpolation circuitry to receive best mode data, including one or more angles corresponding to content of the image and interpolate first pixel values at first pixel positions diagonally offset from input pixel positions of the input pixel data based on the best mode data and input pixel values corresponding to the input pixel positions. The directional scaling circuitry may also include second interpolation circuitry to receive the best mode data and the input pixel values and interpolate second pixel values at second pixel positions horizontally or vertically offset from the input pixel positions based at least in part on the best mode data and the input pixel values.

    Neural network-based image processing with artifact compensation

    公开(公告)号:US11367167B2

    公开(公告)日:2022-06-21

    申请号:US17000260

    申请日:2020-08-21

    Applicant: Apple Inc.

    Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.

    NEURAL NETWORK-BASED IMAGE PROCESSING WITH ARTIFACT COMPENSATION

    公开(公告)号:US20220058773A1

    公开(公告)日:2022-02-24

    申请号:US17000260

    申请日:2020-08-21

    Applicant: Apple Inc.

    Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.

    BLENDED NEURAL NETWORK FOR SUPER-RESOLUTION IMAGE PROCESSING

    公开(公告)号:US20200294196A1

    公开(公告)日:2020-09-17

    申请号:US16844951

    申请日:2020-04-09

    Applicant: Apple Inc.

    Abstract: Embodiments relate to a super-resolution engine that converts a lower resolution input image into a higher resolution output image. The super-resolution engine includes a directional scaler, an enhancement processor, a feature detection processor, a blending logic circuit, and a neural network. The directional scaler generates directionally scaled image data by upscaling the input image. The enhancement processor generates enhanced image data by applying an example-based enhancement, a peaking filter, or some other type of non-neural network image processing scheme to the directionally scaled image data. The feature detection processor determines features indicating properties of portions of the directionally scaled image data. The neural network generates residual values defining differences between a target result of the super-resolution enhancement and the directionally scaled image data. The blending logic circuit blends the enhanced image data with the residual values according to the features.

    FOVEATED DISPLAY IMAGE ENHANCEMENT SYSTEMS AND METHODS

    公开(公告)号:US20240404009A1

    公开(公告)日:2024-12-05

    申请号:US18326630

    申请日:2023-05-31

    Applicant: Apple Inc.

    Abstract: A system may include a display for displaying an image frame that is divided into regions having respective resolutions based on display image data. The system may also include image processing circuitry to generate the display image data based on multi-resolution image data of the image frame. Generating the display image data may include determining an enhancement to be applied to a portion of the multi-resolution image data and adjusting the determined enhancement to be applied to the portion of the multi-resolution image data based on boundary data associated with locations of boundaries between the regions.

    NEURAL NETWORK-BASED IMAGE PROCESSING WITH ARTIFACT COMPENSATION

    公开(公告)号:US20220309616A1

    公开(公告)日:2022-09-29

    申请号:US17841387

    申请日:2022-06-15

    Applicant: Apple Inc.

    Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.

    Blended neural network for super-resolution image processing

    公开(公告)号:US11308582B2

    公开(公告)日:2022-04-19

    申请号:US16844951

    申请日:2020-04-09

    Applicant: Apple Inc.

    Abstract: Embodiments relate to a super-resolution engine that converts a lower resolution input image into a higher resolution output image. The super-resolution engine includes a directional scaler, an enhancement processor, a feature detection processor, a blending logic circuit, and a neural network. The directional scaler generates directionally scaled image data by upscaling the input image. The enhancement processor generates enhanced image data by applying an example-based enhancement, a peaking filter, or some other type of non-neural network image processing scheme to the directionally scaled image data. The feature detection processor determines features indicating properties of portions of the directionally scaled image data. The neural network generates residual values defining differences between a target result of the super-resolution enhancement and the directionally scaled image data. The blending logic circuit blends the enhanced image data with the residual values according to the features.

    DIRECTIONAL SCALING SYSTEMS AND METHODS

    公开(公告)号:US20210287344A1

    公开(公告)日:2021-09-16

    申请号:US17331602

    申请日:2021-05-26

    Applicant: Apple Inc.

    Abstract: An electronic device may include scaling circuitry to scale input pixel data to a greater resolution. The directional scaling circuitry may include first interpolation circuitry to receive best mode data, including one or more angles corresponding to content of the image and interpolate first pixel values at first pixel positions diagonally offset from input pixel positions of the input pixel data based on the best mode data and input pixel values corresponding to the input pixel positions. The directional scaling circuitry may also include second interpolation circuitry to receive the best mode data and the input pixel values and interpolate second pixel values at second pixel positions horizontally or vertically offset from the input pixel positions based at least in part on the best mode data and the input pixel values.

    Image blending modes systems and methods

    公开(公告)号:US12067674B2

    公开(公告)日:2024-08-20

    申请号:US17934138

    申请日:2022-09-21

    Applicant: Apple Inc.

    CPC classification number: G06T15/503 G06T3/18

    Abstract: A device may include an electronic display to display an image frame based on blended image data and image processing circuitry to generate the blended image data by combining first image data and second image data via a blend operation. The blend operation may include receiving graphics alpha data indicative of a transparency factor to be applied to the first image data to generate a first layer of the blend operation. The blend operation may also include overlaying the first layer onto a second layer that is based on the second image data. Overlaying the first layer onto the second layer may include adding first pixels values of the first image data that include negative pixel values and are augmented by the transparency factor to second pixel values of the second image data to generate blended pixel values of the blended image data.

Patent Agency Ranking