LINEAR TRANSFORM OF UNDISTORTED IMAGE FOR FUSION

    公开(公告)号:US20230138779A1

    公开(公告)日:2023-05-04

    申请号:US17518437

    申请日:2021-11-03

    Applicant: Apple Inc.

    Abstract: Embodiments of the present disclosure relate performing registration of a first image to a second image where the first image is undistorted to linear space before applying a geometric transformation matrix to modify the first image to align with the second image. The geometric transformation matrix may be a linear matrix that causes the undistorted version of the first image to make translation movement, rotational movement or both. The undistorted and modified first image is then reverted back to nonlinear distorted space. Then the reverted first image may be warped to better align with the second image for fusing with the second image. In this way, visual distortions in the fused image such as wobbling may be reduced or eliminated.

    MACHINE LEARNING BASED NOISE REDUCTION CIRCUIT

    公开(公告)号:US20230289923A1

    公开(公告)日:2023-09-14

    申请号:US17692574

    申请日:2022-03-11

    Applicant: Apple Inc.

    CPC classification number: G06T5/002 G06V10/764 G06T3/40

    Abstract: Embodiments relate to an image processing circuit that performs machine learning (ML) based noise reduction on image data. The image processing circuit includes a ML based noise reduction circuit that includes a hybrid kernel calculation circuit and a noise filtering circuit coupled to the hybrid kernel calculation circuit. The hybrid kernel calculation circuit generates, for each pixel of an image, a hybrid kernel by combining a ML kernel of each pixel of the image and a bilateral kernel of each pixel of the image. The noise filtering circuit performs, for each pixel of the image, noise filtering of the image using the hybrid kernel for each pixel of the image to generate a de-noised version of the image.

    Image fusion processor circuit for dual-mode image fusion architecture

    公开(公告)号:US11841926B2

    公开(公告)日:2023-12-12

    申请号:US17173074

    申请日:2021-02-10

    Applicant: Apple Inc.

    CPC classification number: G06F18/251 G06T3/0093 G06T3/40 G06V10/751

    Abstract: Embodiments relate to an image processing circuit able to perform image fusion on received images in a first mode for fusing demosaiced and downscaled image data, and a second mode for fusing raw image data. In the first mode, raw image data received from an image sensor is demosaiced and resampled prior to undergoing image fusion. On the other hand, in the second raw image mode, the image processing circuit performs image fusion on the raw image data, and demosaics and resamples the generated fused raw image. The image processing circuit comprises an image fusion circuit that processes images of received image pyramids differently, based on whether the first or second mode is being run. The image fusion circuit further comprises an additional alpha-blending circuit allowing for the image fusion circuit to perform a fusion and an alpha-blending in a single pass through image fusion circuit.

    IMAGE FUSION PROCESSOR CIRCUIT FOR DUAL-MODE IMAGE FUSION ARCHITECTURE

    公开(公告)号:US20220253651A1

    公开(公告)日:2022-08-11

    申请号:US17173074

    申请日:2021-02-10

    Applicant: Apple Inc.

    Abstract: Embodiments relate to an image processing circuit able to perform image fusion on received images in a first mode for fusing demosaiced and downscaled image data, and a second mode for fusing raw image data. In the first mode, raw image data received from an image sensor is demosaiced and resampled prior to undergoing image fusion. On the other hand, in the second raw image mode, the image processing circuit performs image fusion on the raw image data, and demosaics and resamples the generated fused raw image. The image processing circuit comprises an image fusion circuit that processes images of received image pyramids differently, based on whether the first or second mode is being run. The image fusion circuit further comprises an additional alpha-blending circuit allowing for the image fusion circuit to perform a fusion and an alpha-blending in a single pass through image fusion circuit.

    Linear transform of undistorted image for fusion

    公开(公告)号:US12260532B2

    公开(公告)日:2025-03-25

    申请号:US17518437

    申请日:2021-11-03

    Applicant: Apple Inc.

    Abstract: Embodiments of the present disclosure relate performing registration of a first image to a second image where the first image is undistorted to linear space before applying a geometric transformation matrix to modify the first image to align with the second image. The geometric transformation matrix may be a linear matrix that causes the undistorted version of the first image to make translation movement, rotational movement or both. The undistorted and modified first image is then reverted back to nonlinear distorted space. Then the reverted first image may be warped to better align with the second image for fusing with the second image. In this way, visual distortions in the fused image such as wobbling may be reduced or eliminated.

    Local image warping in image processor using homography transform function

    公开(公告)号:US11164283B1

    公开(公告)日:2021-11-02

    申请号:US16858134

    申请日:2020-04-24

    Applicant: Apple Inc.

    Abstract: A feature extractor determines reference feature locations from a portion of a reference image and corresponding feature locations from a portion of a warp image. A transform module determines a homography transform function that transforms versions of the corresponding feature locations to the reference feature locations. The homography transform function has an error below a threshold level, where the error represents a difference between the transformed corresponding feature locations and the reference feature locations. The local transform module generates transform parameters by processing the homography transform function. A warper circuit warps the portion of the warp image by at least applying the transform parameters to generate a portion of a warped image.

    LOCAL IMAGE WARPING IN IMAGE PROCESSOR USING HOMOGRAPHY TRANSFORM FUNCTION

    公开(公告)号:US20210334934A1

    公开(公告)日:2021-10-28

    申请号:US16858134

    申请日:2020-04-24

    Applicant: Apple Inc.

    Abstract: A feature extractor determines reference feature locations from a portion of a reference image and corresponding feature locations from a portion of a warp image. A transform module determines a homography transform function that transforms versions of the corresponding feature locations to the reference feature locations. The homography transform function has an error below a threshold level, where the error represents a difference between the transformed corresponding feature locations and the reference feature locations. The local transform module generates transform parameters by processing the homography transform function. A warper circuit warps the portion of the warp image by at least applying the transform parameters to generate a portion of a warped image.

Patent Agency Ranking