-
公开(公告)号：US20240331087A1
公开(公告)日：2024-10-03
申请号：US18128479
申请日：2023-03-30
Applicant: Apple Inc.
Inventor： Maxim Smirnov
CPC classification number: G06T3/4015 , G06T5/70 , G06T2207/20182
Abstract: A noise reduction circuit that performs demosaic-based noise reduction on image data. The noise reduction circuit includes a pre-demosaic circuit, a kernel calculation circuit, a noise filtering circuit, and a blending circuit. The pre-demosaic circuit generates a de-mosaiced version of an image. The kernel calculation circuit generates a denoising kernel for at least one pixel of the image and a bilateral kernel for the at least one pixel of the image using the de-mosaiced version of the image. The noise filtering circuit performs noise filtering of the image using the denoising kernel to generate a first de-noised version of the image, and performs noise filtering of the image using the bilateral kernel to generate a second de-noised version of the image. The blending circuit blends the first de-noised version with the second de-noised version to generate an output de-noised version of the image.
-
公开(公告)号：US11803949B2
公开(公告)日：2023-10-31
申请号：US16987210
申请日：2020-08-06
Applicant: Apple Inc.
Inventor： Maxim Smirnov , David R. Pope
CPC classification number: G06T5/50 , G06T3/0093 , G06T5/002
Abstract: Embodiments relate to circuitry for temporal processing and image fusion. An image fusion circuit receives captured images, and generates corresponding image pyramids. The generated image pyramids are raster or tiled processed, and stored in memory. A fusion module receives a first and second image pyramids from the memory, and warps and fuses image pyramids to generate a fused image pyramid, which may be used for further processing, and may also be stored back into the memory. The image fusion circuitry is configurable to operate in a plurality of different configuration modes corresponding to different image fusion applications for fusing image pyramids of received images, including two-frame fusion, temporal filtering, infinite impulse response (IIR) temporal processing, and/or finite impulse response (FIR) temporal processing.
-
公开(公告)号：US20230289923A1
公开(公告)日：2023-09-14
申请号：US17692574
申请日：2022-03-11
Applicant: Apple Inc.
Inventor： Maxim Smirnov , David R. Pope , Henryk K. Blasinski , Kaiming Liu
IPC: G06T5/00 , G06V10/764 , G06T3/40
CPC classification number: G06T5/002 , G06V10/764 , G06T3/40
Abstract: Embodiments relate to an image processing circuit that performs machine learning (ML) based noise reduction on image data. The image processing circuit includes a ML based noise reduction circuit that includes a hybrid kernel calculation circuit and a noise filtering circuit coupled to the hybrid kernel calculation circuit. The hybrid kernel calculation circuit generates, for each pixel of an image, a hybrid kernel by combining a ML kernel of each pixel of the image and a bilateral kernel of each pixel of the image. The noise filtering circuit performs, for each pixel of the image, noise filtering of the image using the hybrid kernel for each pixel of the image to generate a de-noised version of the image.
-
公开(公告)号：US20220253972A1
公开(公告)日：2022-08-11
申请号：US17173049
申请日：2021-02-10
Applicant: Apple Inc.
Inventor： Maxim Smirnov , David R. Pope
Abstract: Embodiments relate to an image processing circuit able to perform image fusion on received images in at least a first mode for fusing demosaiced and downscaled image data, and a second mode for fusing raw image data. Raw image data is received from an image sensor in Bayer RGB format. In the first mode, the raw image data is demosaiced and resampled prior to undergoing image fusion. On the other hand, in the second raw image mode, the image processing circuit performs image fusion on the raw Bayer image data, and demosaics and resamples the generated fused raw Bayer image. This may ensure a cleaner image signal for image fusion, but consumes more memory. The image processing circuit is configured to support both modes of operation, allowing for fused images to be generated to satisfy the requirements of different applications.
-
公开(公告)号：US11074678B2
公开(公告)日：2021-07-27
申请号：US16393892
申请日：2019-04-24
Applicant: Apple Inc.
Inventor： Sheng Lin , Wu Cheng , Maxim Smirnov
Abstract: Embodiments relate to biasing an image noise filter to reduce edge and texture blurring of image data. Pixel values used to determine photometric coefficients for a bilateral filter are modified by offset values. The offset value for a pixel value is determined by applying a high pass filter to the pixel (referred to as the center pixel) and neighboring pixels of the center pixel. By adding the offset value to the center pixel value, the pixel value difference between the neighboring pixels and the center pixel becomes smaller for pixels on the same side of an edge as the center pixel. Thus, pixels on the same side of the edge get more weight in the bilateral noise filter. Conversely, pixels on the opposite side of the edge as the center pixel get less weight in the bilateral filter. As a result, the biased bilateral filter reduces blurring of edges and increases preservation of texture in the image data.
-
Patent Agency Ranking
公开(公告)号：US20200051209A1
公开(公告)日：2020-02-13
申请号：US16100823
申请日：2018-08-10
Applicant: Apple Inc.
Inventor： Maxim Smirnov , David R. Pope , Oren Kerem , Elena Lamburn
Abstract: Embodiments relate to two stage multi-scale processing of an image. A first stage processing circuitry generates an unscaled single color version of the image that undergoes noise reduction before generating a high frequency component of the unscaled single color version. A scaler generates a first downscaled version of the image comprising a plurality of color components. A second stage processing circuitry generates a plurality of sequentially downscaled images based on the first downscaled version. The second stage processing circuitry processes the first downscaled version and the downscaled images to generate a processed version of the first downscaled version. The unscaled single color high frequency component and the processed version of the first downscaled version of the image are merged to generate a processed version of the image.
-
公开(公告)号：US12260532B2
公开(公告)日：2025-03-25
申请号：US17518437
申请日：2021-11-03
Applicant: Apple Inc.
Inventor： Kaiming Liu , Maxim Smirnov , William T. Warner , David Pope , Hui Chao , Jason Holloway
Abstract: Embodiments of the present disclosure relate performing registration of a first image to a second image where the first image is undistorted to linear space before applying a geometric transformation matrix to modify the first image to align with the second image. The geometric transformation matrix may be a linear matrix that causes the undistorted version of the first image to make translation movement, rotational movement or both. The undistorted and modified first image is then reverted back to nonlinear distorted space. Then the reverted first image may be warped to better align with the second image for fusing with the second image. In this way, visual distortions in the fused image such as wobbling may be reduced or eliminated.
-
公开(公告)号：US11798146B2
公开(公告)日：2023-10-24
申请号：US16987202
申请日：2020-08-06
Applicant: Apple Inc.
Inventor： Maxim Smirnov , David R. Pope
CPC classification number: G06T5/50 , G06T3/0093 , G06T5/002
Abstract: Embodiments relate to circuitry for temporal processing and image fusion. An image fusion circuit receives captured images, and generates corresponding image pyramids. The generated image pyramids are raster or tiled processed, and stored in memory. A fusion module receives a first and second image pyramids from the memory, warps the first image pyramid based upon the second image pyramid, and fuses the warped first image pyramid with the second image pyramid to generate a fused image pyramid, which may be used for further processing, and may also be stored back into the memory. Because pyramid generation occurs prior to warping and fusion, and by allowing fused image pyramids to be stored back into memory, the image fusion circuitry is configurable to implement a variety of temporal processing functions involving different image fusion combinations.
-
公开(公告)号：US11164283B1
公开(公告)日：2021-11-02
申请号：US16858134
申请日：2020-04-24
Applicant: Apple Inc.
Inventor： Kaiming Liu , Maxim Smirnov , David R. Pope
Abstract: A feature extractor determines reference feature locations from a portion of a reference image and corresponding feature locations from a portion of a warp image. A transform module determines a homography transform function that transforms versions of the corresponding feature locations to the reference feature locations. The homography transform function has an error below a threshold level, where the error represents a difference between the transformed corresponding feature locations and the reference feature locations. The local transform module generates transform parameters by processing the homography transform function. A warper circuit warps the portion of the warp image by at least applying the transform parameters to generate a portion of a warped image.
-
公开(公告)号：US20210334934A1
公开(公告)日：2021-10-28
申请号：US16858134
申请日：2020-04-24
Applicant: Apple Inc.
Inventor： Kaiming Liu , Maxim Smirnov , David R. Pope
Abstract: A feature extractor determines reference feature locations from a portion of a reference image and corresponding feature locations from a portion of a warp image. A transform module determines a homography transform function that transforms versions of the corresponding feature locations to the reference feature locations. The homography transform function has an error below a threshold level, where the error represents a difference between the transformed corresponding feature locations and the reference feature locations. The local transform module generates transform parameters by processing the homography transform function. A warper circuit warps the portion of the warp image by at least applying the transform parameters to generate a portion of a warped image.
-
-
-
-
-
-
-
-
-
Search Results
35
records
(took 0.014 seconds)
