-
公开(公告)号：US11841926B2
公开(公告)日：2023-12-12
申请号：US17173074
申请日：2021-02-10
Applicant: Apple Inc.
Inventor： Maxim Smirnov , Kaiming Liu
CPC classification number: G06F18/251 , G06T3/0093 , G06T3/40 , G06V10/751
Abstract: Embodiments relate to an image processing circuit able to perform image fusion on received images in a first mode for fusing demosaiced and downscaled image data, and a second mode for fusing raw image data. In the first mode, raw image data received from an image sensor is demosaiced and resampled prior to undergoing image fusion. On the other hand, in the second raw image mode, the image processing circuit performs image fusion on the raw image data, and demosaics and resamples the generated fused raw image. The image processing circuit comprises an image fusion circuit that processes images of received image pyramids differently, based on whether the first or second mode is being run. The image fusion circuit further comprises an additional alpha-blending circuit allowing for the image fusion circuit to perform a fusion and an alpha-blending in a single pass through image fusion circuit.
-
公开(公告)号：US11836889B2
公开(公告)日：2023-12-05
申请号：US17173049
申请日：2021-02-10
Applicant: Apple Inc.
Inventor： Maxim Smirnov , David R. Pope
CPC classification number: G06T3/4015 , G06T3/0093 , G06T5/002 , G06T5/50 , G06T2207/20016 , G06T2207/20221
Abstract: Embodiments relate to an image processing circuit able to perform image fusion on received images in at least a first mode for fusing demosaiced and downscaled image data, and a second mode for fusing raw image data. Raw image data is received from an image sensor in Bayer RGB format. In the first mode, the raw image data is demosaiced and resampled prior to undergoing image fusion. On the other hand, in the second raw image mode, the image processing circuit performs image fusion on the raw Bayer image data, and demosaics and resamples the generated fused raw Bayer image. This may ensure a cleaner image signal for image fusion, but consumes more memory. The image processing circuit is configured to support both modes of operation, allowing for fused images to be generated to satisfy the requirements of different applications.
-
公开(公告)号：US20220254050A1
公开(公告)日：2022-08-11
申请号：US17173094
申请日：2021-02-10
Applicant: Apple Inc.
Inventor： Maxim Smirnov , Sheng Lin
Abstract: Embodiments relate to an image processing circuit comprising a noise reduction circuit configurable to perform bilateral filtering on demosaiced and resampled image data, or on raw image data, based on the operating mode of the image processing circuit. The noise reduction circuit filters received image data based upon directional taps, by selecting, for each pixel, a set of neighbor pixels, and comparing values of the set of neighbor pixels to determine whether the pixel lies on a directional edge. For raw images, the noise reduction circuit selects the set of neighbor pixels to include a plurality of pixels of the same color channel as the pixel, and one or more additional pixels of a different color channel, where color values for the one or more additional pixels are determined by interpolating color values of two or more adjacent pixels of the same color channel as the pixel.
-
公开(公告)号：US20220253651A1
公开(公告)日：2022-08-11
申请号：US17173074
申请日：2021-02-10
Applicant: Apple Inc.
Inventor： Maxim Smirnov , Kaiming Liu
Abstract: Embodiments relate to an image processing circuit able to perform image fusion on received images in a first mode for fusing demosaiced and downscaled image data, and a second mode for fusing raw image data. In the first mode, raw image data received from an image sensor is demosaiced and resampled prior to undergoing image fusion. On the other hand, in the second raw image mode, the image processing circuit performs image fusion on the raw image data, and demosaics and resamples the generated fused raw image. The image processing circuit comprises an image fusion circuit that processes images of received image pyramids differently, based on whether the first or second mode is being run. The image fusion circuit further comprises an additional alpha-blending circuit allowing for the image fusion circuit to perform a fusion and an alpha-blending in a single pass through image fusion circuit.
-
公开(公告)号：US11334961B2
公开(公告)日：2022-05-17
申请号：US16987272
申请日：2020-08-06
Applicant: Apple Inc.
Inventor： Maxim Smirnov , William T. Warner , David R. Pope , Manching Ko
Abstract: Embodiments relate to circuitry for warping image pyramids for image fusion. An image fusion circuit receives captured images, and generates image pyramids corresponding to the received images to be used for image fusion. A warping circuit warps the first image pyramid based upon one or more warping parameters to align the first image pyramid to the second image pyramid. The warping circuit is a multi-scale warping circuit configured to warp each level of the first image pyramid, using a first warping engine that warps a base level of the image pyramid, and at least one addition warping engine that warps a plurality of scaled levels of the image pyramid in parallel with the first warping engine.
-
Patent Agency Ranking
公开(公告)号：US11010873B2
公开(公告)日：2021-05-18
申请号：US15930250
申请日：2020-05-12
Applicant: Apple Inc.
Inventor： Maxim Smirnov
Abstract: Embodiments relate to enhancing local contrast in an image. A bilateral high pass filter generates a high frequency value for each pixel of an input image, based on a convolution using photometric kernel coefficients associated with other pixels around the pixel. A noise control circuit generates a modulated high frequency value for the pixel based on a noise model for the image defining a noise threshold value for modifying the high frequency value. The modulated high frequency value for the pixel is then combined with a pixel value of the pixel to generate an enhanced value for the pixel. Enhanced values for pixels of the image may be generated to provide the local contrast enhancement for the input image.
-
公开(公告)号：US10991083B2
公开(公告)日：2021-04-27
申请号：US17020626
申请日：2020-09-14
Applicant: Apple Inc.
Inventor： Sheng Lin , Maxim Smirnov , David R. Pope , Farhan Baqai
Abstract: Embodiments relate to a bilateral filter circuit for directional filtering of an image. The directional bilateral filter circuit determines an edge direction and a weight for the edge direction by processing differences between pixel values of pixels in a first block of pixels in the image. The bilateral filter circuit determines non-directional taps for pixels in a second block by processing pixel locations, and determines directional taps by processing differences between pixel values, gradient information for the second block and the edge direction. The bilateral filter circuit determines final filter taps for pixels in the second block by blending corresponding non-directional taps and directional taps using the weight. The bilateral filter circuit obtains a pixel value of a filtered image by multiplying the final filter taps to corresponding pixel values of the pixels in the second block and adding the multiplied values.
-
公开(公告)号：US20200334787A1
公开(公告)日：2020-10-22
申请号：US16391224
申请日：2019-04-22
Applicant: Apple Inc.
Inventor： Maxim Smirnov , Elena Lamburn , Oren Kerem , Chihsin Wu
Abstract: A portable electronic device may include an image signal processor that includes a clipping circuit, a pyramid generator circuit, and an image fusion processor. The clipping circuit clips pixel values that are under-exposed or over-exposed. The pyramid generator circuit applies a filter to the pixels of the image to generate a filtered image. Some of the filtered pixels may be generated from one or more clipped pixel values. The pyramid generator circuit identifies those filtered pixels that are generated from one or more clipped pixel values and marks the identified filtered pixels with a tag. The pyramid generator circuit decimates the filtered image to generate a downscaled image, which may include one or more filtered pixels that are marked with the tags. The image fusion processor fuses the downscaled image with another image. The pixels that are marked with the tags may be disregarded in the fusion process.
-
公开(公告)号：US10692191B2
公开(公告)日：2020-06-23
申请号：US16100833
申请日：2018-08-10
Applicant: Apple Inc.
Inventor： Maxim Smirnov
Abstract: Embodiments relate to enhancing local contrast in an image. A bilateral high pass filter generates a high frequency value for each pixel of an input image, based on a convolution using photometric kernel coefficients associated with other pixels around the pixel. A noise control circuit generates a modulated high frequency value for the pixel based on a noise model for the image defining a noise threshold value for modifying the high frequency value. The modulated high frequency value for the pixel is then combined with a pixel value of the pixel to generate an enhanced value for the pixel. Enhanced values for pixels of the image may be generated to provide the local contrast enhancement for the input image.
-
30.发明公开公开(公告)号：US20240303778A1
公开(公告)日：2024-09-12
申请号：US18117644
申请日：2023-03-06
Applicant: Apple Inc.
Inventor： Maxim Smirnov
CPC classification number: G06T5/70 , G06T5/20 , G06T2207/20081 , G06T2207/30168
Abstract: Embodiments relate to an image processing circuit that performs noise reduction on image data. The image processing circuit includes a noise reduction circuit with a kernel calculation circuit, a noise filtering circuit, and a blending circuit. The kernel calculation circuit generates a machine learning (ML) kernel for at least one pixel of an image and a bilateral kernel for the at least one pixel of the image. The noise filtering circuit performs noise filtering of the image using the ML kernel to generate a first de-noised version of the image, and performs noise filtering of the image using the bilateral kernel to generate a second de-noised version of the image. The blending circuit blends each color component of the first de-noised version of the image with a corresponding color component of the second de-noised version of the image to generate a de-noised multi-color version of the image.
-
-
-
-
-
-
-
-
-
Search Results
35
records
(took 0.021 seconds)
