公开(公告)号：US20230138779A1

公开(公告)日：2023-05-04

申请号：US17518437

申请日：2021-11-03

Applicant: Apple Inc.

Inventor： Kaiming Liu ,  Maxim Smirnov ,  William T. Warner ,  David Pope ,  Hui Chao ,  Jason Holloway

IPC: G06T5/00 ,  G06T5/50 ,  G06K9/62 ,  G06T3/00 ,  G06T7/33

Abstract: Embodiments of the present disclosure relate performing registration of a first image to a second image where the first image is undistorted to linear space before applying a geometric transformation matrix to modify the first image to align with the second image. The geometric transformation matrix may be a linear matrix that causes the undistorted version of the first image to make translation movement, rotational movement or both. The undistorted and modified first image is then reverted back to nonlinear distorted space. Then the reverted first image may be warped to better align with the second image for fusing with the second image. In this way, visual distortions in the fused image such as wobbling may be reduced or eliminated.

公开(公告)号：US11024006B2

公开(公告)日：2021-06-01

申请号：US16391224

申请日：2019-04-22

Applicant: Apple Inc.

Inventor： Maxim Smirnov ,  Elena Lamburn ,  Oren Kerem ,  Chihsin Wu

IPC: G06T3/40 ,  G06T3/00 ,  G06T5/30 ,  G06T5/50 ,  G06T5/00

Abstract: A portable electronic device may include an image signal processor that includes a clipping circuit, a pyramid generator circuit, and an image fusion processor. The clipping circuit clips pixel values that are under-exposed or over-exposed. The pyramid generator circuit applies a filter to the pixels of the image to generate a filtered image. Some of the filtered pixels may be generated from one or more clipped pixel values. The pyramid generator circuit identifies those filtered pixels that are generated from one or more clipped pixel values and marks the identified filtered pixels with a tag. The pyramid generator circuit decimates the filtered image to generate a downscaled image, which may include one or more filtered pixels that are marked with the tags. The image fusion processor fuses the downscaled image with another image. The pixels that are marked with the tags may be disregarded in the fusion process.

公开(公告)号：US20210042899A1

公开(公告)日：2021-02-11

申请号：US17083719

申请日：2020-10-29

Applicant: Apple Inc.

Inventor： Maxim Smirnov ,  Elena Lamburn

IPC: G06T5/50 ,  G06T5/00 ,  H04N5/235

Abstract: Embodiments relate to fusion processing between two images captured with two different exposure times to generate a fused image with a higher dynamic range. An unscaled single color version of a first image is blended with another unscaled single color version of a second image to generate an unscaled single color version of the fused image. A downscaled multi-color version of the first image is blended with a downscaled multi-color version of the second image to generate a downscaled multi-color version of the fused image of a plurality of downscaled versions of the fused image. A first downscaled multi-color version of the fused image is generated by upscaling and accumulating the plurality of downscaled versions of the fused image. The first downscaled multi-color version of the fused image has a pixel resolution lower than a pixel resolution of the unscaled single color version of the fused image.

公开(公告)号：US20200311890A1

公开(公告)日：2020-10-01

申请号：US16370662

申请日：2019-03-29

Applicant: Apple Inc.

Inventor： Maxim Smirnov ,  Elena Lamburn

IPC: G06T5/50 ,  H04N5/235 ,  G06T5/00

Abstract: Embodiments relate to fusion processing between two images captured with two different exposure times to generate a fused image with a higher dynamic range. An unscaled single color version of a first image is blended with another unscaled single color version of a second image to generate an unscaled single color version of the fused image. A downscaled multi-color version of the first image is blended with a downscaled multi-color version of the second image to generate a downscaled multi-color version of the fused image of a plurality of downscaled versions of the fused image. A first downscaled multi-color version of the fused image is generated by upscaling and accumulating the plurality of downscaled versions of the fused image. The first downscaled multi-color version of the fused image has a pixel resolution lower than a pixel resolution of the unscaled single color version of the fused image.

公开(公告)号：US20200051215A1

公开(公告)日：2020-02-13

申请号：US16100833

申请日：2018-08-10

Applicant: Apple Inc.

Inventor： Maxim Smirnov

IPC: G06T5/00 ,  G06T5/20 ,  G06T3/40

Abstract: Embodiments relate to enhancing local contrast in an image. A bilateral high pass filter generates a high frequency value for each pixel of an input image, based on a convolution using photometric kernel coefficients associated with other pixels around the pixel. A noise control circuit generates a modulated high frequency value for the pixel based on a noise model for the image defining a noise threshold value for modifying the high frequency value. The modulated high frequency value for the pixel is then combined with a pixel value of the pixel to generate an enhanced value for the pixel. Enhanced values for pixels of the image may be generated to provide the local contrast enhancement for the input image.