公开(公告)号：US20240104691A1

公开(公告)日：2024-03-28

申请号：US18481696

申请日：2023-10-05

Applicant: Apple Inc.

Inventor： Maxim SMIRNOV ,  David R. POPE

IPC: G06T3/40 ,  G06T3/00 ,  G06T5/00 ,  G06T5/50

CPC classification number: G06T3/4015 ,  G06T3/0093 ,  G06T5/002 ,  G06T5/50 ,  G06T2207/20016 ,  G06T2207/20221

Abstract: Embodiments relate to an image processing circuit able to perform image fusion on received images in at least a first mode for fusing demosaiced and downscaled image data, and a second mode for fusing raw image data. Raw image data is received from an image sensor in Bayer RGB format. In the first mode, the raw image data is demosaiced and resampled prior to undergoing image fusion. On the other hand, in the second raw image mode, the image processing circuit performs image fusion on the raw Bayer image data, and demosaics and resamples the generated fused raw Bayer image. This may ensure a cleaner image signal for image fusion, but consumes more memory. The image processing circuit is configured to support both modes of operation, allowing for fused images to be generated to satisfy the requirements of different applications.

公开(公告)号：US20240205363A1

公开(公告)日：2024-06-20

申请号：US18444524

申请日：2024-02-16

Applicant: Apple Inc.

Inventor： David R. POPE ,  Liran FISHEL ,  Assaf METUKI ,  Muge WANG

IPC: H04N5/76 ,  G06T1/60 ,  G06T7/246 ,  H04N1/21

CPC classification number: H04N5/76 ,  G06T1/60 ,  G06T7/251 ,  H04N1/2141 ,  G06T2207/20016

Abstract: Embodiments relate to extracting features from images, such as by identifying keypoints and generating keypoint descriptors of the keypoints. An apparatus includes a pyramid image generator circuit, a keypoint descriptor generator circuit, and a pyramid image buffer. The pyramid image generator circuit generates an image pyramid from an input image. The keypoint descriptor generator circuit processes the pyramid images for keypoint descriptor generation. The pyramid image buffer stores different portions of the pyramid images generated by the pyramid image generator circuit at different times and provides the stored portions of the pyramid images to the keypoint descriptor generator circuit for keypoint descriptor generation. When first portions of the pyramid images are no longer needed for the keypoint descriptor generation, the first portions are removed from the pyramid image buffer to provide space for second portions of the pyramid images that are needed for the keypoint descriptor generation.

公开(公告)号：US20240169481A1

公开(公告)日：2024-05-23

申请号：US18429536

申请日：2024-02-01

Applicant: Apple Inc.

Inventor： Sarvesh SWAMI ,  David R. POPE ,  Sheng LIN ,  Amnon D. SILVERSTEIN

IPC: G06T3/4015 ,  G06T3/4007 ,  G06T5/20

CPC classification number: G06T3/4015 ,  G06T3/4007 ,  G06T5/20

Abstract: Embodiments ralte to a multi-mode demosaicing circuit able to receive and demosaic image data in a different raw image formats, such as Bayer raw image format and Quad Bayer raw image format. The multi-mode demosaicing circuit demosaics Quad Bayer image data by interpolating a green channel of the image data along each of a plurality of directions, generating a gradient of the image data along each of the plurality of directions, modifying the interpolated green channels based on respective gradients to generate full-resolution green channel image data, which is combined with red and blue image data to generate the demosaiced image data. Interpolation is performed for non-green pixels based on neighboring green pixels along a specified direction, modified by a residual value based upon valued of one or more nearby same-color pixels and a correlation between values of the same color pixels and neighboring green pixels.