Multi-scale warping circuit for image fusion architecture

    公开(公告)号:US11334961B2

    公开(公告)日:2022-05-17

    申请号:US16987272

    申请日:2020-08-06

    Applicant: Apple Inc.

    Abstract: Embodiments relate to circuitry for warping image pyramids for image fusion. An image fusion circuit receives captured images, and generates image pyramids corresponding to the received images to be used for image fusion. A warping circuit warps the first image pyramid based upon one or more warping parameters to align the first image pyramid to the second image pyramid. The warping circuit is a multi-scale warping circuit configured to warp each level of the first image pyramid, using a first warping engine that warps a base level of the image pyramid, and at least one addition warping engine that warps a plurality of scaled levels of the image pyramid in parallel with the first warping engine.

    Auto-focus engine architecture for image signal processor

    公开(公告)号:US11023994B2

    公开(公告)日:2021-06-01

    申请号:US16376414

    申请日:2019-04-05

    Applicant: Apple Inc.

    Abstract: Embodiments relate to image signal processors (ISP) that include one or more auto-focus circuits. Each of the auto-focus circuits may be connected to an image sensor and may be separate from a statistics circuit and other image processing pipelines of the ISP. An image sensor may include one or more focus pixels that are used to generate data for auto-focusing. The auto-focus circuit may extract the focus pixel values and generate a signal to control the lens position of the image sensor. Each image sensor may include a separate auto-focus circuit. When other image processing pipelines of the ISP are processing the image data from one image sensor, the auto-focus circuit for another image sensor may continue to generate focus signals that control the lens position of the other image sensor. The other image sensor may be in standby but may continue to remain in focus.

    Directional bilateral filtering with improved noise reduction along edges

    公开(公告)号:US10991083B2

    公开(公告)日:2021-04-27

    申请号:US17020626

    申请日:2020-09-14

    Applicant: Apple Inc.

    Abstract: Embodiments relate to a bilateral filter circuit for directional filtering of an image. The directional bilateral filter circuit determines an edge direction and a weight for the edge direction by processing differences between pixel values of pixels in a first block of pixels in the image. The bilateral filter circuit determines non-directional taps for pixels in a second block by processing pixel locations, and determines directional taps by processing differences between pixel values, gradient information for the second block and the edge direction. The bilateral filter circuit determines final filter taps for pixels in the second block by blending corresponding non-directional taps and directional taps using the weight. The bilateral filter circuit obtains a pixel value of a filtered image by multiplying the final filter taps to corresponding pixel values of the pixels in the second block and adding the multiplied values.

    HIGH DYNAMIC RANGE COLOR CONVERSION USING SELECTIVE INTERPOLATION

    公开(公告)号:US20200314289A1

    公开(公告)日:2020-10-01

    申请号:US16364049

    申请日:2019-03-25

    Applicant: Apple Inc.

    Abstract: Embodiments relate to circuitry for pixel conversion of images for display. A circuit converts input pixel values of an image using a color conversion function. A lookup table memory circuit stores a mapping of color converted values and input pixel values where the mapping represents the color conversion function. The circuit produces a color converted value from the lookup table as a color converted version of a first input pixel value responsive to the first input pixel value being within a first range. The circuit may also produce a color converted version of a second input pixel value by interpolating a subset of the color converted values received from the lookup table responsive to the second input pixel being within a second input range.

    DIRECTIONAL BILATERAL FILTERING OF RAW IMAGE DATA

    公开(公告)号:US20200294199A1

    公开(公告)日:2020-09-17

    申请号:US16352801

    申请日:2019-03-13

    Applicant: Apple Inc.

    Abstract: Embodiments relate to directional bilateral filtering of a raw image. For each pixel in the image, a block of pixels surrounding that pixel is used for filtering. When the block of pixels in a Bayer pattern have directionality, directional filter coefficients are used instead of default filter coefficients. To obtain a directional tap, a directional filter coefficient is attenuated by an attenuation factor that differs based at least on the location of the pixels in the pixel block. The directional taps are blended with non-directional taps derived from the default filter coefficients using a weight representing confidence on the directionality. The filtered pixel values are then obtained by multiplying pixel values with corresponding taps.

    Image pipeline with dual demosaicing circuit for efficient image processing

    公开(公告)号:US10692177B2

    公开(公告)日:2020-06-23

    申请号:US16100709

    申请日:2018-08-10

    Applicant: Apple Inc.

    Abstract: Embodiments relate to a first demosaicing circuit and a second demosaicing circuit that can perform demosaicing of image data. The first demosaicing circuit processes received image data to generate a first demosaiced image for obtaining statistic information on the received image data. The second demosaicing circuit performs demosaicing of the received image data to generate a second demosaiced image. A processing circuit pipeline performs at least one of resampling, noise processing, color processing and output rescaling performed on the second demosaiced image based on the statistics information obtained from the first demosaiced image.

    Adjusting confidence values for correcting pixel defects

    公开(公告)号:US10554914B1

    公开(公告)日:2020-02-04

    申请号:US16101154

    申请日:2018-08-10

    Applicant: Apple Inc.

    Abstract: Embodiments relate to a pixel defect detection circuit for detecting and correcting defective pixels in captured image frames. The pixel defect detection circuit includes a defect pixel location table that maps pixel locations in an image frame to respective confidence values, each confidence value indicating a likelihood that a corresponding pixel is defective. The pixel defect detection circuit further includes a dynamic defect processing circuit configured to determine whether a first pixel of an image frame is defective, and a flatness detection circuit configured to determine whether the first pixel is in a flat region of the image frame. The confidence value corresponding to the location of the first pixel is updated based upon whether the first pixel is determined be defective if the first pixel is determined to be in a flat region, and not updated if the first pixel is determined to not be in a flat region.

    Detecting keypoints in image data
    30.
    发明授权

    公开(公告)号:US09754182B2

    公开(公告)日:2017-09-05

    申请号:US14843919

    申请日:2015-09-02

    Applicant: Apple Inc.

    Inventor: David R. Pope

    Abstract: Methods and systems for detecting keypoints in image data may include an image sensor interface receiving pixel data from an image sensor. A front-end pixel data processing circuit may receive pixel data and convert the pixel data to a different color space format. A back-end pixel data processing circuit may perform one or more operations on the pixel data. An output circuit may receive pixel data and output the pixel data to a system memory. A keypoint detection circuit may receive pixel data from the image sensor interface in the image sensor pixel data format or receive pixel data after processing by the front-end or the back-end pixel data processing circuits. The keypoint detection circuit may perform a keypoint detection operation on the pixel data to detect one or more keypoints in the image frame and output to the system memory a description of the one or more keypoints.

Patent Agency Ranking