-
公开(公告)号:US11334961B2
公开(公告)日:2022-05-17
申请号:US16987272
申请日:2020-08-06
Applicant: Apple Inc.
Inventor: Maxim Smirnov , William T. Warner , David R. Pope , Manching Ko
Abstract: Embodiments relate to circuitry for warping image pyramids for image fusion. An image fusion circuit receives captured images, and generates image pyramids corresponding to the received images to be used for image fusion. A warping circuit warps the first image pyramid based upon one or more warping parameters to align the first image pyramid to the second image pyramid. The warping circuit is a multi-scale warping circuit configured to warp each level of the first image pyramid, using a first warping engine that warps a base level of the image pyramid, and at least one addition warping engine that warps a plurality of scaled levels of the image pyramid in parallel with the first warping engine.
-
公开(公告)号:US11023994B2
公开(公告)日:2021-06-01
申请号:US16376414
申请日:2019-04-05
Applicant: Apple Inc.
Inventor: Sheng Lin , David R. Pope , D. Amnon Silverstein
Abstract: Embodiments relate to image signal processors (ISP) that include one or more auto-focus circuits. Each of the auto-focus circuits may be connected to an image sensor and may be separate from a statistics circuit and other image processing pipelines of the ISP. An image sensor may include one or more focus pixels that are used to generate data for auto-focusing. The auto-focus circuit may extract the focus pixel values and generate a signal to control the lens position of the image sensor. Each image sensor may include a separate auto-focus circuit. When other image processing pipelines of the ISP are processing the image data from one image sensor, the auto-focus circuit for another image sensor may continue to generate focus signals that control the lens position of the other image sensor. The other image sensor may be in standby but may continue to remain in focus.
-
公开(公告)号:US10991083B2
公开(公告)日:2021-04-27
申请号:US17020626
申请日:2020-09-14
Applicant: Apple Inc.
Inventor: Sheng Lin , Maxim Smirnov , David R. Pope , Farhan Baqai
Abstract: Embodiments relate to a bilateral filter circuit for directional filtering of an image. The directional bilateral filter circuit determines an edge direction and a weight for the edge direction by processing differences between pixel values of pixels in a first block of pixels in the image. The bilateral filter circuit determines non-directional taps for pixels in a second block by processing pixel locations, and determines directional taps by processing differences between pixel values, gradient information for the second block and the edge direction. The bilateral filter circuit determines final filter taps for pixels in the second block by blending corresponding non-directional taps and directional taps using the weight. The bilateral filter circuit obtains a pixel value of a filtered image by multiplying the final filter taps to corresponding pixel values of the pixels in the second block and adding the multiplied values.
-
公开(公告)号:US20200314289A1
公开(公告)日:2020-10-01
申请号:US16364049
申请日:2019-03-25
Applicant: Apple Inc.
Inventor: Chihsin Wu , David R. Pope
Abstract: Embodiments relate to circuitry for pixel conversion of images for display. A circuit converts input pixel values of an image using a color conversion function. A lookup table memory circuit stores a mapping of color converted values and input pixel values where the mapping represents the color conversion function. The circuit produces a color converted value from the lookup table as a color converted version of a first input pixel value responsive to the first input pixel value being within a first range. The circuit may also produce a color converted version of a second input pixel value by interpolating a subset of the color converted values received from the lookup table responsive to the second input pixel being within a second input range.
-
公开(公告)号:US20200294199A1
公开(公告)日:2020-09-17
申请号:US16352801
申请日:2019-03-13
Applicant: Apple Inc.
Inventor: Sheng Lin , David R. Pope
Abstract: Embodiments relate to directional bilateral filtering of a raw image. For each pixel in the image, a block of pixels surrounding that pixel is used for filtering. When the block of pixels in a Bayer pattern have directionality, directional filter coefficients are used instead of default filter coefficients. To obtain a directional tap, a directional filter coefficient is attenuated by an attenuation factor that differs based at least on the location of the pixels in the pixel block. The directional taps are blended with non-directional taps derived from the default filter coefficients using a weight representing confidence on the directionality. The filtered pixel values are then obtained by multiplying pixel values with corresponding taps.
-
公开(公告)号:US10692177B2
公开(公告)日:2020-06-23
申请号:US16100709
申请日:2018-08-10
Applicant: Apple Inc.
Inventor: Muge Wang , David R. Pope
Abstract: Embodiments relate to a first demosaicing circuit and a second demosaicing circuit that can perform demosaicing of image data. The first demosaicing circuit processes received image data to generate a first demosaiced image for obtaining statistic information on the received image data. The second demosaicing circuit performs demosaicing of the received image data to generate a second demosaiced image. A processing circuit pipeline performs at least one of resampling, noise processing, color processing and output rescaling performed on the second demosaiced image based on the statistics information obtained from the first demosaiced image.
-
公开(公告)号:US10554914B1
公开(公告)日:2020-02-04
申请号:US16101154
申请日:2018-08-10
Applicant: Apple Inc.
Inventor: Sheng Lin , David R. Pope
Abstract: Embodiments relate to a pixel defect detection circuit for detecting and correcting defective pixels in captured image frames. The pixel defect detection circuit includes a defect pixel location table that maps pixel locations in an image frame to respective confidence values, each confidence value indicating a likelihood that a corresponding pixel is defective. The pixel defect detection circuit further includes a dynamic defect processing circuit configured to determine whether a first pixel of an image frame is defective, and a flatness detection circuit configured to determine whether the first pixel is in a flat region of the image frame. The confidence value corresponding to the location of the first pixel is updated based upon whether the first pixel is determined be defective if the first pixel is determined to be in a flat region, and not updated if the first pixel is determined to not be in a flat region.
-
公开(公告)号:US20180007334A1
公开(公告)日:2018-01-04
申请号:US15198907
申请日:2016-06-30
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein , David R. Pope
CPC classification number: H04N9/646 , G06T1/20 , G06T3/4015 , G06T5/009 , G06T5/40 , G06T2207/10024 , G06T2207/20072 , H04N5/2628
Abstract: Embodiments relate to an architecture of a vision pipe included in an image signal processor. The architecture includes a front-end portion that includes a pair of image signal pipelines that generate an updated luminance image data. A back-end portion of the vision pipe architecture receives the updated luminance images from the front-end portion and performs, in parallel, scaling and various computer vision operations on the updated luminance image data. The back-end portion may repeatedly perform this parallel operation of computer vision operations on successively scaled luminance images to generate a pyramid image.
-
公开(公告)号:US20180007333A1
公开(公告)日:2018-01-04
申请号:US15198552
申请日:2016-06-30
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein , David R. Pope
CPC classification number: H04N9/646 , G06T1/20 , G06T3/4007 , G06T3/4015 , H04N9/04 , H04N9/045 , H04N9/67 , H04N9/76
Abstract: Embodiments relate to color correction circuit operations performed by an image signal processor. The color correction circuit computes optimal color correction matrix on a per-pixel basis and adjusts it based on relative noise standard deviations of the color channels to steer the matrix.
-
公开(公告)号:US09754182B2
公开(公告)日:2017-09-05
申请号:US14843919
申请日:2015-09-02
Applicant: Apple Inc.
Inventor: David R. Pope
CPC classification number: G06K9/4671 , G06K9/00973 , G06K9/4652 , G06K9/4661 , G06K2009/4666 , G06T5/00 , G06T5/002 , G06T7/10 , G06T2200/28 , G06T2207/20164 , H04N9/646
Abstract: Methods and systems for detecting keypoints in image data may include an image sensor interface receiving pixel data from an image sensor. A front-end pixel data processing circuit may receive pixel data and convert the pixel data to a different color space format. A back-end pixel data processing circuit may perform one or more operations on the pixel data. An output circuit may receive pixel data and output the pixel data to a system memory. A keypoint detection circuit may receive pixel data from the image sensor interface in the image sensor pixel data format or receive pixel data after processing by the front-end or the back-end pixel data processing circuits. The keypoint detection circuit may perform a keypoint detection operation on the pixel data to detect one or more keypoints in the image frame and output to the system memory a description of the one or more keypoints.
-
-
-
-
-
-
-
-
-