-
公开(公告)号:US09648261B2
公开(公告)日:2017-05-09
申请号:US14836918
申请日:2015-08-26
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , David R. Pope , Touraj Tajbakhsh
CPC classification number: H04N5/3675 , G06T5/20 , H04N5/23212 , H04N5/357 , H04N5/3572 , H04N9/045
Abstract: An image processing pipeline may account for clipped pixels in auto focus statistics. Generating auto focus statistics may include evaluating a neighborhood of pixels with respect to a given pixel in a stream of pixels for an image. If a clipped pixel is identified within the neighborhood of pixels then the evaluation of the given pixel may be excluded from an auto focus statistic. The image processing pipeline may also provide auto focus statistics that do not exclude clipped pixels. A luminance edge detection value may, in some embodiments, be generated by applying an IIR filter to the given pixel in a stream of pixels to band-pass filter the given pixel before including the band-pass filtered pixel in the generation of the luminance edge detection value.
-
公开(公告)号:US12231787B2
公开(公告)日:2025-02-18
申请号:US18669229
申请日:2024-05-20
Applicant: Apple Inc.
Inventor: Sheng Lin , D. Amnon Silverstein , David R. Pope
Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.
-
公开(公告)号:US20240029210A1
公开(公告)日:2024-01-25
申请号:US18361685
申请日:2023-07-28
Applicant: Apple Inc.
Inventor: David R. Pope
CPC classification number: G06T5/002 , H04N9/646 , G06T5/00 , G06V10/462 , G06V10/56 , G06V10/94 , G06T7/10 , G06T2200/28 , G06T2207/20164
Abstract: Methods and systems for detecting keypoints in image data may include an image sensor interface receiving pixel data from an image sensor. A front-end pixel data processing circuit may receive pixel data and convert the pixel data to a different color space format. A back-end pixel data processing circuit may perform one or more operations on the pixel data. An output circuit may receive pixel data and output the pixel data to a system memory. A keypoint detection circuit may receive pixel data from the image sensor interface in the image sensor pixel data format or receive pixel data after processing by the front-end or the back-end pixel data processing circuits. The keypoint detection circuit may perform a keypoint detection operation on the pixel data to detect one or more keypoints in the image frame and output to the system memory a description of the one or more keypoints.
-
公开(公告)号:US20230388468A1
公开(公告)日:2023-11-30
申请号:US18231648
申请日:2023-08-08
Applicant: Apple Inc.
Inventor: Yung-Chin Chen , Michael Bekerman , Guy Côté , Aleksandr M. Movshovich , D. Amnon Silverstein , David R. Pope
IPC: H04N13/111 , H04N13/178 , G06T19/00 , G06T15/00 , H04N13/122
CPC classification number: H04N13/111 , H04N13/178 , G06T19/006 , G06T15/005 , H04N13/122
Abstract: In one embodiment, a system includes a first device rendering image data, a second device storing the image data, and a display panel that displays the image data stored in the memory. The first device renders multiple frames of the image data, compresses the multiple frames into a single superframe, and transports the single superframe. The second device receives the single superframe, decompresses the single superframe into the multiple frames of image data, and stores the image data on a memory of the second device.
-
公开(公告)号:US11743440B2
公开(公告)日:2023-08-29
申请号:US17234510
申请日:2021-04-19
Applicant: Apple Inc.
Inventor: Yung-Chin Chen , Michael Bekerman , Guy Côté , Aleksandr M. Movshovich , D. Amnon Silverstein , David R. Pope
IPC: H04N13/111 , H04N13/178 , G06T19/00 , G06T15/00 , H04N13/122
CPC classification number: H04N13/111 , G06T15/005 , G06T19/006 , H04N13/122 , H04N13/178
Abstract: In one embodiment, a system includes a first device rendering image data, a second device storing the image data, and a display panel that displays the image data stored in the memory. The first device renders multiple frames of the image data, compresses the multiple frames into a single superframe, and transports the single superframe. The second device receives the single superframe, decompresses the single superframe into the multiple frames of image data, and stores the image data on a memory of the second device.
-
公开(公告)号:US20230230199A1
公开(公告)日:2023-07-20
申请号:US17578127
申请日:2022-01-18
Applicant: Apple Inc.
Inventor: Sarvesh Swami , David R. Pope , Sheng Lin , Amnon D. Silverstein
CPC classification number: G06T3/4015 , G06T3/4007 , G06T5/20
Abstract: Embodiments relate to a multi-mode demosaicing circuit able to receive and demosaic image data in a different raw image formats, such as Bayer raw image format and Quad Bayer raw image format. The multi-mode demosaicing circuit demosaics Quad Bayer image data by interpolating a green channel of the image data along each of a plurality of directions, generating a gradient of the image data along each of the plurality of directions, modifying the interpolated green channels based on respective gradients to generate full-resolution green channel image data, which is combined with red and blue image data to generate the demosaiced image data. Interpolation is performed for non-green pixels based on neighboring green pixels along a specified direction, modified by a residual value based upon values of one or more nearby same-color pixels and a correlation between values of the same-color pixels and neighboring green pixels.
-
公开(公告)号:US20220337799A1
公开(公告)日:2022-10-20
申请号:US17234510
申请日:2021-04-19
Applicant: Apple Inc.
Inventor: Yung-Chin Chen , Michael Bekerman , Guy Côté , Aleksandr M. Movshovich , D. Amnon Silverstein , David R. Pope
IPC: H04N13/111 , H04N13/178 , H04N13/122 , G06T15/00 , G06T19/00
Abstract: In one embodiment, a system includes a first device rendering image data, a second device storing the image data, and a display panel that displays the image data stored in the memory. The first device renders multiple frames of the image data, compresses the multiple frames into a single superframe, and transports the single superframe. The second device receives the single superframe, decompresses the single superframe into the multiple frames of image data, and stores the image data on a memory of the second device.
-
公开(公告)号:US20220286604A1
公开(公告)日:2022-09-08
申请号:US17195520
申请日:2021-03-08
Applicant: Apple Inc.
Inventor: David R. Pope , Liran Fishel , Assaf Metuki , Muge Wang
Abstract: Embodiments relate to extracting features from images, such as by identifying keypoints and generating keypoint descriptors of the keypoints. An apparatus includes a pyramid image generator circuit, a keypoint descriptor generator circuit, and a pyramid image buffer. The pyramid image generator circuit generates an image pyramid from an input image. The keypoint descriptor generator circuit processes the pyramid images for keypoint descriptor generation. The pyramid image buffer stores different portions of the pyramid images generated by the pyramid image generator circuit at different times and provides the stored portions of the pyramid images to the keypoint descriptor generator circuit for keypoint descriptor generation. When first portions of the pyramid images are no longer needed for the keypoint descriptor generation, the first portions are removed from the pyramid image buffer to provide space for second portions of the pyramid images that are needed for the keypoint descriptor generation.
-
公开(公告)号:US20220215506A1
公开(公告)日:2022-07-07
申请号:US17143995
申请日:2021-01-07
Applicant: Apple Inc.
Inventor: Chihsin Wu , David R. Pope , Sheng Lin , Amnon D. Silverstein
Abstract: A foveated down sampling and correction (FDS-C) circuit for combined down sampling and correction of chromatic aberrations in images. The FDS-C circuit performs down sampling and interpolation of pixel values of a first subset of pixels of a color in a raw image using down sampling scale factors and first interpolation coefficients to generate first corrected pixel values for pixels of the color in a first corrected version of the raw image. The FDS-C circuit further performs interpolation of pixel values of a second subset of the pixels in the first corrected version using second interpolation coefficients to generate second corrected pixel values for pixels of the color in a second corrected version of the raw image. Pixels in the first subset are arranged in a first direction, pixels in the second subset are arranged in a second direction, and the down sampling scale factors vary along the first direction.
-
公开(公告)号:US20210321065A1
公开(公告)日:2021-10-14
申请号:US16848131
申请日:2020-04-14
Applicant: Apple Inc.
Inventor: Chihsin Wu , David R. Pope
Abstract: Embodiments relate to lateral chromatic aberration (LCA) recovery of raw image data generated by image sensors. A chromatic aberration recovery circuit performs chromatic aberration recovery on the raw image data to correct the resulting LCA in the full color images using pre-calculated offset values of a subset of colors of pixels.
-
-
-
-
-
-
-
-
-