-
公开(公告)号：US20200050880A1
公开(公告)日：2020-02-13
申请号：US16101138
申请日：2018-08-10
Applicant: Apple Inc.
Inventor： David R. Pope , Cecile Foret , Jung Kim
Abstract: Embodiments relate a keypoint detection circuit for identifying keypoints in captured image frames. The keypoint detection circuit generates an image pyramid based upon a received image frame, and determine multiple sets of keypoints for each octave of the pyramid using different levels of blur. In some embodiments, the keypoint detection circuit includes multiple branches, each branch made up of one or more circuits for determining a different set of keypoints from the image, or for determining a subsampled image for a subsequent octave of the pyramid. By determining multiple sets of keypoints for each of a plurality of pyramid octaves, a larger, more varied set of keypoints can be obtained and used for object detection and matching between images.
-
公开(公告)号：US09992467B2
公开(公告)日：2018-06-05
申请号：US15198907
申请日：2016-06-30
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , David R. Pope
IPC: H04N5/228 , H04N9/73 , H04N5/76 , H04N9/64 , G06T1/20 , H04N5/262 , G06T3/40 , G06T5/00 , G06T5/40
CPC classification number: H04N9/646 , G06T1/20 , G06T3/4015 , G06T5/009 , G06T5/40 , G06T2207/10024 , G06T2207/20072 , H04N5/2628
Abstract: Embodiments relate to an architecture of a vision pipe included in an image signal processor. The architecture includes a front-end portion that includes a pair of image signal pipelines that generate an updated luminance image data. A back-end portion of the vision pipe architecture receives the updated luminance images from the front-end portion and performs, in parallel, scaling and various computer vision operations on the updated luminance image data. The back-end portion may repeatedly perform this parallel operation of computer vision operations on successively scaled luminance images to generate a pyramid image.
-
公开(公告)号：US20170364768A1
公开(公告)日：2017-12-21
申请号：US15694826
申请日：2017-09-03
Applicant: Apple Inc.
Inventor： David R. Pope
CPC classification number: G06K9/4671 , G06K9/00973 , G06K9/4652 , G06K9/4661 , G06K2009/4666 , G06T5/00 , G06T5/002 , G06T7/10 , G06T2200/28 , G06T2207/20164 , H04N9/646
Abstract: Methods and systems for detecting keypoints in image data may include an image sensor interface receiving pixel data from an image sensor. A front-end pixel data processing circuit may receive pixel data and convert the pixel data to a different color space format. A back-end pixel data processing circuit may perform one or more operations on the pixel data. An output circuit may receive pixel data and output the pixel data to a system memory. A keypoint detection circuit may receive pixel data from the image sensor interface in the image sensor pixel data format or receive pixel data after processing by the front-end or the back-end pixel data processing circuits. The keypoint detection circuit may perform a keypoint detection operation on the pixel data to detect one or more keypoints in the image frame and output to the system memory a description of the one or more keypoints.
-
公开(公告)号：US09756266B2
公开(公告)日：2017-09-05
申请号：US14977384
申请日：2015-12-21
Applicant: Apple Inc.
Inventor： Christopher L. Mills , Sheng Lin , David R. Pope , D. Amnon Silverstein , Suk Hwan Lim
CPC classification number: H04N9/04511 , G06T3/4015 , H04N5/2628 , H04N9/07 , H04N9/646 , H04N2209/046
Abstract: An input rescale module that performs cross-color correlated downscaling of sensor data in the horizontal and vertical dimensions. The module may perform a first-pass demosaic of sensor data, apply horizontal and vertical scalers to resample and downsize the data in the horizontal and vertical dimensions, and then remosaic the data to provide horizontally and vertically downscaled sensor data as output for additional image processing. The module may, for example, act as a front end scaler for an image signal processor (ISP). The demosaic performed by the module may be a relatively simple demosaic, for example a demosaic function that works on 3×3 blocks of pixels. The front end of module may receive and process sensor data at two pixels per clock (ppc); the horizontal filter component reduces the sensor data down to one ppc for downstream components of the input rescale module and for the ISP pipeline.
-
公开(公告)号：US20170070689A1
公开(公告)日：2017-03-09
申请号：US14848276
申请日：2015-09-08
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Sheng Lin , David R. Pope , Suk Hwan Lim
CPC classification number: H04N5/3572 , G06T5/008 , H01L27/14623 , H01L27/14643 , H04N5/3651 , H04N5/3696 , H04N9/646
Abstract: Systems and methods for automatic lens flare compensation may include a non-uniformity detector configured to operate on pixel data for an image in an image sensor color pattern. The non-uniformity detector may detect a non-uniformity in the pixel data in a color channel of the image sensor color pattern. The non-uniformity detector may generate output including location and magnitude values of the non-uniformity. A lens flare detector may determine, based at least on the location and magnitude values, whether the output of the non-uniformity detector corresponds to a lens flare in the image. In some embodiments, the lens flare detector may generate, in response to determining that the output corresponds to the lens flare, a representative map of the lens flare. A lens flare corrector may determine one or more pixel data correction values corresponding to the lens flare and apply the pixel data correction values to the pixel data.
Abstract translation: 用于自动镜头光斑补偿的系统和方法可以包括被配置为对图像传感器颜色图案中的图像的像素数据进行操作的非均匀性检测器。 不均匀性检测器可以检测图像传感器颜色图案的颜色通道中的像素数据的不均匀性。 不均匀性检测器可以产生包括不均匀性的位置和幅度值的输出。 透镜闪光检测器可以至少基于位置和幅度值来确定不均匀性检测器的输出是否对应于图像中的透镜闪光。 在一些实施例中，透镜光斑检测器可以响应于确定输出对应于透镜闪光而产生透镜的代表性地图闪光。 透镜闪光校正器可以确定与透镜光斑相对应的一个或多个像素数据校正值，并将像素数据校正值应用于像素数据。
-
Patent Agency Ranking
公开(公告)号：US20170061234A1
公开(公告)日：2017-03-02
申请号：US14841406
申请日：2015-08-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , David R. Pope
CPC classification number: G06K9/4661 , G06K9/4652 , G06T3/40 , G06T5/00 , G06T5/002 , G06T5/003 , G06T5/20
Abstract: An image processing pipeline may perform noise filtering and image sharpening utilizing common spatial support. A noise filter may perform a spatial noise filtering technique to determine a filtered value of a given pixel based on spatial support obtained from line buffers. Sharpening may also be performed to generate a sharpened value of the given pixel based on spatial support obtained from the same line buffers. A filtered and sharpened version of the pixel may be generated by combining the filtered value of the given pixel with the sharpened value of the given pixel. In at least some embodiments, the noise filter performs spatial noise filtering and image sharpening on a luminance value of the given pixel, when the given pixel is received in a luminance-chrominance encoding.
Abstract translation: 图像处理流水线可以利用共同的空间支持来执行噪声滤波和图像锐化。 噪声滤波器可以执行空间噪声滤波技术，以基于从线缓冲器获得的空间支持来确定给定像素的滤波值。 还可以执行锐化以基于从相同的行缓冲器获得的空间支持来产生给定像素的锐化值。 可以通过将给定像素的滤波值与给定像素的锐化值组合来生成像素的滤波和锐化版本。 在至少一些实施例中，当在亮度 - 色度编码中接收给定像素时，噪声滤波器对给定像素的亮度值执行空间噪声滤波和图像锐化。
-
公开(公告)号：US09219870B1
公开(公告)日：2015-12-22
申请号：US14449005
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Christopher L. Mills , Sheng Lin , David R. Pope , D. Amnon Silverstein , Suk Hwan Lim
CPC classification number: H04N9/04511 , G06T3/4015 , H04N5/2628 , H04N9/07 , H04N9/646 , H04N2209/046
Abstract: An input rescale module that performs cross-color correlated downscaling of sensor data in the horizontal and vertical dimensions. The module may perform a first-pass demosaic of sensor data, apply horizontal and vertical scalers to resample and downsize the data in the horizontal and vertical dimensions, and then remosaic the data to provide horizontally and vertically downscaled sensor data as output for additional image processing. The module may, for example, act as a front end scaler for an image signal processor (ISP). The demosaic performed by the module may be a relatively simple demosaic, for example a demosaic function that works on 3×3 blocks of pixels. The front end of module may receive and process sensor data at two pixels per clock (ppc); the horizontal filter component reduces the sensor data down to one ppc for downstream components of the input rescale module and for the ISP pipeline.
Abstract translation: 在水平和垂直维度上执行传感器数据的交叉色相关缩小的输入重定标模块。 模块可以执行传感器数据的第一遍去马赛克，应用水平和垂直缩放器对水平和垂直尺寸的数据进行重新采样和缩小，然后重新绘制数据，以提供水平和垂直缩小的传感器数据作为附加图像处理的输出 。 该模块可以例如用作图像信号处理器（ISP）的前端缩放器。 由模块执行的去镶嵌可以是相对简单的去马赛克，例如在3×3像素块上工作的去马赛克功能。 模块的前端可以以每个时钟两个像素（ppc）接收和处理传感器数据; 水平滤波器组件将传感器数据减少到输入重定标模块的下游组件和ISP管线的一ppc。
-
公开(公告)号：US12262117B2
公开(公告)日：2025-03-25
申请号：US17933941
申请日：2022-09-21
Applicant: Apple Inc.
Inventor： Patrick A. Carroll , Ajay Ramesh , Ashwini Dwarakanath , David A. Silverstein , David R. Pope , Michael W. Tao , Terence N. Tam , Vitanshu Sharma
Abstract: Devices, methods, and non-transitory program storage devices are disclosed herein to perform predictive image sensor cropping operations to improve the performance of video image stabilization operations, especially for high resolution image sensors. According to some embodiments, the techniques include, for each of one or more respective images of a first plurality of images: obtaining image information corresponding to one or more images in the first plurality of images captured prior to the respective image; predicting, for the respective image, an image sensor cropping region to be read out from the first image sensor; and then reading out, into a memory, a first cropped version of the respective image comprising only the predicted image sensor cropping region for the respective image. Then, a first video may be produced based, at least in part, on the first cropped versions of the one or more respective images of the first plurality of images.
-
公开(公告)号：US20240297949A1
公开(公告)日：2024-09-05
申请号：US18117065
申请日：2023-03-03
Applicant: Apple Inc.
Inventor： Muge Wang , William T. Warner , David R. Pope
CPC classification number: H04N1/6019 , G06T3/18 , G06T3/4007 , G06T5/92 , G06T7/90 , G06V10/56 , G06V10/60 , H04N9/69 , G06T2207/10024
Abstract: An image processing circuit for performing local tone mapping (LTM) after image warping. The image processing circuit includes a warping circuit that warps an input image to generate a warped image, and a LTM circuit coupled to the warping circuit. The LTM circuit determines an input color component value for a color component of a pixel in a version of the warped image, determines an output color component value for the color component of the pixel, based on mapping of coordinates of pixels in the warped image to coordinates of pixels in the input image, determines a gain value for the pixel as a ratio of the output color component value relative to the input color component value, and adjusts color component values for color components of the pixel using the gain value to generate adjusted color component values for the color components of the pixel in an output image.
-
公开(公告)号：US11863889B2
公开(公告)日：2024-01-02
申请号：US17734576
申请日：2022-05-02
Applicant: Apple Inc.
Inventor： Chihsin Wu , David R. Pope
IPC: G06T5/00 , H04N25/611 , H04N9/64 , H04N25/68
CPC classification number: H04N25/611 , G06T5/006 , H04N9/646 , H04N25/68 , G06T2207/10024
Abstract: Embodiments relate to lateral chromatic aberration (LCA) recovery of raw image data generated by image sensors. A chromatic aberration recovery circuit performs chromatic aberration recovery on the raw image data to correct the resulting LCA in the full color images using pre-calculated offset values of a subset of colors of pixels.
-
-
-
-
-
-
-
-
-
Search Results
89
records
(took 0.026 seconds)
