-
公开(公告)号：US20200084401A1
公开(公告)日：2020-03-12
申请号：US16593900
申请日：2019-10-04
Applicant: Apple Inc.
Inventor： Sheng Lin , D. Amnon Silverstein , David R. Pope , Suk Hwan Lim
Abstract: An image signal processor may include a pixel defect correction component that tracks defect history for frames captured by an image sensor and applies the history when identifying and correcting defective pixels in a frame. The component maintains a defect pixel location table that includes a defect confidence value for pixels of the image sensor. The component identifies defective pixels in a frame, for example by comparing each pixel's value to the values of its neighbor pixels. If a pixel is detected as defective, its defect confidence value may be incremented. Otherwise, the value may be decremented. If a pixel's defect confidence value is over a defect confidence threshold, the pixel is considered defective and thus may be corrected. If a pixel's defect confidence value is under the threshold, the pixel is considered not defective and thus may not be corrected even if the pixel was detected as defective.
-
公开(公告)号：US10298863B2
公开(公告)日：2019-05-21
申请号：US14848276
申请日：2015-09-08
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Sheng Lin , David R. Pope , Suk Hwan Lim
Abstract: Systems and methods for automatic lens flare compensation may include a non-uniformity detector configured to operate on pixel data for an image in an image sensor color pattern. The non-uniformity detector may detect a non-uniformity in the pixel data in a color channel of the image sensor color pattern. The non-uniformity detector may generate output including location and magnitude values of the non-uniformity. A lens flare detector may determine, based at least on the location and magnitude values, whether the output of the non-uniformity detector corresponds to a lens flare in the image. In some embodiments, the lens flare detector may generate, in response to determining that the output corresponds to the lens flare, a representative map of the lens flare. A lens flare corrector may determine one or more pixel data correction values corresponding to the lens flare and apply the pixel data correction values to the pixel data.
-
公开(公告)号：US10205898B2
公开(公告)日：2019-02-12
申请号：US14882361
申请日：2015-10-13
Applicant: Apple Inc.
Inventor： Andrew Kenneth John McMahon , D. Amnon Silverstein , David R. Pope , Suk Hwan Lim
Abstract: A pedestal level for an image sensor can be dynamically adjusted based on one or more parameters. The parameters include one or more operating conditions associated with the image sensor, pre-determined image sensor characterization data, the number of unused digital codes, and/or the number of clipped pixel signals. The operating conditions can include the temperature of the image sensor, the gain of at least one amplifier included in processing circuitry operably connected to at least one pixel, and/or the length of the integration period for at least one pixel in the image sensor. Based on the one or more of the parameters, the pedestal level is adjusted to reduce a number of unused digital codes in a distribution of dark current. Additionally or alternatively, the variance of the pixel signals can be reduced to permit the use of a lower pedestal level.
-
公开(公告)号：US09979942B2
公开(公告)日：2018-05-22
申请号：US15198552
申请日：2016-06-30
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , David R. Pope
CPC classification number: H04N9/646 , G06T1/20 , G06T3/4007 , G06T3/4015 , H04N9/04 , H04N9/045 , H04N9/67 , H04N9/76
Abstract: Embodiments relate to color correction circuit operations performed by an image signal processor. The color correction circuit computes optimal color correction matrix on a per-pixel basis and adjusts it based on relative noise standard deviations of the color channels to steer the matrix.
-
45.发明申请CORRECTING PIXEL DEFECTS BASED ON DEFECT HISTORY IN AN IMAGE PROCESSING PIPELINE 审中-公开基于图像处理管道中的缺陷历史校正像素缺陷公开(公告)号：US20170070692A1
公开(公告)日：2017-03-09
申请号：US14845659
申请日：2015-09-04
Applicant: Apple Inc.
Inventor： Sheng Lin , D. Amnon Silverstein , David R. Pope , Suk Hwan Lim
Abstract: An image signal processor may include a pixel defect correction component that tracks defect history for frames captured by an image sensor and applies the history when identifying and correcting defective pixels in a frame. The component maintains a defect pixel location table that includes a defect confidence value for pixels of the image sensor. The component identifies defective pixels in a frame, for example by comparing each pixel's value to the values of its neighbor pixels. If a pixel is detected as defective, its defect confidence value may be incremented. Otherwise, the value may be decremented. If a pixel's defect confidence value is over a defect confidence threshold, the pixel is considered defective and thus may be corrected. If a pixel's defect confidence value is under the threshold, the pixel is considered not defective and thus may not be corrected even if the pixel was detected as defective.
Abstract translation: 图像信号处理器可以包括跟踪由图像传感器捕获的帧的缺陷历史的像素缺陷校正组件，并且在识别和校正帧中的缺陷像素时应用历史。 该组件保持缺陷像素位置表，其包括图像传感器的像素的缺陷置信度值。 组件识别帧中的缺陷像素，例如通过将每个像素的值与其相邻像素的值进行比较。 如果像素被检测为缺陷，则其缺陷置信度值可以增加。 否则，该值可能会减少。 如果像素的缺陷置信度值超过缺陷置信度阈值，则该像素被认为是有缺陷的，因此可被校正。 如果像素的缺陷置信度值低于阈值，则认为像素不是有缺陷的，因此即使像素被检测为有缺陷，也可能不被校正。
-
Patent Agency Ranking
公开(公告)号：US20170061236A1
公开(公告)日：2017-03-02
申请号：US14843919
申请日：2015-09-02
Applicant: APPLE INC.
Inventor： David R. Pope
CPC classification number: G06K9/4671 , G06K9/00973 , G06K9/4652 , G06K9/4661 , G06K2009/4666 , G06T5/00 , G06T5/002 , G06T7/10 , G06T2200/28 , G06T2207/20164 , H04N9/646
Abstract: Methods and systems for detecting keypoints in image data may include an image sensor interface receiving pixel data from an image sensor. A front-end pixel data processing circuit may receive pixel data and convert the pixel data to a different color space format. A back-end pixel data processing circuit may perform one or more operations on the pixel data. An output circuit may receive pixel data and output the pixel data to a system memory. A keypoint detection circuit may receive pixel data from the image sensor interface in the image sensor pixel data format or receive pixel data after processing by the front-end or the back-end pixel data processing circuits. The keypoint detection circuit may perform a keypoint detection operation on the pixel data to detect one or more keypoints in the image frame and output to the system memory a description of the one or more keypoints.
Abstract translation: 用于检测图像数据中的关键点的方法和系统可以包括从图像传感器接收像素数据的图像传感器接口。 前端像素数据处理电路可以接收像素数据并将像素数据转换成不同的颜色空间格式。 后端像素数据处理电路可以对像素数据执行一个或多个操作。 输出电路可以接收像素数据并将像素数据输出到系统存储器。 关键点检测电路可以以图像传感器像素数据格式从图像传感器接口接收像素数据，或者在由前端或后端像素数据处理电路处理之后接收像素数据。 关键点检测电路可以对像素数据执行关键点检测操作，以检测图像帧中的一个或多个关键点，并向系统存储器输出对一个或多个关键点的描述。
-
公开(公告)号：US20160110843A1
公开(公告)日：2016-04-21
申请号：US14977384
申请日：2015-12-21
Applicant: Apple Inc.
Inventor： Christopher L. Mills , Sheng Lin , David R. Pope , D. Amnon Silverstein , Suk Hwan Lim
CPC classification number: H04N9/04511 , G06T3/4015 , H04N5/2628 , H04N9/07 , H04N9/646 , H04N2209/046
Abstract: An input rescale module that performs cross-color correlated downscaling of sensor data in the horizontal and vertical dimensions. The module may perform a first-pass demosaic of sensor data, apply horizontal and vertical scalers to resample and downsize the data in the horizontal and vertical dimensions, and then remosaic the data to provide horizontally and vertically downscaled sensor data as output for additional image processing. The module may, for example, act as a front end scaler for an image signal processor (ISP). The demosaic performed by the module may be a relatively simple demosaic, for example a demosaic function that works on 3×3 blocks of pixels. The front end of module may receive and process sensor data at two pixels per clock (ppc); the horizontal filter component reduces the sensor data down to one ppc for downstream components of the input rescale module and for the ISP pipeline.
Abstract translation: 在水平和垂直维度上执行传感器数据的交叉色相关缩小的输入重定标模块。 模块可以执行传感器数据的第一遍去马赛克，应用水平和垂直缩放器对水平和垂直尺寸的数据进行重新取样和缩小，然后重新绘制数据，以提供水平和垂直缩小的传感器数据作为附加图像处理的输出 。 该模块可以例如用作图像信号处理器（ISP）的前端缩放器。 由模块执行的去镶嵌可以是相对简单的去马赛克，例如在3×3像素块上工作的去马赛克功能。 模块的前端可以以每个时钟两个像素（ppc）接收和处理传感器数据; 水平滤波器组件将传感器数据减少到输入重定标模块的下游组件和ISP管线的一ppc。
-
公开(公告)号：US20240334073A1
公开(公告)日：2024-10-03
申请号：US18127296
申请日：2023-03-28
Applicant: Apple Inc.
Inventor： Muge Wang , David R. Pope , Roberto Montagna
Abstract: An image processing circuit for multi-illumination white balance with thumbnail processing. The image processing circuit determines a set of initial weights for a source pixel in a thumbnail image by determining component values for multiple color channels of the source pixel. The image processing circuit determines a set of weights for the source pixel in a weight map for the thumbnail image. Each weight in the set of weights is determined based on corresponding initial weights from the set of initial weights. Each weight in the set of weights represents an intensity level of a respective chrominance class of multiple chrominance classes for the source pixel. The image processing circuit applies the set of weights to values of the color channels of the source pixel to generate color component values of the color channels of a target pixel in a target thumbnail image.
-
公开(公告)号：US12022213B2
公开(公告)日：2024-06-25
申请号：US17829363
申请日：2022-06-01
Applicant: Apple Inc.
Inventor： Sheng Lin , D. Amnon Silverstein , David R. Pope
CPC classification number: H04N25/46 , G06T5/70 , H04N9/646 , H04N23/67 , H04N23/84 , H04N25/445 , H04N25/68
Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.
-
公开(公告)号：US11968471B2
公开(公告)日：2024-04-23
申请号：US17195520
申请日：2021-03-08
Applicant: Apple Inc.
Inventor： David R. Pope , Liran Fishel , Assaf Metuki , Muge Wang
CPC classification number: H04N5/76 , G06T1/60 , G06T7/251 , H04N1/2141 , G06T2207/20016
Abstract: Embodiments relate to extracting features from images, such as by identifying keypoints and generating keypoint descriptors of the keypoints. An apparatus includes a pyramid image generator circuit, a keypoint descriptor generator circuit, and a pyramid image buffer. The pyramid image generator circuit generates an image pyramid from an input image. The keypoint descriptor generator circuit processes the pyramid images for keypoint descriptor generation. The pyramid image buffer stores different portions of the pyramid images generated by the pyramid image generator circuit at different times and provides the stored portions of the pyramid images to the keypoint descriptor generator circuit for keypoint descriptor generation. When first portions of the pyramid images are no longer needed for the keypoint descriptor generation, the first portions are removed from the pyramid image buffer to provide space for second portions of the pyramid images that are needed for the keypoint descriptor generation.
-
-
-
-
-
-
-
-
-
Search Results
89
records
(took 0.029 seconds)
