-
公开(公告)号：US10657623B2
公开(公告)日：2020-05-19
申请号：US16100823
申请日：2018-08-10
Applicant: Apple Inc.
Inventor： Maxim Smirnov , David R. Pope , Oren Kerem , Elena Lamburn
Abstract: Embodiments relate to two stage multi-scale processing of an image. A first stage processing circuitry generates an unscaled single color version of the image that undergoes noise reduction before generating a high frequency component of the unscaled single color version. A scaler generates a first downscaled version of the image comprising a plurality of color components. A second stage processing circuitry generates a plurality of sequentially downscaled images based on the first downscaled version. The second stage processing circuitry processes the first downscaled version and the downscaled images to generate a processed version of the first downscaled version. The unscaled single color high frequency component and the processed version of the first downscaled version of the image are merged to generate a processed version of the image.
-
公开(公告)号：US09911174B2
公开(公告)日：2018-03-06
申请号：US14836915
申请日：2015-08-26
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , Christopher L. Mills , D. Amnon Silverstein , David R. Pope , Sheng Lin
CPC classification number: G06T1/20 , G06T1/60 , G06T3/4015 , H04N5/23229 , H04N5/3765 , H04N5/917 , H04N9/045
Abstract: An image processing pipeline may process image data at multiple rates. A stream of raw pixel data collected from an image sensor for an image frame may be processed through one or more pipeline stages of an image signal processor. The stream of raw pixel data may then be converted into a full-color domain and scaled to a data size that is less than an initial data size for the image frame. The converted pixel data may be processed through one or more other pipelines stages and output for storage, further processing, or display. In some embodiments, a back-end interface may be implemented as part of the image signal processor via which image data collected from sources other than the image sensor may be received and processed through various pipeline stages at the image signal processor.
-
公开(公告)号：US09811892B1
公开(公告)日：2017-11-07
申请号：US15198414
申请日：2016-06-30
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , David R. Pope , Simon W. Butler , Maxim W. Smirnov
CPC classification number: G06T5/40 , G06T3/4007 , G06T3/4023 , G06T5/003 , G06T5/20 , G06T5/50 , G06T2207/10024 , G06T2207/20016 , G06T2207/20221
Abstract: Embodiments of the present disclosure generally relate to image signal processing logic, and in particular, to separating an undecimated image signal data to create two components with lower resolution and full-resolution, generating an interpolation guidance information based on the two components created by separation, forming a difference image data representing the difference between the chroma and luma values of each pixel and its neighboring pixels, and merging the processed image data from the processing pipelines with the unprocessed image data using the interpolation guidance information generated. The generation of the interpolation guidance information is based on determining distances between pixel values from a group comprising pixels from interpolation nodes, pixels diagonally located adjacent to the interpolation nodes, pixels horizontally adjacent to the interpolation nodes, and pixels vertically adjacent to the interpolation nodes.
-
公开(公告)号：US09747514B2
公开(公告)日：2017-08-29
申请号：US14841406
申请日：2015-08-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , David R. Pope
CPC classification number: G06K9/4661 , G06K9/4652 , G06T3/40 , G06T5/00 , G06T5/002 , G06T5/003 , G06T5/20
Abstract: An image processing pipeline may perform noise filtering and image sharpening utilizing common spatial support. A noise filter may perform a spatial noise filtering technique to determine a filtered value of a given pixel based on spatial support obtained from line buffers. Sharpening may also be performed to generate a sharpened value of the given pixel based on spatial support obtained from the same line buffers. A filtered and sharpened version of the pixel may be generated by combining the filtered value of the given pixel with the sharpened value of the given pixel. In at least some embodiments, the noise filter performs spatial noise filtering and image sharpening on a luminance value of the given pixel, when the given pixel is received in a luminance-chrominance encoding.
-
Patent Agency Ranking
公开(公告)号：US20170064232A1
公开(公告)日：2017-03-02
申请号：US14836918
申请日：2015-08-26
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , David R. Pope , Touraj Tajbakhsh
CPC classification number: H04N5/3675 , G06T5/20 , H04N5/23212 , H04N5/357 , H04N5/3572 , H04N9/045
Abstract: An image processing pipeline may account for clipped pixels in auto focus statistics. Generating auto focus statistics may include evaluating a neighborhood of pixels with respect to a given pixel in a stream of pixels for an image. If a clipped pixel is identified within the neighborhood of pixels then the evaluation of the given pixel may be excluded from an auto focus statistic. The image processing pipeline may also provide auto focus statistics that do not exclude clipped pixels. A luminance edge detection value may, in some embodiments, be generated by applying an IIR filter to the given pixel in a stream of pixels to band-pass filter the given pixel before including the band-pass filtered pixel in the generation of the luminance edge detection value.
Abstract translation: 图像处理流水线可以解释自动对焦统计中的剪切像素。 产生自动对焦统计可以包括评估相对于图像的像素流中的给定像素的像素的邻域。 如果在像素附近识别出剪切像素，则可以从自动聚焦统计信息中排除给定像素的评估。 图像处理流水线还可以提供不排除剪切像素的自动对焦统计。 在一些实施例中，亮度边缘检测值可以通过将IIR滤波器应用于像素流中的给定像素，以便在产生亮度边缘之前包括带通滤波像素之前对给定像素进行带通滤波来生成 检测值。
-
公开(公告)号：US20170061567A1
公开(公告)日：2017-03-02
申请号：US14836915
申请日：2015-08-26
Applicant: APPLE INC.
Inventor： Suk Hwan Lim , Christopher L. Mills , D. Amnon Silverstein , David R. Pope , Sheng Lin
CPC classification number: G06T1/20 , G06T1/60 , G06T3/4015 , H04N5/23229 , H04N5/3765 , H04N5/917 , H04N9/045
Abstract: An image processing pipeline may process image data at multiple rates. A stream of raw pixel data collected from an image sensor for an image frame may be processed through one or more pipeline stages of an image signal processor. The stream of raw pixel data may then be converted into a full-color domain and scaled to a data size that is less than an initial data size for the image frame. The converted pixel data may be processed through one or more other pipelines stages and output for storage, further processing, or display. In some embodiments, a back-end interface may be implemented as part of the image signal processor via which image data collected from sources other than the image sensor may be received and processed through various pipeline stages at the image signal processor.
Abstract translation: 图像处理流水线可以以多个速率处理图像数据。 从图像帧的图像传感器收集的原始像素数据流可以通过图像信号处理器的一个或多个流水线级进行处理。 然后可以将原始像素数据流转换为全色域并缩放为小于图像帧的初始数据大小的数据大小。 转换的像素数据可以通过一个或多个其他管道级进行处理，并输出用于存储，进一步处理或显示。 在一些实施例中，后端接口可以被实现为图像信号处理器的一部分，通过该图像信号处理器从除图像传感器之外的源收集的图像数据可以通过图像信号处理器处的各种流水线级被接收和处理。
-
公开(公告)号：US09462189B2
公开(公告)日：2016-10-04
申请号：US14449024
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Christopher L. Mills , David R. Pope , D. Amnon Silverstein
CPC classification number: H04N5/2329 , G06T3/00 , H04N5/23254 , H04N5/23258 , H04N5/23267
Abstract: An image signal processor of a device, apparatus, or computing system that includes a camera capable of capturing image data may apply piecewise perspective transformations to image data received from the camera's image sensor. A scaling unit of an Image Signal Processor (ISP) may perform piecewise perspective transformations on a captured image to correct for rolling shutter artifacts and to provide video image stabilization. Image data may be divided into a series of horizontal slices and perspective transformations may be applied to each slice. The transformations may be based on motion data determined in any of various manners, such as by using gyroscopic data and/or optical-flow calculations. The piecewise perspective transforms may be encoded as Digital Difference Analyzer (DDA) steppers and may be implemented using separable scalar operations. The image signal processor may not write the received image data to system memory until after the transformations have been performed.
Abstract translation: 包括能够拍摄图像数据的相机的设备，装置或计算系统的图像信号处理器可以对从相机的图像传感器接收的图像数据应用分段透视变换。 图像信号处理器（ISP）的缩放单元可以对捕获的图像执行分段透视变换，以校正滚动快门伪影并提供视频图像稳定。 图像数据可以被划分为一系列水平切片，并且透视变换可以应用于每个切片。 变换可以基于以各种方式中的任何一种确定的运动数据，例如通过使用陀螺仪数据和/或光流计算。 分段透视变换可以被编码为数字差分分析器（DDA）步进器，并且可以使用可分离的标量运算来实现。 图像信号处理器可能不会将接收的图像数据写入系统存储器直到转换完成。
-
公开(公告)号：US20160105621A1
公开(公告)日：2016-04-14
申请号：US14882361
申请日：2015-10-13
Applicant: Apple Inc.
Inventor： Andrew Kenneth John McMahon , D. Amnon Sliverstein , David R. Pope , Suk Hwan Lim
Abstract: A pedestal level for an image sensor can be dynamically adjusted based on one or more parameters. The parameters include one or more operating conditions associated with the image sensor, pre-determined image sensor characterization data, the number of unused digital codes, and/or the number of clipped pixel signals. The operating conditions can include the temperature of the image sensor, the gain of at least one amplifier included in processing circuitry operably connected to at least one pixel, and/or the length of the integration period for at least one pixel in the image sensor. Based on the one or more of the parameters, the pedestal level is adjusted to reduce a number of unused digital codes in a distribution of dark current. Additionally or alternatively, the variance of the pixel signals can be reduced to permit the use of a lower pedestal level.
Abstract translation: 可以基于一个或多个参数来动态调整用于图像传感器的基座水平。 这些参数包括与图像传感器相关联的一个或多个操作条件，预定图像传感器表征数据，未使用的数字代码的数量和/或限幅像素信号的数量。 操作条件可以包括图像传感器的温度，包括在可操作地连接到至少一个像素的处理电路中的至少一个放大器的增益和/或图像传感器中的至少一个像素的积分周期的长度。 基于一个或多个参数，调节基座电平以减少暗电流分布中未使用的数字代码的数量。 附加地或替代地，可以减小像素信号的方差以允许使用较低的基座电平。
-
公开(公告)号：US20160037073A1
公开(公告)日：2016-02-04
申请号：US14449024
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Christopher L. Mills , David R. Pope , D. Amnon Silverstein
IPC: H04N5/232
CPC classification number: H04N5/2329 , G06T3/00 , H04N5/23254 , H04N5/23258 , H04N5/23267
Abstract: An image signal processor of a device, apparatus, or computing system that includes a camera capable of capturing image data may apply piecewise perspective transformations to image data received from the camera's image sensor. A scaling unit of an Image Signal Processor (ISP) may perform piecewise perspective transformations on a captured image to correct for rolling shutter artifacts and to provide video image stabilization. Image data may be divided into a series of horizontal slices and perspective transformations may be applied to each slice. The transformations may be based on motion data determined in any of various manners, such as by using gyroscopic data and/or optical-flow calculations. The piecewise perspective transforms may be encoded as Digital Difference Analyzer (DDA) steppers and may be implemented using separable scalar operations. The image signal processor may not write the received image data to system memory until after the transformations have been performed.
Abstract translation: 包括能够拍摄图像数据的相机的设备，装置或计算系统的图像信号处理器可以对从相机的图像传感器接收的图像数据应用分段透视变换。 图像信号处理器（ISP）的缩放单元可以对捕获的图像执行分段透视变换，以校正滚动快门伪影并提供视频图像稳定。 图像数据可以被划分为一系列水平切片，并且透视变换可以应用于每个切片。 变换可以基于以各种方式中的任何一种确定的运动数据，例如通过使用陀螺仪数据和/或光流计算。 分段透视变换可以被编码为数字差分分析器（DDA）步进器，并且可以使用可分离的标量运算来实现。 图像信号处理器可能不会将接收的图像数据写入系统存储器直到转换完成。
-
-
-
-
-
-
-
-
Search Results
89
records
(took 0.023 seconds)
