-
公开(公告)号：US20170070689A1
公开(公告)日：2017-03-09
申请号：US14848276
申请日：2015-09-08
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Sheng Lin , David R. Pope , Suk Hwan Lim
CPC classification number: H04N5/3572 , G06T5/008 , H01L27/14623 , H01L27/14643 , H04N5/3651 , H04N5/3696 , H04N9/646
Abstract: Systems and methods for automatic lens flare compensation may include a non-uniformity detector configured to operate on pixel data for an image in an image sensor color pattern. The non-uniformity detector may detect a non-uniformity in the pixel data in a color channel of the image sensor color pattern. The non-uniformity detector may generate output including location and magnitude values of the non-uniformity. A lens flare detector may determine, based at least on the location and magnitude values, whether the output of the non-uniformity detector corresponds to a lens flare in the image. In some embodiments, the lens flare detector may generate, in response to determining that the output corresponds to the lens flare, a representative map of the lens flare. A lens flare corrector may determine one or more pixel data correction values corresponding to the lens flare and apply the pixel data correction values to the pixel data.
Abstract translation: 用于自动镜头光斑补偿的系统和方法可以包括被配置为对图像传感器颜色图案中的图像的像素数据进行操作的非均匀性检测器。 不均匀性检测器可以检测图像传感器颜色图案的颜色通道中的像素数据的不均匀性。 不均匀性检测器可以产生包括不均匀性的位置和幅度值的输出。 透镜闪光检测器可以至少基于位置和幅度值来确定不均匀性检测器的输出是否对应于图像中的透镜闪光。 在一些实施例中，透镜光斑检测器可以响应于确定输出对应于透镜闪光而产生透镜的代表性地图闪光。 透镜闪光校正器可以确定与透镜光斑相对应的一个或多个像素数据校正值，并将像素数据校正值应用于像素数据。
-
公开(公告)号：US09591219B2
公开(公告)日：2017-03-07
申请号：US15089784
申请日：2016-04-04
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Shun Wai Go , Suk Hwan Lim , Timothy J. Millet , Ting Chen , Bin Ni
CPC classification number: H04N5/23245 , H04N1/212 , H04N5/23216 , H04N5/23232 , H04N5/23293 , H04N7/0122 , H04N9/87
Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.
Abstract translation: 在一个实施例中，电子设备可以被配置为在视频捕获期间捕获静止帧，但是可以以比4×3宽高比和高于16×9宽高比视频帧的分辨率捕获静止帧。 该装置可以在视频序列中交错高分辨率，4×3帧和较低分辨率的16×9帧，并且当用户指示拍摄静止帧时可以捕获最近的较高分辨率，4×3帧。 或者，设备可以在视频序列中显示16×9帧，然后当按下快门按钮时，扩展为4×3帧。 该装置可以捕获静止帧并响应于快门按钮的释放而返回到16×9视频帧。
-
公开(公告)号：US20170064227A1
公开(公告)日：2017-03-02
申请号：US14841345
申请日：2015-08-31
Applicant: Apple Inc.
Inventor： Sheng Lin , Suk Hwan Lim
Abstract: An image signal processor may include a sensor interface that includes a pixel defect preprocessing (PDP) component that performs an initial adjustment of pixel values for patterned defect pixels in raw pixel data captured by an image sensor. To adjust a patterned defect pixel, the PDP component may apply an interpolation technique to values in a gain lookup table according to the pixel's location in the image frame to determine the gain value for the pixel, and then apply the gain value to the pixel. The PDP component may provide the raw pixel data with the adjusted patterned defect pixels to two or more other modules for additional processing. The other modules may include an image processing pipeline that may detect other defective pixels in the raw pixel data and correct the patterned defect pixels and the other defective pixels, for example using a weighted combination of neighboring pixels.
Abstract translation: 图像信号处理器可以包括传感器接口，该传感器接口包括对由图像传感器捕获的原始像素数据中的图案化缺陷像素执行像素值的初始调整的像素缺陷预处理（PDP）组件。 为了调整图案化的缺陷像素，PDP部件可以根据图像帧中的像素的位置对增益查找表中的值应用内插技术，以确定像素的增益值，然后将该增益值应用于像素。 PDP组件可以将经调整的图案化缺陷像素的原始像素数据提供给两个或更多个其他模块用于附加处理。 其他模块可以包括图像处理流水线，其可以检测原始像素数据中的其他缺陷像素，并且例如使用相邻像素的加权组合来校正图案化的缺陷像素和其它缺陷像素。
-
公开(公告)号：US20170061582A1
公开(公告)日：2017-03-02
申请号：US14841412
申请日：2015-08-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , Sheng Lin
CPC classification number: G06K9/6201 , G06T5/002 , G06T2207/20182
Abstract: An image processing pipeline may perform temporal filtering on independent color channels in image data. A filter weight may be determined for a given pixel received at a temporal filter. The filter weight may be determined for blending a value of a channel in a full color encoding of the given pixel with a value of the same channel for a corresponding pixel in a previously filtered reference image frame. In some embodiments, the filtering strength for the channel may be determined independent from the filtering strength of another channel in the full color encoding of the given pixel. Spatial filtering may be applied to a filtered version of the given pixel prior to storing the given pixel as part of a new reference image frame.
Abstract translation: 图像处理流水线可以对图像数据中的独立颜色通道执行时间滤波。 可以针对在时间滤波器处接收到的给定像素来确定滤波器权重。 可以确定滤波器权重用于将给定像素的全色编码中的信道的值与先前滤波的参考图像帧中的对应像素的相同信道的值混合。 在一些实施例中，可以独立于给定像素的全色编码中的另一通道的滤波强度来确定信道的滤波强度。 在将给定像素作为新参考图像帧的一部分存储之前，空间滤波可以应用于给定像素的滤波版本。
-
公开(公告)号：US20170061234A1
公开(公告)日：2017-03-02
申请号：US14841406
申请日：2015-08-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , David R. Pope
CPC classification number: G06K9/4661 , G06K9/4652 , G06T3/40 , G06T5/00 , G06T5/002 , G06T5/003 , G06T5/20
Abstract: An image processing pipeline may perform noise filtering and image sharpening utilizing common spatial support. A noise filter may perform a spatial noise filtering technique to determine a filtered value of a given pixel based on spatial support obtained from line buffers. Sharpening may also be performed to generate a sharpened value of the given pixel based on spatial support obtained from the same line buffers. A filtered and sharpened version of the pixel may be generated by combining the filtered value of the given pixel with the sharpened value of the given pixel. In at least some embodiments, the noise filter performs spatial noise filtering and image sharpening on a luminance value of the given pixel, when the given pixel is received in a luminance-chrominance encoding.
Abstract translation: 图像处理流水线可以利用共同的空间支持来执行噪声滤波和图像锐化。 噪声滤波器可以执行空间噪声滤波技术，以基于从线缓冲器获得的空间支持来确定给定像素的滤波值。 还可以执行锐化以基于从相同的行缓冲器获得的空间支持来产生给定像素的锐化值。 可以通过将给定像素的滤波值与给定像素的锐化值组合来生成像素的滤波和锐化版本。 在至少一些实施例中，当在亮度 - 色度编码中接收给定像素时，噪声滤波器对给定像素的亮度值执行空间噪声滤波和图像锐化。
-
Patent Agency Ranking
公开(公告)号：US09479695B2
公开(公告)日：2016-10-25
申请号：US14449015
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein
CPC classification number: H04N5/23229 , G06T5/009 , G06T5/10 , G06T5/50 , G06T2207/10016 , G06T2207/10144 , G06T2207/20024 , G06T2207/20182 , G06T2207/20208 , G06T2207/20221 , H04N5/217 , H04N5/2355
Abstract: A temporal filter in an image processing pipeline may be configured to generate a high dynamic range (HDR) image. Image frames captured to generate an HDR image frame be blended together at a temporal filter. An image frame that is part of a group of image frames capture to generate the HDR image may be received for filtering at the temporal filter module. A reference image frame, which may be a previously filtered image frame or an unfiltered image frame may be obtained. A filtered version of the image frame may then be generated according to an HDR blending scheme that blends the reference image frame with the image frame. If the image frame is the last image frame of the group of image frames to be filtered, then the filtered version of the image frame may be provided as the HDR image frame.
Abstract translation: 图像处理流水线中的时间滤波器可以被配置为生成高动态范围（HDR）图像。 拍摄以生成HDR图像帧的图像帧在时间滤波器中混合在一起。 作为拍摄以生成HDR图像的一组图像帧的一部分的图像帧可以被接收以用于在时间滤波器模块处进行滤波。 可以获得可以是先前滤波的图像帧或未滤波图像帧的参考图像帧。 然后可以根据将参考图像帧与图像帧混合的HDR混合方案来生成图像帧的滤波版本。 如果图像帧是要滤波的图像帧组的最后一个图像帧，则图像帧的滤波版本可以被提供为HDR图像帧。
-
公开(公告)号：US09374526B2
公开(公告)日：2016-06-21
申请号：US14449010
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Suk Hwan Lim
CPC classification number: H04N5/23229 , G06T1/20 , G06T5/002 , G06T5/10 , G06T5/50 , G06T2207/20024 , G06T2207/20182 , H04N5/21
Abstract: A temporal filter in an image processing pipeline may insert a frame delay when filtering an image frame. A given pixel of a current image frame may be received and a filtered version of the given pixel may be generated, blending the given pixel and a corresponding pixel of a reference image frame to store as part of a filtered version of the current image frame. If a frame delay setting is enabled, the corresponding pixel of the reference image frame may be provided as output for subsequent image processing inserting a frame delay for the current image frame. During the frame delay programming instructions may be received and image processing pipeline components may be configured according to the programming instructions. If the frame delay setting is disabled, then the filtered version of the given pixel may be provided as output for subsequent image processing.
Abstract translation: 图像处理流水线中的时间滤波器可以在对图像帧进行滤波时插入帧延迟。 可以接收当前图像帧的给定像素，并且可以生成给定像素的滤波版本，将给定像素和参考图像帧的对应像素混合以存储为当前图像帧的滤波版本的一部分。 如果启用了帧延迟设置，则可以将参考图像帧的相应像素提供为用于随后的图像处理的输出，为当前图像帧插入帧延迟。 在帧延迟期间，可以接收编程指令，并且可以根据编程指令来配置图像处理流水线部件。 如果帧延迟设置被禁用，则可以提供给定像素的滤波版本作为后续图像处理的输出。
-
58.发明授权公开(公告)号：US09342858B2
公开(公告)日：2016-05-17
申请号：US14023359
申请日：2013-09-10
Applicant: APPLE INC.
Inventor： Guy Cote , D. Amnon Silverstein , Suk Hwan Lim
CPC classification number: G06T1/20 , H04N17/002
Abstract: Systems and methods are provided for selectively performing image statistics processing based at least partly on whether a pixel has been clipped. In one example, an image signal processor may include statistics collection logic. The statistics collection logic may include statistics image processing logic and a statistics core. The statistics image processing logic may perform initial image processing on image pixels, at least occasionally causing some of the image pixels to become clipped. The statistics core may obtain image statistics from the image pixels. The statistics core may obtain at least one of the image statistics using only pixels that have not been clipped and excluding pixels that have been clipped.
Abstract translation: 系统和方法被提供用于至少部分地基于是否已经剪切像素来选择性地执行图像统计处理。 在一个示例中，图像信号处理器可以包括统计信息收集逻辑。 统计信息采集逻辑可以包括统计图像处理逻辑和统计核心。 统计图像处理逻辑可以对图像像素执行初始图像处理，至少偶尔导致一些图像像素被削波。 统计核心可以从图像像素获取图像统计。 统计核心可以仅使用未被裁剪的像素并且排除已经被裁剪的像素来获得至少一个图像统计信息。
-
公开(公告)号：US09219870B1
公开(公告)日：2015-12-22
申请号：US14449005
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Christopher L. Mills , Sheng Lin , David R. Pope , D. Amnon Silverstein , Suk Hwan Lim
CPC classification number: H04N9/04511 , G06T3/4015 , H04N5/2628 , H04N9/07 , H04N9/646 , H04N2209/046
Abstract: An input rescale module that performs cross-color correlated downscaling of sensor data in the horizontal and vertical dimensions. The module may perform a first-pass demosaic of sensor data, apply horizontal and vertical scalers to resample and downsize the data in the horizontal and vertical dimensions, and then remosaic the data to provide horizontally and vertically downscaled sensor data as output for additional image processing. The module may, for example, act as a front end scaler for an image signal processor (ISP). The demosaic performed by the module may be a relatively simple demosaic, for example a demosaic function that works on 3×3 blocks of pixels. The front end of module may receive and process sensor data at two pixels per clock (ppc); the horizontal filter component reduces the sensor data down to one ppc for downstream components of the input rescale module and for the ISP pipeline.
Abstract translation: 在水平和垂直维度上执行传感器数据的交叉色相关缩小的输入重定标模块。 模块可以执行传感器数据的第一遍去马赛克，应用水平和垂直缩放器对水平和垂直尺寸的数据进行重新采样和缩小，然后重新绘制数据，以提供水平和垂直缩小的传感器数据作为附加图像处理的输出 。 该模块可以例如用作图像信号处理器（ISP）的前端缩放器。 由模块执行的去镶嵌可以是相对简单的去马赛克，例如在3×3像素块上工作的去马赛克功能。 模块的前端可以以每个时钟两个像素（ppc）接收和处理传感器数据; 水平滤波器组件将传感器数据减少到输入重定标模块的下游组件和ISP管线的一ppc。
-
公开(公告)号：US20150181186A1
公开(公告)日：2015-06-25
申请号：US14623332
申请日：2015-02-16
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein
IPC: H04N9/64
CPC classification number: H04N9/646 , G06T5/008 , G06T5/40 , G06T2207/10016 , G06T2207/20012 , G06T2207/20016 , G06T2207/20021 , G06T2207/20208
Abstract: Image tone adjustment using local tone curve computation may be utilized to adjust luminance ranges for images. Image tone adjustment using local tone curve computation may reduce the overall contrast of an image, while maintaining local contrast in smaller areas, such as in images capturing brightly lit scenes where the difference in intensity between brightest and darkest areas is large. A desired brightness representation of the image may be generated including target luminance values for corresponding blocks of the image. For each block, one or more tone adjustment values may be computed, that when jointly applied to the respective histograms for the block and neighboring blocks results in the luminance values that match corresponding target values. The tone adjustment values may be determined by solving an under-constrained optimization problem such that optimization constraints are minimized. The image may then be adjusted according to the computed tone adjustment values.
Abstract translation: 可以使用局部色调曲线计算的图像色调调整来调整图像的亮度范围。 使用局部色调曲线计算的图像色调调整可以降低图像的整体对比度，同时保持较小区域中的局部对比度，诸如在最亮和最暗区域之间强度差异较大的明亮场景的图像中。 可以产生图像的期望的亮度表示，包括图像的相应块的目标亮度值。 对于每个块，可以计算一个或多个色调调整值，当共同应用于块和相邻块的各个直方图时，会导致与相应目标值匹配的亮度值。 音调调整值可以通过求解不受约束的优化问题来确定，使得优化约束被最小化。 然后可以根据所计算的音调调整值来调整图像。
-
-
-
-
-
-
-
-
-
Search Results
81
records
(took 0.04 seconds)
