公开(公告)号：US09342858B2

公开(公告)日：2016-05-17

申请号：US14023359

申请日：2013-09-10

Applicant: APPLE INC.

Inventor： Guy Cote ,  D. Amnon Silverstein ,  Suk Hwan Lim

IPC: G06K9/00 ,  G06T1/20 ,  H04N17/00

CPC classification number: G06T1/20 ,  H04N17/002

Abstract: Systems and methods are provided for selectively performing image statistics processing based at least partly on whether a pixel has been clipped. In one example, an image signal processor may include statistics collection logic. The statistics collection logic may include statistics image processing logic and a statistics core. The statistics image processing logic may perform initial image processing on image pixels, at least occasionally causing some of the image pixels to become clipped. The statistics core may obtain image statistics from the image pixels. The statistics core may obtain at least one of the image statistics using only pixels that have not been clipped and excluding pixels that have been clipped.

Abstract translation: 系统和方法被提供用于至少部分地基于是否已经剪切像素来选择性地执行图像统计处理。 在一个示例中，图像信号处理器可以包括统计信息收集逻辑。 统计信息采集逻辑可以包括统计图像处理逻辑和统计核心。 统计图像处理逻辑可以对图像像素执行初始图像处理，至少偶尔导致一些图像像素被削波。 统计核心可以从图像像素获取图像统计。 统计核心可以仅使用未被裁剪的像素并且排除已经被裁剪的像素来获得至少一个图像统计信息。

公开(公告)号：US09219870B1

公开(公告)日：2015-12-22

申请号：US14449005

申请日：2014-07-31

Applicant: Apple Inc.

Inventor： Christopher L. Mills ,  Sheng Lin ,  David R. Pope ,  D. Amnon Silverstein ,  Suk Hwan Lim

IPC: H04N5/345 ,  H04N9/64 ,  G06T3/40 ,  H04N9/07

CPC classification number: H04N9/04511 ,  G06T3/4015 ,  H04N5/2628 ,  H04N9/07 ,  H04N9/646 ,  H04N2209/046

Abstract: An input rescale module that performs cross-color correlated downscaling of sensor data in the horizontal and vertical dimensions. The module may perform a first-pass demosaic of sensor data, apply horizontal and vertical scalers to resample and downsize the data in the horizontal and vertical dimensions, and then remosaic the data to provide horizontally and vertically downscaled sensor data as output for additional image processing. The module may, for example, act as a front end scaler for an image signal processor (ISP). The demosaic performed by the module may be a relatively simple demosaic, for example a demosaic function that works on 3×3 blocks of pixels. The front end of module may receive and process sensor data at two pixels per clock (ppc); the horizontal filter component reduces the sensor data down to one ppc for downstream components of the input rescale module and for the ISP pipeline.

Abstract translation: 在水平和垂直维度上执行传感器数据的交叉色相关缩小的输入重定标模块。 模块可以执行传感器数据的第一遍去马赛克，应用水平和垂直缩放器对水平和垂直尺寸的数据进行重新采样和缩小，然后重新绘制数据，以提供水平和垂直缩小的传感器数据作为附加图像处理的输出 。 该模块可以例如用作图像信号处理器（ISP）的前端缩放器。 由模块执行的去镶嵌可以是相对简单的去马赛克，例如在3×3像素块上工作的去马赛克功能。 模块的前端可以以每个时钟两个像素（ppc）接收和处理传感器数据; 水平滤波器组件将传感器数据减少到输入重定标模块的下游组件和ISP管线的一ppc。

公开(公告)号：US20150181186A1

公开(公告)日：2015-06-25

申请号：US14623332

申请日：2015-02-16

Applicant: Apple Inc.

Inventor： Suk Hwan Lim ,  D. Amnon Silverstein

IPC: H04N9/64

CPC classification number: H04N9/646 ,  G06T5/008 ,  G06T5/40 ,  G06T2207/10016 ,  G06T2207/20012 ,  G06T2207/20016 ,  G06T2207/20021 ,  G06T2207/20208

Abstract: Image tone adjustment using local tone curve computation may be utilized to adjust luminance ranges for images. Image tone adjustment using local tone curve computation may reduce the overall contrast of an image, while maintaining local contrast in smaller areas, such as in images capturing brightly lit scenes where the difference in intensity between brightest and darkest areas is large. A desired brightness representation of the image may be generated including target luminance values for corresponding blocks of the image. For each block, one or more tone adjustment values may be computed, that when jointly applied to the respective histograms for the block and neighboring blocks results in the luminance values that match corresponding target values. The tone adjustment values may be determined by solving an under-constrained optimization problem such that optimization constraints are minimized. The image may then be adjusted according to the computed tone adjustment values.

Abstract translation: 可以使用局部色调曲线计算的图像色调调整来调整图像的亮度范围。 使用局部色调曲线计算的图像色调调整可以降低图像的整体对比度，同时保持较小区域中的局部对比度，诸如在最亮和最暗区域之间强度差异较大的明亮场景的图像中。 可以产生图像的期望的亮度表示，包括图像的相应块的目标亮度值。 对于每个块，可以计算一个或多个色调调整值，当共同应用于块和相邻块的各个直方图时，会导致与相应目标值匹配的亮度值。 音调调整值可以通过求解不受约束的优化问题来确定，使得优化约束被最小化。 然后可以根据所计算的音调调整值来调整图像。

公开(公告)号：US20150139603A1

公开(公告)日：2015-05-21

申请号：US14082390

申请日：2013-11-18

Applicant: Apple Inc.

Inventor： D. Amnon Silverstein ,  Shun Wai Go ,  Suk Hwan Lim ,  Timothy J. Millet ,  Ting Chen ,  Bin Ni

IPC: H04N5/232 ,  H04N9/87

CPC classification number: H04N5/23245 ,  H04N1/212 ,  H04N5/23216 ,  H04N5/23232 ,  H04N5/23293 ,  H04N7/0122 ,  H04N9/87

Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.

Abstract translation: 在一个实施例中，电子设备可以被配置为在视频捕获期间捕获静止帧，但是可以以比4×3宽高比和高于16×9宽高比视频帧的分辨率捕获静止帧。 该装置可以在视频序列中交错高分辨率，4×3帧和较低分辨率的16×9帧，并且当用户指示拍摄静止帧时可以捕获最近的较高分辨率，4×3帧。 或者，设备可以在视频序列中显示16×9帧，然后当按下快门按钮时，扩展为4×3帧。 该装置可以捕获静止帧并响应于快门按钮的释放而返回到16×9视频帧。

公开(公告)号：US20150071537A1

公开(公告)日：2015-03-12

申请号：US14023159

申请日：2013-09-10

Applicant: Apple Inc.

Inventor： Suk Hwan Lim ,  D. Amnon Silverstein

IPC: G06T5/40

CPC classification number: H04N9/646 ,  G06T5/008 ,  G06T5/40 ,  G06T2207/10016 ,  G06T2207/20012 ,  G06T2207/20016 ,  G06T2207/20021 ,  G06T2207/20208

Abstract: Image tone adjustment using local tone curve computation may be utilized to adjust luminance ranges for images. Image tone adjustment using local tone curve computation may reduce the overall contrast of an image, while maintaining local contrast in smaller areas, such as in images capturing brightly lit scenes where the difference in intensity between brightest and darkest areas is large. A desired brightness representation of the image may be generated including target luminance values for corresponding blocks of the image. For each block, one or more tone adjustment values may be computed, that when jointly applied to the respective histograms for the block and neighboring blocks results in the luminance values that match corresponding target values. The tone adjustment values may be determined by solving an under-constrained optimization problem such that optimization constraints are minimized. The image may then be adjusted according to the computed tone adjustment values.