-
公开(公告)号：US20180007334A1
公开(公告)日：2018-01-04
申请号：US15198907
申请日：2016-06-30
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , David R. Pope
CPC classification number: H04N9/646 , G06T1/20 , G06T3/4015 , G06T5/009 , G06T5/40 , G06T2207/10024 , G06T2207/20072 , H04N5/2628
Abstract: Embodiments relate to an architecture of a vision pipe included in an image signal processor. The architecture includes a front-end portion that includes a pair of image signal pipelines that generate an updated luminance image data. A back-end portion of the vision pipe architecture receives the updated luminance images from the front-end portion and performs, in parallel, scaling and various computer vision operations on the updated luminance image data. The back-end portion may repeatedly perform this parallel operation of computer vision operations on successively scaled luminance images to generate a pyramid image.
-
公开(公告)号：US20180007333A1
公开(公告)日：2018-01-04
申请号：US15198552
申请日：2016-06-30
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , David R. Pope
CPC classification number: H04N9/646 , G06T1/20 , G06T3/4007 , G06T3/4015 , H04N9/04 , H04N9/045 , H04N9/67 , H04N9/76
Abstract: Embodiments relate to color correction circuit operations performed by an image signal processor. The color correction circuit computes optimal color correction matrix on a per-pixel basis and adjusts it based on relative noise standard deviations of the color channels to steer the matrix.
-
公开(公告)号：US09686470B2
公开(公告)日：2017-06-20
申请号：US14502128
申请日：2014-09-30
Applicant: Apple Inc.
Inventor： Anita Nariani-Schulze , Benjamin M. Olson , Ralph Brunner , Suk Hwan Lim , Frank Doepke
CPC classification number: H04N5/23254 , G06T7/215 , G06T2207/20016 , G06T2207/20076 , G06T2207/20104
Abstract: Techniques to detect subject and camera motion in a set of consecutively captured image frames are disclosed. More particularly, techniques disclosed herein temporally track two sets of downscaled images to detect motion. One set may contain higher resolution and the other set lower resolution of the same images. For each set, a coefficient of variation may be computed across the set of images for each sample in the downscaled image to detect motion and generate a change mask. The information in the change mask can be used for various applications, including determining how to capture a next image in the sequence.
-
公开(公告)号：US09648261B2
公开(公告)日：2017-05-09
申请号：US14836918
申请日：2015-08-26
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , David R. Pope , Touraj Tajbakhsh
CPC classification number: H04N5/3675 , G06T5/20 , H04N5/23212 , H04N5/357 , H04N5/3572 , H04N9/045
Abstract: An image processing pipeline may account for clipped pixels in auto focus statistics. Generating auto focus statistics may include evaluating a neighborhood of pixels with respect to a given pixel in a stream of pixels for an image. If a clipped pixel is identified within the neighborhood of pixels then the evaluation of the given pixel may be excluded from an auto focus statistic. The image processing pipeline may also provide auto focus statistics that do not exclude clipped pixels. A luminance edge detection value may, in some embodiments, be generated by applying an IIR filter to the given pixel in a stream of pixels to band-pass filter the given pixel before including the band-pass filtered pixel in the generation of the luminance edge detection value.
-
公开(公告)号：US20160219220A1
公开(公告)日：2016-07-28
申请号：US15089784
申请日：2016-04-04
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Shun Wai Go , Suk Hwan Lim , Timothy J. Millet , Ting Chen , Bin Ni
CPC classification number: H04N5/23245 , H04N1/212 , H04N5/23216 , H04N5/23232 , H04N5/23293 , H04N7/0122 , H04N9/87
Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.
-
Patent Agency Ranking
公开(公告)号：US20160037061A1
公开(公告)日：2016-02-04
申请号：US14449016
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , Sheng Lin
CPC classification number: H04N5/23229 , G06T5/002 , G06T5/10 , G06T7/20 , G06T2207/20182 , G06T2207/20201 , H04N5/23254 , H04N5/23267 , H04N9/045
Abstract: A temporal filter may perform dynamic motion estimation and compensation for filtering an image frame. A row of pixels in an image frame received for processing at the temporal filter may be received. A motion estimate may be dynamically determined that registers a previously filtered reference image frame with respect to the row of pixels in the image frame. The reference image frame may be aligned according to the determined motion estimate, and pixels in the row of the image frame may be blended with corresponding pixels in the aligned reference image frame to generate a filtered version of the image frame. Motion statistics may be collected for subsequent processing based on the motion estimation and alignment for the row of pixels in the image frame.
Abstract translation: 时间滤波器可以执行用于过滤图像帧的动态运动估计和补偿。 可以接收用于在时间滤波器处理的图像帧中的像素行。 可以动态地确定运动估计，其相对于图像帧中的像素行注册先前滤波的参考图像帧。 可以根据确定的运动估计来对准参考图像帧，并且可以将图像帧的行中的像素与对准的参考图像帧中的对应像素混合以生成图像帧的滤波版本。 可以基于图像帧中的像素行的运动估计和对准来收集运动统计信息用于后续处理。
-
公开(公告)号：US20160037060A1
公开(公告)日：2016-02-04
申请号：US14449015
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein
CPC classification number: H04N5/23229 , G06T5/009 , G06T5/10 , G06T5/50 , G06T2207/10016 , G06T2207/10144 , G06T2207/20024 , G06T2207/20182 , G06T2207/20208 , G06T2207/20221 , H04N5/217 , H04N5/2355
Abstract: A temporal filter in an image processing pipeline may be configured to generate a high dynamic range (HDR) image. Image frames captured to generate an HDR image frame be blended together at a temporal filter. An image frame that is part of a group of image frames capture to generate the HDR image may be received for filtering at the temporal filter module. A reference image frame, which may be a previously filtered image frame or an unfiltered image frame may be obtained. A filtered version of the image frame may then be generated according to an HDR blending scheme that blends the reference image frame with the image frame. If the image frame is the last image frame of the group of image frames to be filtered, then the filtered version of the image frame may be provided as the HDR image frame.
Abstract translation: 图像处理流水线中的时间滤波器可以被配置为生成高动态范围（HDR）图像。 拍摄以生成HDR图像帧的图像帧在时间滤波器中混合在一起。 作为拍摄以生成HDR图像的一组图像帧的一部分的图像帧可以被接收以用于在时间滤波器模块处进行滤波。 可以获得可以是先前滤波的图像帧或未滤波图像帧的参考图像帧。 然后可以根据将参考图像帧与图像帧混合的HDR混合方案来生成图像帧的滤波版本。 如果图像帧是要滤波的图像帧组的最后一个图像帧，则图像帧的滤波版本可以被提供为HDR图像帧。
-
公开(公告)号：US08958658B1
公开(公告)日：2015-02-17
申请号：US14023159
申请日：2013-09-10
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein
CPC classification number: H04N9/646 , G06T5/008 , G06T5/40 , G06T2207/10016 , G06T2207/20012 , G06T2207/20016 , G06T2207/20021 , G06T2207/20208
Abstract: Image tone adjustment using local tone curve computation may be utilized to adjust luminance ranges for images. Image tone adjustment using local tone curve computation may reduce the overall contrast of an image, while maintaining local contrast in smaller areas, such as in images capturing brightly lit scenes where the difference in intensity between brightest and darkest areas is large. A desired brightness representation of the image may be generated including target luminance values for corresponding blocks of the image. For each block, one or more tone adjustment values may be computed, that when jointly applied to the respective histograms for the block and neighboring blocks results in the luminance values that match corresponding target values. The tone adjustment values may be determined by solving an under-constrained optimization problem such that optimization constraints are minimized. The image may then be adjusted according to the computed tone adjustment values.
Abstract translation: 可以使用局部色调曲线计算的图像色调调整来调整图像的亮度范围。 使用局部色调曲线计算的图像色调调整可以降低图像的整体对比度，同时保持较小区域中的局部对比度，诸如在最亮和最暗区域之间强度差异较大的明亮场景的图像中。 可以产生图像的期望的亮度表示，包括图像的相应块的目标亮度值。 对于每个块，可以计算一个或多个色调调整值，当共同应用于块和相邻块的各个直方图时，会导致与相应目标值匹配的亮度值。 音调调整值可以通过求解不受约束的优化问题来确定，使得优化约束被最小化。 然后可以根据所计算的音调调整值来调整图像。
-
29.发明申请公开(公告)号：US20130329098A1
公开(公告)日：2013-12-12
申请号：US13724574
申请日：2012-12-21
Applicant: APPLE INC.
Inventor： Suk Hwan Lim , Christopher L. Mills , Sheng Lin
IPC: H04N9/64
CPC classification number: H04N9/64 , H04N5/142 , H04N5/23229 , H04N5/23254 , H04N5/365 , H04N5/367 , H04N9/045 , H04N9/735
Abstract: The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may detect and correct a defective pixel of image data acquired using an image sensor. The image processing pipeline may receive an input pixel of the image data acquired using the image sensor. The image processing pipeline may then identify a set of neighboring pixels having the same color component as the input pixel and remove two neighboring pixels from the set of neighboring pixels thereby generating a modified set of neighboring pixels. Here, the two neighboring pixels correspond to a maximum pixel value and a minimum pixel value of the set of neighboring pixels. The image processing pipeline may then determine a gradient for each neighboring pixel in the modified set of neighboring pixels and determine whether the input pixel includes a dynamic defect or a speckle based at least in part on the gradient for each neighboring pixel in the modified set of neighboring pixels.
Abstract translation: 本公开通常涉及用于图像数据处理的系统和方法。 在某些实施例中，图像处理流水线可以检测和校正使用图像传感器获取的图像数据的缺陷像素。 图像处理流水线可以接收使用图像传感器获取的图像数据的输入像素。 然后，图像处理流水线可以识别具有与输入像素相同颜色分量的一组相邻像素，并从相邻像素组中移除两个相邻像素，从而生成修改后的相邻像素集合。 这里，两个相邻像素对应于该组相邻像素的最大像素值和最小像素值。 然后，图像处理流水线可以确定相邻像素的修改集合中的每个相邻像素的梯度，并且确定输入像素是否至少部分地基于修改的集合中的每个相邻像素的梯度的动态缺陷或散斑 相邻像素。
-
公开(公告)号：US10911673B2
公开(公告)日：2021-02-02
申请号：US16673173
申请日：2019-11-04
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Shun Wai Go , Suk Hwan Lim , Timothy J. Millet , Ting Chen , Bin Ni
Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.
-
-
-
-
-
-
-
-
-
Search Results
81
records
(took 0.028 seconds)
