-
公开(公告)号:US20150085150A1
公开(公告)日:2015-03-26
申请号:US14038309
申请日:2013-09-26
Applicant: Apple Inc.
Inventor: D. Amnon Silverstein
CPC classification number: H04N5/2329 , H04N5/145 , H04N5/23229 , H04N5/23248 , H04N5/23254 , H04N5/23258 , H04N5/23261 , H04N5/23277 , H04N5/3532
Abstract: In-stream rolling shutter compensation may be utilized to modify image data to compensate for detected camera motion. An image processor may perform motion matching on image data received from a camera sensor to determine whether and how the camera is moving. Strips of image data are analyzed to find matching locations between the current image and a previous image by generating graphical profiles for each image strip. The graphical profiles for the current strip are compared to corresponding profiles from the previous image to determine matching locations between the two frames. A motion vector for the strip may be computed based on spatial distances between the match locations of the current image and corresponding match locations of the previous frame. Image data for the current strip may be modified based on the motion vector to compensate for perceived camera motion as it is written out to memory.
Abstract translation: 可以使用流内滚动快门补偿来修改图像数据以补偿检测到的相机运动。 图像处理器可以对从相机传感器接收的图像数据执行运动匹配,以确定相机是否以及如何移动。 通过生成每个图像条的图形轮廓,分析图像数据条,以找到当前图像和先前图像之间的匹配位置。 将当前条带的图形轮廓与来自先前图像的对应轮廓进行比较,以确定两帧之间的匹配位置。 可以基于当前图像的匹配位置与前一帧的相应匹配位置之间的空间距离来计算条带的运动矢量。 可以基于运动矢量来修改当前条带的图像数据,以便在被写入存储器时补偿感知的相机运动。
-
52.
公开(公告)号:US08958658B1
公开(公告)日:2015-02-17
申请号:US14023159
申请日:2013-09-10
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein
CPC classification number: H04N9/646 , G06T5/008 , G06T5/40 , G06T2207/10016 , G06T2207/20012 , G06T2207/20016 , G06T2207/20021 , G06T2207/20208
Abstract: Image tone adjustment using local tone curve computation may be utilized to adjust luminance ranges for images. Image tone adjustment using local tone curve computation may reduce the overall contrast of an image, while maintaining local contrast in smaller areas, such as in images capturing brightly lit scenes where the difference in intensity between brightest and darkest areas is large. A desired brightness representation of the image may be generated including target luminance values for corresponding blocks of the image. For each block, one or more tone adjustment values may be computed, that when jointly applied to the respective histograms for the block and neighboring blocks results in the luminance values that match corresponding target values. The tone adjustment values may be determined by solving an under-constrained optimization problem such that optimization constraints are minimized. The image may then be adjusted according to the computed tone adjustment values.
Abstract translation: 可以使用局部色调曲线计算的图像色调调整来调整图像的亮度范围。 使用局部色调曲线计算的图像色调调整可以降低图像的整体对比度,同时保持较小区域中的局部对比度,诸如在最亮和最暗区域之间强度差异较大的明亮场景的图像中。 可以产生图像的期望的亮度表示,包括图像的相应块的目标亮度值。 对于每个块,可以计算一个或多个色调调整值,当共同应用于块和相邻块的各个直方图时,会导致与相应目标值匹配的亮度值。 音调调整值可以通过求解不受约束的优化问题来确定,使得优化约束被最小化。 然后可以根据所计算的音调调整值来调整图像。
-
公开(公告)号:US12212729B2
公开(公告)日:2025-01-28
申请号:US18231648
申请日:2023-08-08
Applicant: Apple Inc.
Inventor: Yung-Chin Chen , Michael Bekerman , Guy Côté , Aleksandr M. Movshovich , D. Amnon Silverstein , David R. Pope
IPC: H04N13/111 , G06T15/00 , G06T19/00 , H04N13/122 , H04N13/178
Abstract: In one embodiment, a system includes a first device rendering image data, a second device storing the image data, and a display panel that displays the image data stored in the memory. The first device renders multiple frames of the image data, compresses the multiple frames into a single superframe, and transports the single superframe. The second device receives the single superframe, decompresses the single superframe into the multiple frames of image data, and stores the image data on a memory of the second device.
-
公开(公告)号:US20240397217A1
公开(公告)日:2024-11-28
申请号:US18669229
申请日:2024-05-20
Applicant: Apple Inc.
Inventor: Sheng LIN , D. Amnon Silverstein , David R. Pope
Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.
-
公开(公告)号:US11488285B2
公开(公告)日:2022-11-01
申请号:US16846904
申请日:2020-04-13
Applicant: Apple Inc.
Inventor: Ching E. Ho , D. Amnon Silverstein
Abstract: Some embodiments relate to sharpening segments of an image differently based on content in the image. Content based sharpening is performed by a content image processing circuit that receives luminance values of an image and a content map. The content map identifies categories of content in segments of the image. Based on one or more of the identified categories of content, the circuit determines a content factor associated with a pixel. The content factor may also be based on a texture and/or chroma values. A texture value indicates a likelihood of a category of content and is based on detected edges in the image. A chroma value indicates a likelihood of a category of content and is based on color information of the image. The circuit receives the content factor and applies it to a version of the luminance value of the pixel to generate a sharpened version of the luminance value.
-
公开(公告)号:US10911673B2
公开(公告)日:2021-02-02
申请号:US16673173
申请日:2019-11-04
Applicant: Apple Inc.
Inventor: D. Amnon Silverstein , Shun Wai Go , Suk Hwan Lim , Timothy J. Millet , Ting Chen , Bin Ni
Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.
-
公开(公告)号:US10853927B2
公开(公告)日:2020-12-01
申请号:US16358094
申请日:2019-03-19
Applicant: Apple Inc.
Inventor: Maxim Smirnov , D. Amnon Silverstein , David R. Pope , Chihsin Wu
Abstract: Embodiments relate to circuitry for performing fusion of two images captured with two different exposure times to generate a fused image having a higher dynamic range. Information about first keypoints is extracted from the first image by processing pixel values of pixels in the first image. A model describing correspondence between the first image and the second image is then built by processing at least the information about first keypoints. A processed version of the first image is warped using mapping information in the model to generate a warped version of the first image spatially more aligned to the second image than to the first image. The warped version of the first image is fused with a processed version of the second image to generate the fused image.
-
公开(公告)号:US20200302582A1
公开(公告)日:2020-09-24
申请号:US16358094
申请日:2019-03-19
Applicant: Apple Inc.
Inventor: Maxim Smirnov , D. Amnon Silverstein , David R. Pope , Chihsin Wu
Abstract: Embodiments relate to circuitry for performing fusion of two images captured with two different exposure times to generate a fused image having a higher dynamic range. Information about first keypoints is extracted from the first image by processing pixel values of pixels in the first image. A model describing correspondence between the first image and the second image is then built by processing at least the information about first keypoints. A processed version of the first image is warped using mapping information in the model to generate a warped version of the first image spatially more aligned to the second image than to the first image. The warped version of the first image is fused with a processed version of the second image to generate the fused image.
-
公开(公告)号:US10719918B2
公开(公告)日:2020-07-21
申请号:US16389785
申请日:2019-04-19
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein
Abstract: An image processing pipeline may dynamically determine filtering strengths for noise filtering of image data. Statistics may be collected for an image at an image processing pipeline. The statistics may be accessed and evaluated to generate a filter strength model that maps respective filtering strengths to different portions of the image. A noise filter may determine a filtering strength for image data received at the noise filter according to the filter strength model. The noise filter may then apply a filtering technique according to the determined filtering strength.
-
公开(公告)号:US20200068129A1
公开(公告)日:2020-02-27
申请号:US16673173
申请日:2019-11-04
Applicant: Apple Inc.
Inventor: D. Amnon Silverstein , Shun Wai Go , Suk Hwan Lim , Timothy J. Millet , Ting Chen , Bin Ni
Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.
-
-
-
-
-
-
-
-
-