-
公开(公告)号：US20180007241A1
公开(公告)日：2018-01-04
申请号：US15198363
申请日：2016-06-30
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Jaewon Shin
CPC classification number: H04N5/2176 , G06T1/20 , G06T3/4015 , G06T5/002 , G06T5/20 , G06T7/0002 , G06T2207/10024 , G06T2207/20024 , H04N5/3675 , H04N9/045 , H04N2209/045 , H04N2209/046
Abstract: Embodiments of the present disclosure relate to a sensor interface circuit that performs scaling of image data in a Bayer pattern without spreading defective pixels across multiple pixels. The sensor interface circuit may include a register circuit storing operating parameters of the sensor interface circuit. The sensor interface circuit includes a scaling circuit with a first defect pixel detection circuit to detect a first defective pixel in an input image by analyzing pixels in a line of an input image data along a first direction. A first scaling circuit is coupled to the first defect pixel detection circuit and generates a scaled line of pixels representing the line of the input image scaled along the first direction according to the operating parameters.
-
公开(公告)号：US20180005352A1
公开(公告)日：2018-01-04
申请号：US15198376
申请日：2016-06-30
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein
CPC classification number: H04N9/76 , G06T3/4015 , H04N5/332 , H04N5/365 , H04N9/045
Abstract: Embodiments of the present disclosure relate to an apparatus for converting image data from a Bayer format image to a four-plane image format using two memory channels. An example apparatus includes an interface for receiving the Bayer image including repeating pixel groups, where each pixel group includes a first pixel type, a second pixel type, a third pixel type, and a fourth pixel type. The apparatus also includes a memory and a circuit to write the Bayer image to the memory as four-plane data. The four-plane data includes pixels of the first type and the third type in the Bayer image that are written via the first memory channel, and pixels of the second type and the fourth type in the Bayer image that are written via the second memory channel. Embodiments also relate to converting three sensor image data to a Bayer format image using the two memory channels.
-
公开(公告)号：US09860429B1
公开(公告)日：2018-01-02
申请号：US15198363
申请日：2016-06-30
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Jaewon Shin
CPC classification number: H04N5/2176 , G06T1/20 , G06T3/4015 , G06T5/002 , G06T5/20 , G06T7/0002 , G06T2207/10024 , G06T2207/20024 , H04N5/3675 , H04N9/045 , H04N2209/045 , H04N2209/046
Abstract: Embodiments of the present disclosure relate to a sensor interface circuit that performs scaling of image data in a Bayer pattern without spreading defective pixels across multiple pixels. The sensor interface circuit may include a register circuit storing operating parameters of the sensor interface circuit. The sensor interface circuit includes a scaling circuit with a first defect pixel detection circuit to detect a first defective pixel in an input image by analyzing pixels in a line of an input image data along a first direction. A first scaling circuit is coupled to the first defect pixel detection circuit and generates a scaled line of pixels representing the line of the input image scaled along the first direction according to the operating parameters.
-
公开(公告)号：US09756266B2
公开(公告)日：2017-09-05
申请号：US14977384
申请日：2015-12-21
Applicant: Apple Inc.
Inventor： Christopher L. Mills , Sheng Lin , David R. Pope , D. Amnon Silverstein , Suk Hwan Lim
CPC classification number: H04N9/04511 , G06T3/4015 , H04N5/2628 , H04N9/07 , H04N9/646 , H04N2209/046
Abstract: An input rescale module that performs cross-color correlated downscaling of sensor data in the horizontal and vertical dimensions. The module may perform a first-pass demosaic of sensor data, apply horizontal and vertical scalers to resample and downsize the data in the horizontal and vertical dimensions, and then remosaic the data to provide horizontally and vertically downscaled sensor data as output for additional image processing. The module may, for example, act as a front end scaler for an image signal processor (ISP). The demosaic performed by the module may be a relatively simple demosaic, for example a demosaic function that works on 3×3 blocks of pixels. The front end of module may receive and process sensor data at two pixels per clock (ppc); the horizontal filter component reduces the sensor data down to one ppc for downstream components of the input rescale module and for the ISP pipeline.
-
公开(公告)号：US20170070689A1
公开(公告)日：2017-03-09
申请号：US14848276
申请日：2015-09-08
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Sheng Lin , David R. Pope , Suk Hwan Lim
CPC classification number: H04N5/3572 , G06T5/008 , H01L27/14623 , H01L27/14643 , H04N5/3651 , H04N5/3696 , H04N9/646
Abstract: Systems and methods for automatic lens flare compensation may include a non-uniformity detector configured to operate on pixel data for an image in an image sensor color pattern. The non-uniformity detector may detect a non-uniformity in the pixel data in a color channel of the image sensor color pattern. The non-uniformity detector may generate output including location and magnitude values of the non-uniformity. A lens flare detector may determine, based at least on the location and magnitude values, whether the output of the non-uniformity detector corresponds to a lens flare in the image. In some embodiments, the lens flare detector may generate, in response to determining that the output corresponds to the lens flare, a representative map of the lens flare. A lens flare corrector may determine one or more pixel data correction values corresponding to the lens flare and apply the pixel data correction values to the pixel data.
Abstract translation: 用于自动镜头光斑补偿的系统和方法可以包括被配置为对图像传感器颜色图案中的图像的像素数据进行操作的非均匀性检测器。 不均匀性检测器可以检测图像传感器颜色图案的颜色通道中的像素数据的不均匀性。 不均匀性检测器可以产生包括不均匀性的位置和幅度值的输出。 透镜闪光检测器可以至少基于位置和幅度值来确定不均匀性检测器的输出是否对应于图像中的透镜闪光。 在一些实施例中，透镜光斑检测器可以响应于确定输出对应于透镜闪光而产生透镜的代表性地图闪光。 透镜闪光校正器可以确定与透镜光斑相对应的一个或多个像素数据校正值，并将像素数据校正值应用于像素数据。
-
Patent Agency Ranking
公开(公告)号：US09591219B2
公开(公告)日：2017-03-07
申请号：US15089784
申请日：2016-04-04
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Shun Wai Go , Suk Hwan Lim , Timothy J. Millet , Ting Chen , Bin Ni
CPC classification number: H04N5/23245 , H04N1/212 , H04N5/23216 , H04N5/23232 , H04N5/23293 , H04N7/0122 , H04N9/87
Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.
Abstract translation: 在一个实施例中，电子设备可以被配置为在视频捕获期间捕获静止帧，但是可以以比4×3宽高比和高于16×9宽高比视频帧的分辨率捕获静止帧。 该装置可以在视频序列中交错高分辨率，4×3帧和较低分辨率的16×9帧，并且当用户指示拍摄静止帧时可以捕获最近的较高分辨率，4×3帧。 或者，设备可以在视频序列中显示16×9帧，然后当按下快门按钮时，扩展为4×3帧。 该装置可以捕获静止帧并响应于快门按钮的释放而返回到16×9视频帧。
-
公开(公告)号：US20170061582A1
公开(公告)日：2017-03-02
申请号：US14841412
申请日：2015-08-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , Sheng Lin
CPC classification number: G06K9/6201 , G06T5/002 , G06T2207/20182
Abstract: An image processing pipeline may perform temporal filtering on independent color channels in image data. A filter weight may be determined for a given pixel received at a temporal filter. The filter weight may be determined for blending a value of a channel in a full color encoding of the given pixel with a value of the same channel for a corresponding pixel in a previously filtered reference image frame. In some embodiments, the filtering strength for the channel may be determined independent from the filtering strength of another channel in the full color encoding of the given pixel. Spatial filtering may be applied to a filtered version of the given pixel prior to storing the given pixel as part of a new reference image frame.
Abstract translation: 图像处理流水线可以对图像数据中的独立颜色通道执行时间滤波。 可以针对在时间滤波器处接收到的给定像素来确定滤波器权重。 可以确定滤波器权重用于将给定像素的全色编码中的信道的值与先前滤波的参考图像帧中的对应像素的相同信道的值混合。 在一些实施例中，可以独立于给定像素的全色编码中的另一通道的滤波强度来确定信道的滤波强度。 在将给定像素作为新参考图像帧的一部分存储之前，空间滤波可以应用于给定像素的滤波版本。
-
公开(公告)号：US09554048B2
公开(公告)日：2017-01-24
申请号：US14038309
申请日：2013-09-26
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein
CPC classification number: H04N5/2329 , H04N5/145 , H04N5/23229 , H04N5/23248 , H04N5/23254 , H04N5/23258 , H04N5/23261 , H04N5/23277 , H04N5/3532
Abstract: In-stream rolling shutter compensation may be utilized to modify image data to compensate for detected camera motion. An image processor may perform motion matching on image data received from a camera sensor to determine whether and how the camera is moving. Strips of image data are analyzed to find matching locations between the current image and a previous image by generating graphical profiles for each image strip. The graphical profiles for the current strip are compared to corresponding profiles from the previous image to determine matching locations between the two frames. A motion vector for the strip may be computed based on spatial distances between the match locations of the current image and corresponding match locations of the previous frame. Image data for the current strip may be modified based on the motion vector to compensate for perceived camera motion as it is written out to memory.
Abstract translation: 可以使用流内滚动快门补偿来修改图像数据以补偿检测到的相机运动。 图像处理器可以对从相机传感器接收的图像数据执行运动匹配，以确定相机是否以及如何移动。 通过生成每个图像条的图形轮廓，分析图像数据条，以找到当前图像和先前图像之间的匹配位置。 将当前条带的图形轮廓与来自先前图像的对应轮廓进行比较，以确定两帧之间的匹配位置。 可以基于当前图像的匹配位置与前一帧的相应匹配位置之间的空间距离来计算条带的运动矢量。 可以基于运动矢量来修改当前条带的图像数据，以便在被写入存储器时补偿感知的相机运动。
-
公开(公告)号：US09479695B2
公开(公告)日：2016-10-25
申请号：US14449015
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein
CPC classification number: H04N5/23229 , G06T5/009 , G06T5/10 , G06T5/50 , G06T2207/10016 , G06T2207/10144 , G06T2207/20024 , G06T2207/20182 , G06T2207/20208 , G06T2207/20221 , H04N5/217 , H04N5/2355
Abstract: A temporal filter in an image processing pipeline may be configured to generate a high dynamic range (HDR) image. Image frames captured to generate an HDR image frame be blended together at a temporal filter. An image frame that is part of a group of image frames capture to generate the HDR image may be received for filtering at the temporal filter module. A reference image frame, which may be a previously filtered image frame or an unfiltered image frame may be obtained. A filtered version of the image frame may then be generated according to an HDR blending scheme that blends the reference image frame with the image frame. If the image frame is the last image frame of the group of image frames to be filtered, then the filtered version of the image frame may be provided as the HDR image frame.
Abstract translation: 图像处理流水线中的时间滤波器可以被配置为生成高动态范围（HDR）图像。 拍摄以生成HDR图像帧的图像帧在时间滤波器中混合在一起。 作为拍摄以生成HDR图像的一组图像帧的一部分的图像帧可以被接收以用于在时间滤波器模块处进行滤波。 可以获得可以是先前滤波的图像帧或未滤波图像帧的参考图像帧。 然后可以根据将参考图像帧与图像帧混合的HDR混合方案来生成图像帧的滤波版本。 如果图像帧是要滤波的图像帧组的最后一个图像帧，则图像帧的滤波版本可以被提供为HDR图像帧。
-
公开(公告)号：US09374526B2
公开(公告)日：2016-06-21
申请号：US14449010
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Suk Hwan Lim
CPC classification number: H04N5/23229 , G06T1/20 , G06T5/002 , G06T5/10 , G06T5/50 , G06T2207/20024 , G06T2207/20182 , H04N5/21
Abstract: A temporal filter in an image processing pipeline may insert a frame delay when filtering an image frame. A given pixel of a current image frame may be received and a filtered version of the given pixel may be generated, blending the given pixel and a corresponding pixel of a reference image frame to store as part of a filtered version of the current image frame. If a frame delay setting is enabled, the corresponding pixel of the reference image frame may be provided as output for subsequent image processing inserting a frame delay for the current image frame. During the frame delay programming instructions may be received and image processing pipeline components may be configured according to the programming instructions. If the frame delay setting is disabled, then the filtered version of the given pixel may be provided as output for subsequent image processing.
Abstract translation: 图像处理流水线中的时间滤波器可以在对图像帧进行滤波时插入帧延迟。 可以接收当前图像帧的给定像素，并且可以生成给定像素的滤波版本，将给定像素和参考图像帧的对应像素混合以存储为当前图像帧的滤波版本的一部分。 如果启用了帧延迟设置，则可以将参考图像帧的相应像素提供为用于随后的图像处理的输出，为当前图像帧插入帧延迟。 在帧延迟期间，可以接收编程指令，并且可以根据编程指令来配置图像处理流水线部件。 如果帧延迟设置被禁用，则可以提供给定像素的滤波版本作为后续图像处理的输出。
-
-
-
-
-
-
-
-
-
Search Results
95
records
(took 0.028 seconds)
