Binner circuit for image signal processor

    公开(公告)号:US11025842B2

    公开(公告)日:2021-06-01

    申请号:US16376426

    申请日:2019-04-05

    Applicant: Apple Inc.

    Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.

    Auto-focus engine architecture for image signal processor

    公开(公告)号:US11023994B2

    公开(公告)日:2021-06-01

    申请号:US16376414

    申请日:2019-04-05

    Applicant: Apple Inc.

    Abstract: Embodiments relate to image signal processors (ISP) that include one or more auto-focus circuits. Each of the auto-focus circuits may be connected to an image sensor and may be separate from a statistics circuit and other image processing pipelines of the ISP. An image sensor may include one or more focus pixels that are used to generate data for auto-focusing. The auto-focus circuit may extract the focus pixel values and generate a signal to control the lens position of the image sensor. Each image sensor may include a separate auto-focus circuit. When other image processing pipelines of the ISP are processing the image data from one image sensor, the auto-focus circuit for another image sensor may continue to generate focus signals that control the lens position of the other image sensor. The other image sensor may be in standby but may continue to remain in focus.

    Temporal filtering of independent color channels in image data

    公开(公告)号:US10467496B2

    公开(公告)日:2019-11-05

    申请号:US14841412

    申请日:2015-08-31

    Applicant: Apple Inc.

    Abstract: An image processing pipeline may perform temporal filtering on independent color channels in image data. A filter weight may be determined for a given pixel received at a temporal filter. The filter weight may be determined for blending a value of a channel in a full color encoding of the given pixel with a value of the same channel for a corresponding pixel in a previously filtered reference image frame. In some embodiments, the filtering strength for the channel may be determined independent from the filtering strength of another channel in the full color encoding of the given pixel. Spatial filtering may be applied to a filtered version of the given pixel prior to storing the given pixel as part of a new reference image frame.

    Dynamic optical shift/tilt lens
    45.
    发明授权

    公开(公告)号:US10200596B1

    公开(公告)日:2019-02-05

    申请号:US16042970

    申请日:2018-07-23

    Applicant: Apple Inc.

    Abstract: Camera modules that may be dynamically adjusted during capture of an image. The camera may include a sensor that captures images using line scan imaging or other scanning technologies. A controller may dynamically control adjustment or movement of the camera lens by an actuator as an image is scanned by the sensor. The lens may be controlled to be in different positions and in different orientations in relation to the sensor as different lines or areas of pixels of the sensor are read. When capturing an image, a region of the sensor may be read, the lens may be adjusted, and a next region of the sensor may be read according to a pattern. Different focus, depth of field, perspective, and other effects may be achieved at different areas or regions of the image during image capture.

    DYNAMIC MOTION ESTIMATION AND COMPENSATION FOR TEMPORAL FILTERING
    49.
    发明申请
    DYNAMIC MOTION ESTIMATION AND COMPENSATION FOR TEMPORAL FILTERING 有权
    动态过滤动态估计与补偿

    公开(公告)号:US20160037061A1

    公开(公告)日:2016-02-04

    申请号:US14449016

    申请日:2014-07-31

    Applicant: Apple Inc.

    Abstract: A temporal filter may perform dynamic motion estimation and compensation for filtering an image frame. A row of pixels in an image frame received for processing at the temporal filter may be received. A motion estimate may be dynamically determined that registers a previously filtered reference image frame with respect to the row of pixels in the image frame. The reference image frame may be aligned according to the determined motion estimate, and pixels in the row of the image frame may be blended with corresponding pixels in the aligned reference image frame to generate a filtered version of the image frame. Motion statistics may be collected for subsequent processing based on the motion estimation and alignment for the row of pixels in the image frame.

    Abstract translation: 时间滤波器可以执行用于过滤图像帧的动态运动估计和补偿。 可以接收用于在时间滤波器处理的图像帧中的像素行。 可以动态地确定运动估计,其相对于图像帧中的像素行注册先前滤波的参考图像帧。 可以根据确定的运动估计来对准参考图像帧,并且可以将图像帧的行中的像素与对准的参考图像帧中的对应像素混合以生成图像帧的滤波版本。 可以基于图像帧中的像素行的运动估计和对准来收集运动统计信息用于后续处理。

    GENERATING A HIGH DYNAMIC RANGE IMAGE USING A TEMPORAL FILTER
    50.
    发明申请
    GENERATING A HIGH DYNAMIC RANGE IMAGE USING A TEMPORAL FILTER 有权
    使用时间过滤器生成高动态范围图像

    公开(公告)号:US20160037060A1

    公开(公告)日:2016-02-04

    申请号:US14449015

    申请日:2014-07-31

    Applicant: Apple Inc.

    Abstract: A temporal filter in an image processing pipeline may be configured to generate a high dynamic range (HDR) image. Image frames captured to generate an HDR image frame be blended together at a temporal filter. An image frame that is part of a group of image frames capture to generate the HDR image may be received for filtering at the temporal filter module. A reference image frame, which may be a previously filtered image frame or an unfiltered image frame may be obtained. A filtered version of the image frame may then be generated according to an HDR blending scheme that blends the reference image frame with the image frame. If the image frame is the last image frame of the group of image frames to be filtered, then the filtered version of the image frame may be provided as the HDR image frame.

    Abstract translation: 图像处理流水线中的时间滤波器可以被配置为生成高动态范围(HDR)图像。 拍摄以生成HDR图像帧的图像帧在时间滤波器中混合在一起。 作为拍摄以生成HDR图像的一组图像帧的一部分的图像帧可以被接收以用于在时间滤波器模块处进行滤波。 可以获得可以是先前滤波的图像帧或未滤波图像帧的参考图像帧。 然后可以根据将参考图像帧与图像帧混合的HDR混合方案来生成图像帧的滤波版本。 如果图像帧是要滤波的图像帧组的最后一个图像帧,则图像帧的滤波版本可以被提供为HDR图像帧。

Patent Agency Ranking