APPARATUS AND METHOD FOR COMBINED INTRABAND AND INTERBAND MULTI-FRAME DEMOSAICING

    公开(公告)号:US20230035482A1

    公开(公告)日:2023-02-02

    申请号:US17649095

    申请日:2022-01-27

    Abstract: A method includes obtaining multiple input image frames and determining how to warp at least one of the input image frames. The method also includes performing an intraband demosaic-warp operation to reconstruct image data in different color channels of the input image frames and warp the at least one input image frame to produce RGB input image frames. The method further includes blending the RGB input image frames to produce a blended RGB image frame, performing an interband denoising operation to produce a denoised RGB image frame, and performing an interband sharpening operation to produce a sharpened RGB image frame. In addition, the method includes performing an interband demosaic operation to substantially equalize high-frequency content in different color channels of the sharpened RGB image frame to produce an equalized sharpened RGB image frame and generating a final image of the scene based on the equalized sharpened RGB image frame.

    Super-resolution depth map generation for multi-camera or other environments

    公开(公告)号:US11503266B2

    公开(公告)日:2022-11-15

    申请号:US16811585

    申请日:2020-03-06

    Abstract: A method includes obtaining, using at least one processor, first and second input image frames, where the first and second input image frames are associated with first and second image planes, respectively. The method also includes obtaining, using the at least one processor, a depth map associated with the first input image frame. The method further includes producing another version of the depth map by performing one or more times: (a) projecting, using the at least one processor, the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane and (b) adjusting, using the at least one processor, at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.

    MULTI-FRAME DEPTH-BASED MULTI-CAMERA RELIGHTING OF IMAGES

    公开(公告)号:US20220198722A1

    公开(公告)日:2022-06-23

    申请号:US17566320

    申请日:2021-12-30

    Abstract: A method includes capturing a plurality of first images using a first image sensor and capturing a plurality of second images using a second image sensor. The method also includes estimating depth information based on at least one of the first images and at least one of the second images. The method further includes obtaining information related to a lighting direction from an artificial intelligence (AI) light director, where the AI light director is trained to determine one or more lighting directions. In addition, the method includes generating at least one relit image using at least one of the first and second images based on the obtained information related to the lighting direction and the estimated depth information.

    Apparatus and method for detail enhancement in super-resolution imaging using mobile electronic device

    公开(公告)号:US11107191B2

    公开(公告)日:2021-08-31

    申请号:US16278567

    申请日:2019-02-18

    Abstract: A method includes obtaining multiple image frames of a scene using at least one camera of an electronic device and processing the multiple image frames to generate a higher-resolution image of the scene. Processing the multiple image frames includes generating an initial estimate of the scene based on the multiple image frames. Processing the multiple image frames also includes, in each of multiple iterations, (i) generating a current estimate of the scene based on the image frames and a prior estimate of the scene and (ii) regularizing the generated current estimate of the scene. The regularized current estimate of the scene from one iteration represents the prior estimate of the scene in a subsequent iteration. The iterations continue until the estimates of the scene converge on the higher-resolution image of the scene.

    APPARATUS AND METHOD FOR OPERATING MULTIPLE CAMERAS FOR DIGITAL PHOTOGRAPHY

    公开(公告)号:US20200186710A1

    公开(公告)日:2020-06-11

    申请号:US16704982

    申请日:2019-12-05

    Abstract: A method includes, in a first mode, positioning first and second tiltable image sensor modules of an image sensor array of an electronic device so that a first optical axis of the first tiltable image sensor module and a second optical axis of the second tiltable image sensor module are substantially perpendicular to a surface of the electronic device, and the first and second tiltable image sensor modules are within a thickness profile of the electronic device. The method also includes, in a second mode, tilting the first and second tiltable image sensor modules so that the first optical axis of the first tiltable image sensor module and the second optical axis of the second tiltable image sensor module are not perpendicular to the surface of the electronic device, and at least part of the first and second tiltable image sensor modules are no longer within the thickness profile of the electronic device.

    PROGRESSIVE COMPRESSED DOMAIN COMPUTER VISION AND DEEP LEARNING SYSTEMS

    公开(公告)号:US20190246130A1

    公开(公告)日:2019-08-08

    申请号:US15892141

    申请日:2018-02-08

    CPC classification number: H04N19/48 H04N19/11 H04N19/167 H04N19/44

    Abstract: Methods and systems for compressed domain progressive application of computer vision techniques. A method for decoding video data includes receiving a video stream that is encoded for multi-stage decoding. The method includes partially decoding the video stream by performing one or more stages of the multi-stage decoding. The method includes determining whether a decision for a computer vision system can be identified based on the partially decoded video stream. Additionally, the method includes generating the decision for the computer vision system based on decoding of the video stream. A system for encoding video data includes a processor configured to receive the video data from a camera, encode the video data received from the camera into a video stream for consumption by a computer vision system, and include metadata with the encoded video stream to indicate whether a decision for the computer vision system can be identified from the metadata.

Patent Agency Ranking