公开(公告)号：US11720782B2

公开(公告)日：2023-08-08

申请号：US17135573

申请日：2020-12-28

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chenchi Luo ,  Gyeongmin Choe ,  Yingmao Li ,  Zeeshan Nadir ,  Hamid R. Sheikh ,  John Seokjun Lee ,  Youngjun Yoo

IPC: G06N3/00 ,  G06N3/045 ,  G06T7/60 ,  G06T7/44 ,  G06N3/08 ,  G06N3/042

CPC classification number: G06N3/045 ,  G06N3/042 ,  G06N3/08 ,  G06T7/44 ,  G06T7/60 ,  G06T2207/10024 ,  G06T2207/20081

Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple calibration parameters associated with multiple sensors of a selected mobile device. The method also includes obtaining, using the at least one processor, an identification of multiple imaging tasks. The method further includes obtaining, using the at least one processor, multiple synthetically-generated scene images. In addition, the method includes generating, using the at least one processor, multiple training images and corresponding meta information based on the calibration parameters, the identification of the imaging tasks, and the scene images. The training images and corresponding meta information are generated concurrently, different ones of the training images correspond to different ones of the sensors, and different pieces of the meta information correspond to different ones of the imaging tasks.

公开(公告)号：US20230073970A1

公开(公告)日：2023-03-09

申请号：US17651226

申请日：2022-02-15

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kaimo Lin ,  Hamid R. Sheikh

IPC: G06T3/40 ,  G06T5/00 ,  H04N5/232 ,  H04N5/235

Abstract: A method includes obtaining a Bayer input image. The method also includes generating, using at least one processing device of an electronic device, multiple YUV image frames based on the Bayer input image using non-linear scaling, where the YUV image frames are associated with different exposure settings. The method further includes generating, using the at least one processing device of the electronic device, a fused image based on the YUV image frames. In addition, the method includes applying, using the at least one processing device of the electronic device, global tone-mapping to the fused image in order to generate a tone-mapped fused image, where the global tone-mapping is based on a first cubic spline curve.

公开(公告)号：US20230034109A1

公开(公告)日：2023-02-02

申请号：US17586435

申请日：2022-01-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Long N. Le ,  Yibo Xu ,  John W. Glotzbach ,  Zhen Tong ,  Hamid R. Sheikh

IPC: G06T5/00 ,  H04N5/367 ,  G06T5/10

Abstract: A method includes obtaining a blended red-green-blue (RGB) image frame of a scene. The method also includes performing, using at least one processing device of an electronic device, an interband denoising operation to remove at least one of noise and one or more artifacts from the blended RGB image frame in order to produce a denoised RGB image frame. Performing the interband denoising operation includes performing filtering of red, green, and blue color channels of the blended RGB image frame to remove at least one of the noise and the one or more artifacts from the blended RGB image frame. The filtering of the red and blue color channels of the blended RGB image frame is based on image data of at least one of the green color channel and a white color channel of the blended RGB image frame.

公开(公告)号：US11532091B2

公开(公告)日：2022-12-20

申请号：US16946956

申请日：2020-07-13

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kushal Kardam Vyas ,  Yingmao Li ,  Chenchi Luo ,  George Q. Chen ,  Hamid R. Sheikh ,  Youngjun Yoo ,  Michael O. Polley

IPC: G06T7/00 ,  G06T7/50 ,  G06T3/40 ,  G06T7/70 ,  G06T5/00

Abstract: A method includes obtaining, using at least one processor, an input image frame. The method also includes identifying, using the at least one processor, one or more regions of the input image frame containing redundant information. In addition, the method includes performing, using the at least one processor, an image processing task using the input image frame. The image processing task is guided based on the one or more identified regions of the input image frame. The method may further include obtaining, using the at least one processor, a coarse depth map associated with the input image frame. Performing the image processing task may include refining the coarse depth map to produce a refined depth map, where the refining of the coarse depth map is guided based on the one or more identified regions of the input image frame.

公开(公告)号：US20220207658A1

公开(公告)日：2022-06-30

申请号：US17139880

申请日：2020-12-31

Applicant: Samsung Electronics Co., Ltd.

Inventor： Zhen Tong ,  Yibo Xu ,  John W. Glotzbach ,  Hamid R. Sheikh ,  Ruiwen Zhen ,  Baekdu Choi

IPC: G06T5/00 ,  G06T7/13 ,  G06T5/50 ,  G06T5/20

Abstract: Various image sharpening techniques are disclosed. For example, a method for image sharpening includes obtaining, using at least one sensor of an electronic device, an image that includes visual content. The method also includes generating an edge map that indicates edges of the visual content within the image. The method further includes applying a high-pass signal and an adaptive gain based on the edge map to sharpen the image. The method also includes generating a bright halo mask and a dark halo mask based on the edge map, where the bright halo mask indicates an upper sharpening limit and the dark halo mask indicates a lower sharpening limit. In addition, the method includes modifying a level of sharpening at one or more of the edges within the sharpened image to provide halo artifact reduction based on the bright halo mask and the dark halo mask.

公开(公告)号：US20220122223A1

公开(公告)日：2022-04-21

申请号：US17139885

申请日：2020-12-31

Applicant: Samsung Electronics Co., Ltd.

Inventor： Baekdu Choi ,  Ruiwen Zhen ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: G06T3/40 ,  G06T5/00 ,  G06T5/50

Abstract: An electronic device includes at least one imaging sensor and at least one processor coupled to the at least one imaging sensor. The at least one imaging sensor is configured to capture a burst of image frames. The at least one processor is configured to generate a low-resolution image from the burst of image frames. The at least one processor is also configured to estimate a blur kernel based on the burst of image frames. The at least one processor is further configured to perform deconvolution on the low-resolution image using the blur kernel to generate a deconvolved image. In addition, the at least one processor is configured to generate a high-resolution image using super resolution (SR) on the deconvolved image.

公开(公告)号：US11200653B2

公开(公告)日：2021-12-14

申请号：US16707652

申请日：2019-12-09

Applicant: Samsung Electronics Co., Ltd.

Inventor： Zhen Tong ,  John W. Glotzbach ,  Ruiwen Zhen ,  Hamid R. Sheikh

IPC: G06T5/50 ,  G06T5/40

Abstract: A method includes obtaining, using at least one sensor of an electronic device, multiple image frames of a scene. The multiple image frames include a first image frame and a second image frame captured using different exposures. The method also includes excluding, using at least one processor of the electronic device, pixels in the first and second image frames based on a coarse motion map. The method further includes generating, using the at least one processor, multiple local histogram match maps based on different portions of the first and second image frames. In addition, the method includes generating, using the at least one processor, an image of the scene using the local histogram match maps.

公开(公告)号：US11107205B2

公开(公告)日：2021-08-31

申请号：US16278512

申请日：2019-02-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yuting Hu ,  Ruiwen Zhen ,  John W. Glotzbach ,  Ibrahim Pekkucuksen ,  Hamid R. Sheikh

IPC: G06N3/08 ,  G06T5/50

Abstract: A method includes obtaining multiple image frames of a scene using at least one camera of an electronic device. The method also includes using a convolutional neural network to generate blending maps associated with the image frames. The blending maps contain or are based on both a measure of motion in the image frames and a measure of how well exposed different portions of the image frames are. The method further includes generating a final image of the scene using at least some of the image frames and at least some of the blending maps. The final image of the scene may be generated by blending the at least some of the image frames using the at least some of the blending maps, and the final image of the scene may include image details that are lost in at least one of the image frames due to over-exposure or under-exposure.

公开(公告)号：US10911691B1

公开(公告)日：2021-02-02

申请号：US16719633

申请日：2019-12-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Long N. Le ,  Ruiwen Zhen ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: H04N5/235 ,  G06T5/40 ,  G06T5/00 ,  G06T5/50

Abstract: A method includes obtaining, using at least one image sensor of an electronic device, multiple image frames of a scene. The multiple image frames include a plurality of short image frames at a first exposure level and a plurality of long image frames at a second exposure level longer than the first exposure level. The method also includes generating a short reference image frame and a long reference image frame using the multiple image frames. The method further includes selecting, using a processor of the electronic device, the short reference image frame or the long reference image frame as a reference frame, where the selection is based on an amount of saturated motion in the long image frame and an amount of a shadow region in the short image frame. In addition, the method includes generating a final image of the scene using the reference frame.

公开(公告)号：US09438809B2

公开(公告)日：2016-09-06

申请号：US14690046

申请日：2015-04-17

Applicant: Samsung Electronics Co., Ltd.

Inventor： Hamid R. Sheikh ,  John W. Glotzbach ,  Osman G. Sezer

IPC: H04N5/262 ,  H04N5/232 ,  G06K9/46 ,  G06T3/00 ,  G06T3/60 ,  H04N5/265 ,  G06T5/50 ,  G06T7/20 ,  G06T3/40

CPC classification number: H04N5/23296 ,  G06K9/46 ,  G06T3/0006 ,  G06T3/4007 ,  G06T3/4053 ,  G06T3/60 ,  G06T5/50 ,  G06T7/20 ,  G06T2200/12 ,  G06T2207/20024 ,  G06T2207/20182 ,  G06T2207/20212 ,  H04N5/23229 ,  H04N5/23232 ,  H04N5/23245 ,  H04N5/23258 ,  H04N5/262 ,  H04N5/265

Abstract: A mobile device includes an embedded digital camera that is configured to capture a burst of N images. The mobile device includes processing circuitry comprising a registration module configured to, for each image within the burst of images: analyze an amount of warp of the image and generate a set of affine matrices indicating the amount of warp of the image. The processing circuitry includes a High Fidelity Interpolation block configured to, for each image within the burst of images: perform affine transformation using the set of affine matrices associated with the image, apply an aliasing-retaining interpolation filter, and implement rotation transformation and sub-pixel shifts, yielding an interpolated image. The processing circuitry includes a blending module configured to receive the N interpolated images and blend the N interpolated images into a single-blended image having a user-selected digital zoom ratio.

Abstract translation: 移动设备包括被配置为捕获N个图像的突发的嵌入式数字照相机。 移动设备包括处理电路，其包括配置为针对图像脉冲串内的每个图像的注册模块：分析图像的扭曲量并生成表示图像的扭曲量的一组仿射矩阵。 所述处理电路包括：高保真插值块，被配置为针对所述图像脉冲串内的每个图像：使用与所述图像相关联的所述一组仿射矩阵执行仿射变换，应用混叠保持内插滤波器，以及实施旋转变换和子像素， 像素移位，产生内插图像。 处理电路包括混合模块，其被配置为接收N个内插图像，并将N个内插图像混合成具有用户选择的数字缩放比率的单一混合图像。