公开(公告)号：US20230254591A1

公开(公告)日：2023-08-10

申请号：US18059822

申请日：2022-11-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Nguyen Thang Long Le ,  Zeeshan Nadir ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: H04N23/745 ,  G06T5/50 ,  G06T7/11 ,  G06V10/44 ,  G06V10/74

CPC classification number: H04N23/745 ,  G06T5/50 ,  G06T7/11 ,  G06V10/44 ,  G06V10/761 ,  G06T2207/10144 ,  G06T2207/20224

Abstract: A method includes obtaining multiple image frames. The method also includes selecting, using at least one processing device of an electronic device, an asymmetrical image pair from the multiple image frames. The asymmetrical image pair includes a first image frame and a second image frame, where the first image frame has a shorter exposure than the second image frame. The method further includes identifying, using the at least one processing device, one or more features based on the asymmetrical image pair. The method also includes determining, using the at least one processing device, whether the first image frame contains flicker based on the one or more features. In addition, the method includes enabling or disabling, using the at least one processing device, the first image frame as a reference candidate based on the determination whether the first image frame contains flicker.

公开(公告)号：US20230252770A1

公开(公告)日：2023-08-10

申请号：US18045558

申请日：2022-10-11

Applicant: Samsung Electronics Co., Ltd.

Inventor： Tyler Luu ,  John W. Glotzbach ,  Hamid R. Sheikh ,  John Seokjun Lee ,  Youngmin Kim ,  Jun Ki Cho ,  Seung-Chul Jeon

IPC: G06V10/774 ,  G06T5/00 ,  G06T5/50 ,  G06V10/24

CPC classification number: G06V10/7747 ,  G06T5/002 ,  G06T5/006 ,  G06T5/50 ,  G06V10/24 ,  G06T2207/10144 ,  G06T2207/20081 ,  G06T2207/20221

Abstract: A method for training data generation includes obtaining a first set of image frames of a scene and a second set of image frames of the scene using multiple exposure settings. The method also includes generating an alignment map, a blending map, and an input image using the first set of image frames. The method further includes generating a ground truth image using the alignment map, the blending map, and the second set of image frames. In addition, the method includes using the ground truth image and the input image as an image pair in a training dataset when training a machine learning model to reduce image distortion and noise.

公开(公告)号：US20230034109A1

公开(公告)日：2023-02-02

申请号：US17586435

申请日：2022-01-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Long N. Le ,  Yibo Xu ,  John W. Glotzbach ,  Zhen Tong ,  Hamid R. Sheikh

IPC: G06T5/00 ,  H04N5/367 ,  G06T5/10

Abstract: A method includes obtaining a blended red-green-blue (RGB) image frame of a scene. The method also includes performing, using at least one processing device of an electronic device, an interband denoising operation to remove at least one of noise and one or more artifacts from the blended RGB image frame in order to produce a denoised RGB image frame. Performing the interband denoising operation includes performing filtering of red, green, and blue color channels of the blended RGB image frame to remove at least one of the noise and the one or more artifacts from the blended RGB image frame. The filtering of the red and blue color channels of the blended RGB image frame is based on image data of at least one of the green color channel and a white color channel of the blended RGB image frame.

公开(公告)号：US20220207658A1

公开(公告)日：2022-06-30

申请号：US17139880

申请日：2020-12-31

Applicant: Samsung Electronics Co., Ltd.

Inventor： Zhen Tong ,  Yibo Xu ,  John W. Glotzbach ,  Hamid R. Sheikh ,  Ruiwen Zhen ,  Baekdu Choi

IPC: G06T5/00 ,  G06T7/13 ,  G06T5/50 ,  G06T5/20

Abstract: Various image sharpening techniques are disclosed. For example, a method for image sharpening includes obtaining, using at least one sensor of an electronic device, an image that includes visual content. The method also includes generating an edge map that indicates edges of the visual content within the image. The method further includes applying a high-pass signal and an adaptive gain based on the edge map to sharpen the image. The method also includes generating a bright halo mask and a dark halo mask based on the edge map, where the bright halo mask indicates an upper sharpening limit and the dark halo mask indicates a lower sharpening limit. In addition, the method includes modifying a level of sharpening at one or more of the edges within the sharpened image to provide halo artifact reduction based on the bright halo mask and the dark halo mask.

公开(公告)号：US20220122223A1

公开(公告)日：2022-04-21

申请号：US17139885

申请日：2020-12-31

Applicant: Samsung Electronics Co., Ltd.

Inventor： Baekdu Choi ,  Ruiwen Zhen ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: G06T3/40 ,  G06T5/00 ,  G06T5/50

Abstract: An electronic device includes at least one imaging sensor and at least one processor coupled to the at least one imaging sensor. The at least one imaging sensor is configured to capture a burst of image frames. The at least one processor is configured to generate a low-resolution image from the burst of image frames. The at least one processor is also configured to estimate a blur kernel based on the burst of image frames. The at least one processor is further configured to perform deconvolution on the low-resolution image using the blur kernel to generate a deconvolved image. In addition, the at least one processor is configured to generate a high-resolution image using super resolution (SR) on the deconvolved image.

公开(公告)号：US11200653B2

公开(公告)日：2021-12-14

申请号：US16707652

申请日：2019-12-09

Applicant: Samsung Electronics Co., Ltd.

Inventor： Zhen Tong ,  John W. Glotzbach ,  Ruiwen Zhen ,  Hamid R. Sheikh

IPC: G06T5/50 ,  G06T5/40

Abstract: A method includes obtaining, using at least one sensor of an electronic device, multiple image frames of a scene. The multiple image frames include a first image frame and a second image frame captured using different exposures. The method also includes excluding, using at least one processor of the electronic device, pixels in the first and second image frames based on a coarse motion map. The method further includes generating, using the at least one processor, multiple local histogram match maps based on different portions of the first and second image frames. In addition, the method includes generating, using the at least one processor, an image of the scene using the local histogram match maps.

公开(公告)号：US11107205B2

公开(公告)日：2021-08-31

申请号：US16278512

申请日：2019-02-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yuting Hu ,  Ruiwen Zhen ,  John W. Glotzbach ,  Ibrahim Pekkucuksen ,  Hamid R. Sheikh

IPC: G06N3/08 ,  G06T5/50

Abstract: A method includes obtaining multiple image frames of a scene using at least one camera of an electronic device. The method also includes using a convolutional neural network to generate blending maps associated with the image frames. The blending maps contain or are based on both a measure of motion in the image frames and a measure of how well exposed different portions of the image frames are. The method further includes generating a final image of the scene using at least some of the image frames and at least some of the blending maps. The final image of the scene may be generated by blending the at least some of the image frames using the at least some of the blending maps, and the final image of the scene may include image details that are lost in at least one of the image frames due to over-exposure or under-exposure.

公开(公告)号：US10911691B1

公开(公告)日：2021-02-02

申请号：US16719633

申请日：2019-12-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Long N. Le ,  Ruiwen Zhen ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: H04N5/235 ,  G06T5/40 ,  G06T5/00 ,  G06T5/50

Abstract: A method includes obtaining, using at least one image sensor of an electronic device, multiple image frames of a scene. The multiple image frames include a plurality of short image frames at a first exposure level and a plurality of long image frames at a second exposure level longer than the first exposure level. The method also includes generating a short reference image frame and a long reference image frame using the multiple image frames. The method further includes selecting, using a processor of the electronic device, the short reference image frame or the long reference image frame as a reference frame, where the selection is based on an amount of saturated motion in the long image frame and an amount of a shadow region in the short image frame. In addition, the method includes generating a final image of the scene using the reference frame.

公开(公告)号：US09438809B2

公开(公告)日：2016-09-06

申请号：US14690046

申请日：2015-04-17

Applicant: Samsung Electronics Co., Ltd.

Inventor： Hamid R. Sheikh ,  John W. Glotzbach ,  Osman G. Sezer

IPC: H04N5/262 ,  H04N5/232 ,  G06K9/46 ,  G06T3/00 ,  G06T3/60 ,  H04N5/265 ,  G06T5/50 ,  G06T7/20 ,  G06T3/40

CPC classification number: H04N5/23296 ,  G06K9/46 ,  G06T3/0006 ,  G06T3/4007 ,  G06T3/4053 ,  G06T3/60 ,  G06T5/50 ,  G06T7/20 ,  G06T2200/12 ,  G06T2207/20024 ,  G06T2207/20182 ,  G06T2207/20212 ,  H04N5/23229 ,  H04N5/23232 ,  H04N5/23245 ,  H04N5/23258 ,  H04N5/262 ,  H04N5/265

Abstract: A mobile device includes an embedded digital camera that is configured to capture a burst of N images. The mobile device includes processing circuitry comprising a registration module configured to, for each image within the burst of images: analyze an amount of warp of the image and generate a set of affine matrices indicating the amount of warp of the image. The processing circuitry includes a High Fidelity Interpolation block configured to, for each image within the burst of images: perform affine transformation using the set of affine matrices associated with the image, apply an aliasing-retaining interpolation filter, and implement rotation transformation and sub-pixel shifts, yielding an interpolated image. The processing circuitry includes a blending module configured to receive the N interpolated images and blend the N interpolated images into a single-blended image having a user-selected digital zoom ratio.

Abstract translation: 移动设备包括被配置为捕获N个图像的突发的嵌入式数字照相机。 移动设备包括处理电路，其包括配置为针对图像脉冲串内的每个图像的注册模块：分析图像的扭曲量并生成表示图像的扭曲量的一组仿射矩阵。 所述处理电路包括：高保真插值块，被配置为针对所述图像脉冲串内的每个图像：使用与所述图像相关联的所述一组仿射矩阵执行仿射变换，应用混叠保持内插滤波器，以及实施旋转变换和子像素， 像素移位，产生内插图像。 处理电路包括混合模块，其被配置为接收N个内插图像，并将N个内插图像混合成具有用户选择的数字缩放比率的单一混合图像。

公开(公告)号：US20230252611A1

公开(公告)日：2023-08-10

申请号：US18046117

申请日：2022-10-12

Applicant: Samsung Electronics Co., Ltd.

Inventor： Gunawath Dilshan Godaliyadda ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: G06T5/00 ,  G06T5/20

CPC classification number: G06T5/009 ,  G06T5/20 ,  G06T5/002 ,  G06T2207/20208

Abstract: A method includes obtaining an image and a gain map associated with the image. The method also includes identifying image patches in the image and corresponding gain map patches in the gain map. Different image patches are centered around different anchor points in the image. The method further includes, for each image patch and its corresponding gain map patch, generating an intensity-gain curve for the associated anchor point. The intensity-gain curve specifies (i) gain values based on the corresponding gain map patch for intensity values up to a threshold intensity value and (ii) gain values based on one or more input parameters for intensity values above the threshold intensity value. In addition, the method includes combining the intensity-gain curves to generate a 3D lookup table, which identifies the gain values for the anchor points in the image at each of multiple intensity values.