公开(公告)号：US20250117894A1

公开(公告)日：2025-04-10

申请号：US18480829

申请日：2023-10-04

Applicant: Samsung Electronics Co., Ltd.

Inventor： Madhuri Suthar ,  Nguyen Thang Long Le ,  Tyler Luu ,  Hamid R. Sheikh

IPC: G06T5/00

Abstract: A method includes obtaining multiple input image frames and generating bad pixel maps associated with different ones of the input image frames. Each bad pixel map is generated using first and second adaptive thresholds that are based on statistical properties of image data contained in a specified operation window within the associated input image frame. The method also includes generating at least one refined bad pixel map using the bad pixel maps associated with two or more of the input image frames. The method further includes using one or more coordinates of one or more bad pixels identified in the at least one refined bad pixel map to update one or more pixel values of at least one of the input image frames.

公开(公告)号：US20250113097A1

公开(公告)日：2025-04-03

申请号：US18477293

申请日：2023-09-28

Applicant: Samsung Electronics Co., Ltd.

Inventor： Jinhan Hu ,  Jing Li ,  Chengyu Wang ,  Pavan C. Madhusudanarao ,  Hamid R. Sheikh ,  John Seokjun Lee

IPC: H04N23/60 ,  G06T7/32 ,  H04N23/68 ,  H04N23/951

Abstract: A method includes obtaining, using at least one under display camera, one or more first image frames associated with a first diffraction pattern and one or more second image frames associated with a second diffraction pattern. The first diffraction pattern and the second diffraction pattern are related through a transformation. The method also includes generating a first deblurred image using the one or more first image frames and a second deblurred image using the one or more second image frames. The method further includes combining the first and second deblurred images while exploiting complementary types of image artifacts created by the first and second diffraction patterns to generate an image of a scene.

公开(公告)号：US12231780B2

公开(公告)日：2025-02-18

申请号：US18059822

申请日：2022-11-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Nguyen Thang Long Le ,  Zeeshan Nadir ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: H04N23/745 ,  G06T5/30 ,  G06T5/50 ,  G06T7/11 ,  G06V10/44 ,  G06V10/74

Abstract: A method includes obtaining multiple image frames. The method also includes selecting, using at least one processing device of an electronic device, an asymmetrical image pair from the multiple image frames. The asymmetrical image pair includes a first image frame and a second image frame, where the first image frame has a shorter exposure than the second image frame. The method further includes identifying, using the at least one processing device, one or more features based on the asymmetrical image pair. The method also includes determining, using the at least one processing device, whether the first image frame contains flicker based on the one or more features. In addition, the method includes enabling or disabling, using the at least one processing device, the first image frame as a reference candidate based on the determination whether the first image frame contains flicker.

公开(公告)号：US20250045867A1

公开(公告)日：2025-02-06

申请号：US18363596

申请日：2023-08-01

Applicant: Samsung Electronics Co., Ltd.

Inventor： Abhiram Gnanasambandam ,  John W. Glotzbach ,  John Seokjun Lee ,  Hamid R. Sheikh

IPC: G06T3/40 ,  G06T5/00 ,  H04N23/84

Abstract: A method includes obtaining a ground truth image and generating multiple image frames using the ground truth image, a modeled optical blur, and a modeled global motion. The method also includes generating multiple mosaic image frames using the image frames and a color filter array and generating multiple raw input image frames using the mosaic image frames and a noise model associated with at least one imaging sensor. The method further includes providing the raw input image frames to a multi-frame processing pipeline in order to generate synthetic training data. In addition, the method includes training a machine learning-based image processing engine using the ground truth image and the synthetic training data.

公开(公告)号：US20240257325A1

公开(公告)日：2024-08-01

申请号：US18485970

申请日：2023-10-12

Applicant: Samsung Electronics Co., Ltd.

Inventor： Abhiram Gnanasambandam ,  John W. Glotzbach ,  Zeeshan Nadir ,  Gunawath Dilshan Godaliyadda ,  John Seokjun Lee ,  Hamid R. Sheikh

IPC: G06T5/00 ,  G06T3/40 ,  G06T15/50

CPC classification number: G06T5/94 ,  G06T3/4015 ,  G06T15/506

Abstract: A method includes obtaining multiple image frames captured using at least one imaging sensor. The method also includes generating a local tone map, a global tone map look-up table (LUT), and one or more contrast enhancement LUTs based on at least one of the image frames and one or more parameters of the at least one imaging sensor. The method further includes generating a blended and demosaiced image based on the image frames and generating a local tone mapped image based on the blended and demosaiced image and the local tone map. The method also includes adjusting color saturation based on the local tone mapped image to generate a corrected image. In addition, the method includes generating an output image based on the corrected image, the global tone map LUT, and the one or more contrast enhancement LUTs.

公开(公告)号：US20240233319A9

公开(公告)日：2024-07-11

申请号：US18049213

申请日：2022-10-24

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibo Xu ,  Weidi Liu ,  Hamid R. Sheikh ,  John Seokjun Lee

IPC: G06V10/70 ,  G06T5/00 ,  G06V10/60

CPC classification number: G06V10/70 ,  G06T5/003 ,  G06V10/60

Abstract: A method includes obtaining an under-display camera (UDC) image captured using a camera located under a display. The method also includes processing, using at least one processing device of an electronic device, the UDC image based on a machine learning model to restore the UDC image. The method further includes displaying or storing the restored image corresponding to the UDC image. The machine learning model is trained using (i) a ground truth image and (ii) a synthetic image generated using the ground truth image and a point spread function that is based on an optical transmission model of the display.

公开(公告)号：US20240119570A1

公开(公告)日：2024-04-11

申请号：US18045696

申请日：2022-10-11

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibo Xu ,  Weidi Liu ,  Hamid R. Sheikh ,  John Seokjun Lee

IPC: G06T5/00 ,  G06T5/20 ,  G06T5/50

CPC classification number: G06T5/003 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10024 ,  G06T2207/20081 ,  H04N23/50

Abstract: A method includes identifying, using at least one processing device of an electronic device, a spatially-variant point spread function associated with an under-display camera. The spatially-variant point spread function is based on an optical transmission model and a layout of a display associated with the under-display camera. The method also includes generating, using the at least one processing device, a ground truth image. The method further includes performing, using the at least one processing device, a convolution of the ground truth image based on the spatially-variant point spread function in order to generate a synthetic sensor image. The synthetic sensor image represents a simulated image captured by the under-display camera. In addition, the method includes providing, using the at least one processing device, the synthetic sensor image and the ground truth image as an image pair to train a machine learning model to perform under-display camera point spread function inversion.

公开(公告)号：US20240087190A1

公开(公告)日：2024-03-14

申请号：US18060419

申请日：2022-11-30

Applicant: Samsung Electronics Co., Ltd.

Inventor： Mingzhao Yu ,  Zeeshan Nadir ,  Hamid R. Sheikh ,  John W. Glotzbach

IPC: G06T11/40 ,  G06T5/00 ,  G06T5/40 ,  G06T7/11 ,  G06T7/90 ,  G06T11/20

CPC classification number: G06T11/40 ,  G06T5/002 ,  G06T5/40 ,  G06T7/11 ,  G06T7/90 ,  G06T11/203 ,  G06T2207/10024

Abstract: A method includes obtaining a raw image in a first image domain. The method also includes determining a color distribution and an amount of variation in the raw image. The method further includes using an iterative process to generate a dead leaf image from a blank image in the first image domain. The iterative process includes adding multiple circles and multiple sticks to the blank image until the dead leaf image is filled. The iterative process also includes blurring portions of the dead leaf image during at least one iteration of the iterative process. Textures of the multiple circles are blended based on the color distribution and the amount of variation in the raw image.

公开(公告)号：US20230351563A1

公开(公告)日：2023-11-02

申请号：US17930335

申请日：2022-09-07

Applicant: Samsung Electronics Co., Ltd.

Inventor： Zeeshan Nadir ,  Hamid R. Sheikh ,  John W. Glotzbach

IPC: G06T5/10 ,  G06T5/00 ,  G06T7/11 ,  G06T7/13 ,  G06V10/56 ,  G06V10/60 ,  G06V10/764

CPC classification number: G06T5/10 ,  G06T5/002 ,  G06T7/11 ,  G06T7/13 ,  G06V10/56 ,  G06V10/60 ,  G06V10/764 ,  G06T2207/10024 ,  G06T2207/20052

Abstract: A method includes dividing an image into overlapping image patches each having a specified size. The method also includes analyzing content of each image patch using a mathematical transform technique to classify each image patch into at least one class. The method further includes filtering each image patch for noise suppression by suppressing one or more transform coefficients of the image patch. An amount of suppression for each of the one or more transform coefficients is selected according to the at least one class of the image patch. In addition, the method includes reconstructing the filtered image patches into an output image.

公开(公告)号：US11615510B2

公开(公告)日：2023-03-28

申请号：US17139885

申请日：2020-12-31

Applicant: Samsung Electronics Co., Ltd.

Inventor： Baekdu Choi ,  Ruiwen Zhen ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: G06T3/40 ,  G06T5/00 ,  G06T5/50

Abstract: An electronic device includes at least one imaging sensor and at least one processor coupled to the at least one imaging sensor. The at least one imaging sensor is configured to capture a burst of image frames. The at least one processor is configured to generate a low-resolution image from the burst of image frames. The at least one processor is also configured to estimate a blur kernel based on the burst of image frames. The at least one processor is further configured to perform deconvolution on the low-resolution image using the blur kernel to generate a deconvolved image. In addition, the at least one processor is configured to generate a high-resolution image using super resolution (SR) on the deconvolved image.