公开(公告)号：US20250037250A1

公开(公告)日：2025-01-30

申请号：US18490505

申请日：2023-10-19

Applicant: Samsung Electronics Co., Ltd.

Inventor： Gunawath Dilshan Godaliyadda ,  Tyler Luu ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: G06T5/00

Abstract: A method includes obtaining, using at least one processing device of an electronic device, an input image containing blur. The method also includes generating, using the at least one processing device, an edge enhancement mask and a gain mask based on the input image. The method further includes generating, using the at least one processing device, a halo-suppressed edge mask based on the edge enhancement mask and the gain mask. In addition, the method includes generating, using the at least one processing device, a sharpened image based on the input image and the halo-suppressed edge mask.

公开(公告)号：US12206993B2

公开(公告)日：2025-01-21

申请号：US17938013

申请日：2022-10-04

Applicant: Samsung Electronics Co., Ltd.

Inventor： Anqi Yang ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: H04N23/73 ,  G06T5/50 ,  G06T5/73 ,  H04N19/42 ,  H04N23/743

Abstract: A method includes obtaining, using at least one image sensor of an electronic device, a first image frame and multiple second image frames of a scene. Each of the second image frames has an exposure time different from an exposure time of the first image frame. The method also includes generating, using at least one processor, blur kernels indicating a motion direction of the first image frame using an optical flow network. The method further includes refining, using the at least one processor, the blur kernels using a convolutional neural network. In addition, the method includes generating, using the at least one processor, a target image frame of the scene using the refined blur kernels and occlusion masks for the second image frames.

公开(公告)号：US12192673B2

公开(公告)日：2025-01-07

申请号：US17591350

申请日：2022-02-02

Applicant: Samsung Electronics Co., Ltd.

Inventor： Gyeongmin Choe ,  Yingmao Li ,  John Seokjun Lee ,  Hamid R. Sheikh ,  Michael O. Polley

IPC: H04N7/01 ,  G06T1/00 ,  G06T3/18 ,  G06T5/50 ,  G06T7/207 ,  H04N1/32 ,  H04N19/139 ,  H04N19/577

Abstract: A method includes obtaining multiple video frames. The method also includes determining whether a bi-directional optical flow between the multiple video frames satisfies an image quality criterion for bi-directional consistency. The method further includes identifying a non-linear curve based on pixel coordinate values from at least two of the video frames. The at least two video frames include first and second video frames. The method also includes generating interpolated video frames between the first and second video frames by applying non-linear interpolation based on the non-linear curve. In addition, the method includes outputting the interpolated video frames for presentation.

公开(公告)号：US12086971B2

公开(公告)日：2024-09-10

申请号：US17586511

申请日：2022-01-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Ibrahim Pekkucuksen ,  Kaimo Lin ,  Hamid R. Sheikh

IPC: G06T5/40 ,  G06T5/92

CPC classification number: G06T5/92 ,  G06T5/40 ,  G06T2207/10024

Abstract: An apparatus includes at least one processing device configured to obtain an input image and determine a cumulative distribution function (CDF) histogram from a luminance or luma (Y) channel of the input image. The at least one processing device is also configured to determine an entry CDF histogram in a CDF histogram lookup table (LUT) closest to the determined CDF histogram. The at least one processing device is further configured to apply a Y channel global tone mapping (GTM) curve to the input image based on one or more parameters assigned to the entry CDF histogram from the CDF histogram LUT.

公开(公告)号：US12069381B2

公开(公告)日：2024-08-20

申请号：US18354394

申请日：2023-07-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibo Xu ,  Hamid R. Sheikh

IPC: H04N23/80 ,  G06F1/16 ,  H04N23/76 ,  H04N23/84

CPC classification number: H04N23/80 ,  H04N23/76 ,  H04N23/84 ,  G06F1/1686

Abstract: A method includes obtaining an image, where the image includes one or more frames. The method also includes performing multi-frame processing, image signal processing, and image processing on the image to produce a processed image. The method further includes applying a chroma suppression to the processed image. The chroma suppression is configured to reduce brightness and color saturation in one or more select areas within the processed image.

公开(公告)号：US20240257324A1

公开(公告)日：2024-08-01

申请号：US18454247

申请日：2023-08-23

Applicant: Samsung Electronics Co., Ltd.

Inventor： Nguyen Thang Long Le ,  Tyler Luu ,  Hamid R. Sheikh

IPC: G06T5/00 ,  G06T5/50

CPC classification number: G06T5/92 ,  G06T5/50 ,  G06T5/70 ,  G06T2207/20192 ,  G06T2207/20208 ,  G06T2207/20221

Abstract: A method includes obtaining multiple input image frames and generating a high dynamic range (HDR) blended image based on the input image frames, where the HIDR blended image has a higher dynamic range than individual ones of the input image frames. The method also includes performing a tone fusion operation on the HIDR blended image based on a semantic delta-weight map to generate a fused image. Performing the tone fusion operation includes synthesizing multiple low dynamic range (LDR) images based on the HIDR blended image and generating initial weight maps based on the LDR images. Performing the tone fusion operation also includes generating filtered weight maps based on the initial weight maps, the semantic delta-weight map, and a guided filter. Performing the tone fusion operation further includes generating the fused image based on the filtered weight maps and decomposed versions of the LDR images.

公开(公告)号：US20240135673A1

公开(公告)日：2024-04-25

申请号：US18049213

申请日：2022-10-23

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibo Xu ,  Weidi Liu ,  Hamid R. Sheikh ,  John Seokjun Lee

IPC: G06V10/70 ,  G06T5/00 ,  G06V10/60

CPC classification number: G06V10/70 ,  G06T5/003 ,  G06V10/60

Abstract: A method includes obtaining an under-display camera (UDC) image captured using a camera located under a display. The method also includes processing, using at least one processing device of an electronic device, the UDC image based on a machine learning model to restore the UDC image. The method further includes displaying or storing the restored image corresponding to the UDC image. The machine learning model is trained using (i) a ground truth image and (ii) a synthetic image generated using the ground truth image and a point spread function that is based on an optical transmission model of the display.

公开(公告)号：US20240062342A1

公开(公告)日：2024-02-22

申请号：US17820795

申请日：2022-08-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Devendra K. Jangid ,  John Seokjun Lee ,  Hamid R. Sheikh

IPC: G06T5/00

CPC classification number: G06T5/002 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: A method includes obtaining an input image that contains blur. The method also includes providing the input image to a trained machine learning model, where the trained machine learning model includes (i) a shallow feature extractor configured to extract one or more feature maps from the input image and (ii) a deep feature extractor configured to extract deep features from the one or more feature maps. The method further includes using the trained machine learning model to generate a sharpened output image. The trained machine learning model is trained using ground truth training images and input training images, where the input training images include versions of the ground truth training images with blur created using demosaic and noise filtering operations.

公开(公告)号：US20230254591A1

公开(公告)日：2023-08-10

申请号：US18059822

申请日：2022-11-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Nguyen Thang Long Le ,  Zeeshan Nadir ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: H04N23/745 ,  G06T5/50 ,  G06T7/11 ,  G06V10/44 ,  G06V10/74

CPC classification number: H04N23/745 ,  G06T5/50 ,  G06T7/11 ,  G06V10/44 ,  G06V10/761 ,  G06T2207/10144 ,  G06T2207/20224

Abstract: A method includes obtaining multiple image frames. The method also includes selecting, using at least one processing device of an electronic device, an asymmetrical image pair from the multiple image frames. The asymmetrical image pair includes a first image frame and a second image frame, where the first image frame has a shorter exposure than the second image frame. The method further includes identifying, using the at least one processing device, one or more features based on the asymmetrical image pair. The method also includes determining, using the at least one processing device, whether the first image frame contains flicker based on the one or more features. In addition, the method includes enabling or disabling, using the at least one processing device, the first image frame as a reference candidate based on the determination whether the first image frame contains flicker.

公开(公告)号：US20230252770A1

公开(公告)日：2023-08-10

申请号：US18045558

申请日：2022-10-11

Applicant: Samsung Electronics Co., Ltd.

Inventor： Tyler Luu ,  John W. Glotzbach ,  Hamid R. Sheikh ,  John Seokjun Lee ,  Youngmin Kim ,  Jun Ki Cho ,  Seung-Chul Jeon

IPC: G06V10/774 ,  G06T5/00 ,  G06T5/50 ,  G06V10/24

CPC classification number: G06V10/7747 ,  G06T5/002 ,  G06T5/006 ,  G06T5/50 ,  G06V10/24 ,  G06T2207/10144 ,  G06T2207/20081 ,  G06T2207/20221

Abstract: A method for training data generation includes obtaining a first set of image frames of a scene and a second set of image frames of the scene using multiple exposure settings. The method also includes generating an alignment map, a blending map, and an input image using the first set of image frames. The method further includes generating a ground truth image using the alignment map, the blending map, and the second set of image frames. In addition, the method includes using the ground truth image and the input image as an image pair in a training dataset when training a machine learning model to reduce image distortion and noise.