-
公开(公告)号:US20250166129A1
公开(公告)日:2025-05-22
申请号:US18516277
申请日:2023-11-21
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gunawath Dilshan Godaliyadda , Abhiram Gnanasambandam , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: G06T5/50 , G06T7/00 , H04N5/265 , H04N23/667 , H04N23/80
Abstract: A method includes obtaining, using a multi-mode image sensor, first image frames and second image frames. The first image frames include image data having a first bit depth, and the second image frames include image data having a second bit depth smaller than the first bit depth. The first image frames are captured using two or more exposure times, and the second image frames are captured using at least one exposure time shorter than the two or more exposure times. At least one of the second image frames is captured in between each consecutive pair of the first image frames. The method also includes providing at least the first image frames to a multi-frame processing (MFP) pipeline and processing at least the first image frames using the MFP pipeline to generate an output image.
-
42.
公开(公告)号:US12272032B2
公开(公告)日:2025-04-08
申请号:US17820795
申请日:2022-08-18
Applicant: Samsung Electronics Co., Ltd.
Inventor: Devendra K. Jangid , John Seokjun Lee , Hamid R. Sheikh
IPC: G06T5/70
Abstract: A method includes obtaining an input image that contains blur. The method also includes providing the input image to a trained machine learning model, where the trained machine learning model includes (i) a shallow feature extractor configured to extract one or more feature maps from the input image and (ii) a deep feature extractor configured to extract deep features from the one or more feature maps. The method further includes using the trained machine learning model to generate a sharpened output image. The trained machine learning model is trained using ground truth training images and input training images, where the input training images include versions of the ground truth training images with blur created using demosaic and noise filtering operations.
-
公开(公告)号:US12230053B2
公开(公告)日:2025-02-18
申请号:US17591530
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Zeeshan Nadir , John W. Glotzbach , Hamid R. Sheikh
Abstract: An apparatus includes a memory configured to store images and a processor. The processor is configured to receive an input image. The processor is further configured to partition a human mask in the input image using a segmentation algorithm. The processor is also configured to generate a skin map based on identifying skin in the input image using the human mask. In addition, the processor is configured to process an output image with brightening applied using the skin map.
-
公开(公告)号:US20240420341A1
公开(公告)日:2024-12-19
申请号:US18334931
申请日:2023-06-14
Applicant: Samsung Electronics Co., Ltd.
Inventor: Yahang Li , Nguyen Thang Long Le , Hamid R. Sheikh
Abstract: A method includes obtaining multiple training image frames of a scene, where the training image frames are captured at multiple viewpoints and multiple viewing angles relative to the scene. The method also includes generating multiple initial motion maps using the training image frames and identifying three-dimensional (3D) feature points associated with the scene using the training image frames. The method further includes generating tuned motion masks using the initial motion maps and projections of the 3D feature points onto the initial motion maps. In addition, the method includes training a machine learning model using the training image frames and the tuned motion masks, where the machine learning model is trained to generate 3D information about the scene from viewpoints and viewing angles not captured in the training image frames.
-
45.
公开(公告)号:US12094086B2
公开(公告)日:2024-09-17
申请号:US17587309
申请日:2022-01-28
Applicant: Samsung Electronics Co., Ltd.
Inventor: Long N. Le , Hamid R. Sheikh , John W. Glotzbach
CPC classification number: G06T5/50 , G06T5/73 , G06T2207/10024 , G06T2207/20221
Abstract: A method includes obtaining multiple images of a scene using at least one red-green-blue-white (RGBW) image sensor. The method also includes generating multi-channel frames at different exposure levels from the images. The method further includes estimating motion across exposure differences between the different exposure levels using a white channel of the multi-channel frames as a guidance signal to generate multiple motion maps. The method also includes estimating saturation across the exposure differences between the different exposure levels to generate multiple saturation maps. The method further includes using the generated motion maps and saturation maps to recover saturations from the different exposure levels and generate a saturation-free RGBW frame. In addition, the method includes processing the saturation-free RGBW frame to generate a final image of the scene.
-
公开(公告)号:US11727540B2
公开(公告)日:2023-08-15
申请号:US17139880
申请日:2020-12-31
Applicant: Samsung Electronics Co., Ltd.
Inventor: Zhen Tong , Yibo Xu , John W. Glotzbach , Hamid R. Sheikh , Ruiwen Zhen , Baekdu Choi
CPC classification number: G06T5/003 , G06T5/002 , G06T5/009 , G06T5/20 , G06T5/50 , G06T7/13 , G06T2207/20192 , G06T2207/20208 , G06T2207/20221
Abstract: Various image sharpening techniques are disclosed. For example, a method for image sharpening includes obtaining, using at least one sensor of an electronic device, an image that includes visual content. The method also includes generating an edge map that indicates edges of the visual content within the image. The method further includes applying a high-pass signal and an adaptive gain based on the edge map to sharpen the image. The method also includes generating a bright halo mask and a dark halo mask based on the edge map, where the bright halo mask indicates an upper sharpening limit and the dark halo mask indicates a lower sharpening limit. In addition, the method includes modifying a level of sharpening at one or more of the edges within the sharpened image to provide halo artifact reduction based on the bright halo mask and the dark halo mask.
-
公开(公告)号:US11503221B2
公开(公告)日:2022-11-15
申请号:US16837785
申请日:2020-04-01
Applicant: Samsung Electronics Co., Ltd.
Inventor: Anqi Yang , John W. Glotzbach , Hamid R. Sheikh
Abstract: A method includes obtaining, using at least one image sensor of an electronic device, a first image frame and multiple second image frames of a scene. Each of the second image frames has an exposure time different from an exposure time of the first image frame. The method also includes encoding, using at least one processor, each of the first image frame and the second image frames using a convolutional neural network to generate a corresponding feature map. The method further includes aligning, using the at least one processor, encoded features of the feature map corresponding to the first image frame with encoded features of the feature maps corresponding to the second image frames.
-
公开(公告)号:US20220337747A1
公开(公告)日:2022-10-20
申请号:US17810213
申请日:2022-06-30
Applicant: Samsung Electronics Co., Ltd.
Inventor: Hamid R. Sheikh , Youngjun Yoo , John Seokjun Lee , Michael O. Polley
Abstract: A method for operating an electronic device includes capturing, by an image sensor module, a stream from a pixel array. The method also includes processing, by the image sensor module, the stream to generate a preview stream and a full frame stream. The method further includes compressing, by the image sensor module, the preview stream using a first compression and the full frame stream using a second compression. In addition, the method includes outputting, by the image sensor module, the compressed preview stream and the compressed full frame stream.
-
公开(公告)号:US20220303495A1
公开(公告)日:2022-09-22
申请号:US17591040
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
Abstract: An apparatus includes at least one processing device configured to obtain input frames from a video. The at least one processing device is also configured to generate a forward flow from a first input frame to a second input frame and a backward flow from the second input frame to the first input frame. The at least one processing device is further configured to generate an occlusion map at an interpolated frame coordinate using the forward flow and the backward flow. The at least one processing device is also configured to generate a consistency map at the interpolated frame coordinate using the forward flow and the backward flow. In addition, the at least one processing device is configured to perform blending using the occlusion map and the consistency map to generate an interpolated frame at the interpolated frame coordinate.
-
公开(公告)号:US11297244B2
公开(公告)日:2022-04-05
申请号:US16947274
申请日:2020-07-27
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Hamid R. Sheikh , John SeokJun Lee , Youngjun Yoo
Abstract: A method includes receiving a selection of a selected zoom area on an input image frame displayed on a user interface; determining one or more candidate zoom previews proximate to the selected zoom area using a saliency detecting algorithm; and displaying the one or more candidate zoom previews on the user interface adjacent to the selected zoom area.
-
-
-
-
-
-
-
-
-