-
11.
公开(公告)号:US12192673B2
公开(公告)日:2025-01-07
申请号:US17591350
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: H04N7/01 , G06T1/00 , G06T3/18 , G06T5/50 , G06T7/207 , H04N1/32 , H04N19/139 , H04N19/577
Abstract: A method includes obtaining multiple video frames. The method also includes determining whether a bi-directional optical flow between the multiple video frames satisfies an image quality criterion for bi-directional consistency. The method further includes identifying a non-linear curve based on pixel coordinate values from at least two of the video frames. The at least two video frames include first and second video frames. The method also includes generating interpolated video frames between the first and second video frames by applying non-linear interpolation based on the non-linear curve. In addition, the method includes outputting the interpolated video frames for presentation.
-
12.
公开(公告)号:US11720782B2
公开(公告)日:2023-08-08
申请号:US17135573
申请日:2020-12-28
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Gyeongmin Choe , Yingmao Li , Zeeshan Nadir , Hamid R. Sheikh , John Seokjun Lee , Youngjun Yoo
CPC classification number: G06N3/045 , G06N3/042 , G06N3/08 , G06T7/44 , G06T7/60 , G06T2207/10024 , G06T2207/20081
Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple calibration parameters associated with multiple sensors of a selected mobile device. The method also includes obtaining, using the at least one processor, an identification of multiple imaging tasks. The method further includes obtaining, using the at least one processor, multiple synthetically-generated scene images. In addition, the method includes generating, using the at least one processor, multiple training images and corresponding meta information based on the calibration parameters, the identification of the imaging tasks, and the scene images. The training images and corresponding meta information are generated concurrently, different ones of the training images correspond to different ones of the sensors, and different pieces of the meta information correspond to different ones of the imaging tasks.
-
13.
公开(公告)号:US11532091B2
公开(公告)日:2022-12-20
申请号:US16946956
申请日:2020-07-13
Applicant: Samsung Electronics Co., Ltd.
Inventor: Kushal Kardam Vyas , Yingmao Li , Chenchi Luo , George Q. Chen , Hamid R. Sheikh , Youngjun Yoo , Michael O. Polley
Abstract: A method includes obtaining, using at least one processor, an input image frame. The method also includes identifying, using the at least one processor, one or more regions of the input image frame containing redundant information. In addition, the method includes performing, using the at least one processor, an image processing task using the input image frame. The image processing task is guided based on the one or more identified regions of the input image frame. The method may further include obtaining, using the at least one processor, a coarse depth map associated with the input image frame. Performing the image processing task may include refining the coarse depth map to produce a refined depth map, where the refining of the coarse depth map is guided based on the one or more identified regions of the input image frame.
-
公开(公告)号:US20210248722A1
公开(公告)日:2021-08-12
申请号:US16946989
申请日:2020-07-14
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yingmao Li , Youngjun Yoo
Abstract: A method includes processing, using at least one processor of an electronic device, each of multiple images using a photometric augmentation engine, where the photometric augmentation engine performs one or more photometric augmentation operations. The method also includes applying, using the at least one processor, multiple layers of a convolutional neural network to each of the images, where each layer generates a corresponding feature map. The method further includes processing, using the at least one processor, at least one of the feature maps using at least one feature augmentation engine between consecutive layers of the multiple layers, where the at least one feature augmentation engine performs one or more feature augmentation operations.
-
公开(公告)号:US20210174479A1
公开(公告)日:2021-06-10
申请号:US16703712
申请日:2019-12-04
Applicant: Samsung Electronics Co., Ltd.
Inventor: Yingmao Li , Chenchi Luo , George Q. Chen , Youngjun Yoo
Abstract: A method includes obtaining, using first and second image sensors of an electronic device, first and second images, respectively, of a scene. The method also includes obtaining, using an image depth sensor of the electronic device, a third image and a first depth map of the scene, the first depth map having a resolution lower than a resolution of the first and second images. The method further includes undistorting the first and second images using the third image and the first depth map. The method also includes rectifying the first and second images using the third image and the first depth map. The method further includes generating a disparity map using the first and second images that have been undistorted and rectified. In addition, the method includes generating a second depth map using the disparity map and the first depth map, where the second depth map has a resolution that is higher than the resolution of the first depth map.
-
公开(公告)号:US20210158142A1
公开(公告)日:2021-05-27
申请号:US16693112
申请日:2019-11-22
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yingmao Li , Youngjun Yoo
Abstract: A method includes identifying, by at least one processor, multiple features of input data using a common feature extractor. The method also includes processing, by the at least one processor, at least some identified features using each of multiple pre-processing branches. Each pre-processing branch includes a first set of neural network layers and generates initial outputs associated with a different one of multiple data processing tasks. The method further includes combining, by the at least one processor, at least two initial outputs from at least two pre-processing branches to produce combined initial outputs. In addition, the method includes processing, by the at least one processor, at least some initial outputs or at least some combined initial outputs using each of multiple post-processing branches. Each post-processing branch includes a second set of neural network layers and generates final outputs associated with a different one of the multiple data processing tasks.
-
公开(公告)号:US12079971B2
公开(公告)日:2024-09-03
申请号:US17666166
申请日:2022-02-07
Applicant: Samsung Electronics Co., Ltd.
Inventor: Yingmao Li , Hamid R. Sheikh , John Seokjun Lee , Youngmin Kim , Jun Ki Cho , Seung-Chul Jeon
CPC classification number: G06T5/77 , G06T2207/10144 , G06T2207/20081 , G06T2207/20084
Abstract: A method includes obtaining, using a stationary sensor of an electronic device, multiple image frames including first and second image frames. The method also includes generating, using multiple previously generated motion vectors, a first motion-distorted image frame using the first image frame and a second motion-distorted image frame using the second image frame. The method further includes adding noise to the motion-distorted image frames to generate first and second noisy motion-distorted image frames. The method also includes performing (i) a first multi-frame processing (MFP) operation to generate a ground truth image using the motion-distorted image frames and (ii) a second MFP operation to generate an input image using the noisy motion-distorted image frames. In addition, the method includes storing the ground truth and input images as an image pair for training an artificial intelligence/machine learning (AI/ML)-based image processing operation for removing image distortions caused by handheld image capture.
-
公开(公告)号:US11823353B2
公开(公告)日:2023-11-21
申请号:US17106676
申请日:2020-11-30
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yingmao Li , Kaimo Lin , Youngjun Yoo
CPC classification number: G06T5/002 , G06N3/08 , G06T5/50 , G06T7/593 , G06T2207/10012 , G06T2207/20081 , G06T2207/20084
Abstract: A method includes processing, using at least one processor of an electronic device, multiple reference images of a scene using a first convolutional neural network (CNN) to generate a confidence map and a disparity map. The method also includes generating, using the at least one processor, an initial Bokeh image based on the disparity map and the reference images using a depth-of-field (DoF) renderer. The method further includes refining, using the at least one processor, the initial Bokeh image using a second CNN to generate a refined Bokeh image, where the second CNN uses the confidence map, the disparity map, and the reference images to generate the refined Bokeh image.
-
公开(公告)号:US20220036513A1
公开(公告)日:2022-02-03
申请号:US17106676
申请日:2020-11-30
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yingmao Li , Kaimo Lin , Youngjun Yoo
Abstract: A method includes processing, using at least one processor of an electronic device, multiple reference images of a scene using a first convolutional neural network (CNN) to generate a confidence map and a disparity map. The method also includes generating, using the at least one processor, an initial Bokeh image based on the disparity map and the reference images using a depth-of-field (DoF) renderer. The method further includes refining, using the at least one processor, the initial Bokeh image using a second CNN to generate a refined Bokeh image, where the second CNN uses the confidence map, the disparity map, and the reference images to generate the refined Bokeh image.
-
20.
公开(公告)号:US20210390375A1
公开(公告)日:2021-12-16
申请号:US17135573
申请日:2020-12-28
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Gyeongmin Choe , Yingmao Li , Zeeshan Nadir , Hamid R. Sheikh , John Seokjun Lee , Youngjun Yoo
Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple calibration parameters associated with multiple sensors of a selected mobile device. The method also includes obtaining, using the at least one processor, an identification of multiple imaging tasks. The method further includes obtaining, using the at least one processor, multiple synthetically-generated scene images. In addition, the method includes generating, using the at least one processor, multiple training images and corresponding meta information based on the calibration parameters, the identification of the imaging tasks, and the scene images. The training images and corresponding meta information are generated concurrently, different ones of the training images correspond to different ones of the sensors, and different pieces of the meta information correspond to different ones of the imaging tasks.
-
-
-
-
-
-
-
-
-