-
公开(公告)号:US12200398B2
公开(公告)日:2025-01-14
申请号:US17591040
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: H04N7/01 , G06T1/00 , G06T3/18 , G06T5/50 , G06T7/207 , H04N1/32 , H04N19/139 , H04N19/577
Abstract: An apparatus includes at least one processing device configured to obtain input frames from a video. The at least one processing device is also configured to generate a forward flow from a first input frame to a second input frame and a backward flow from the second input frame to the first input frame. The at least one processing device is further configured to generate an occlusion map at an interpolated frame coordinate using the forward flow and the backward flow. The at least one processing device is also configured to generate a consistency map at the interpolated frame coordinate using the forward flow and the backward flow. In addition, the at least one processing device is configured to perform blending using the occlusion map and the consistency map to generate an interpolated frame at the interpolated frame coordinate.
-
公开(公告)号:US20230252608A1
公开(公告)日:2023-08-10
申请号:US17666166
申请日:2022-02-07
Applicant: Samsung Electronics Co., Ltd.
Inventor: Yingmao Li , Hamid R. Sheikh , John Seokjun Lee , Youngmin Kim , Jun Ki Cho , Seung-Chul Jeon
IPC: G06T5/00
CPC classification number: G06T5/005 , G06T2207/20081 , G06T2207/10144 , G06T2207/20084
Abstract: A method includes obtaining, using a stationary sensor of an electronic device, multiple image frames including first and second image frames. The method also includes generating, using multiple previously generated motion vectors, a first motion-distorted image frame using the first image frame and a second motion-distorted image frame using the second image frame. The method further includes adding noise to the motion-distorted image frames to generate first and second noisy motion-distorted image frames. The method also includes performing (i) a first multi-frame processing (MFP) operation to generate a ground truth image using the motion-distorted image frames and (ii) a second MFP operation to generate an input image using the noisy motion-distorted image frames. In addition, the method includes storing the ground truth and input images as an image pair for training an artificial intelligence/machine learning (AI/ML)-based image processing operation for removing image distortions caused by handheld image capture.
-
3.
公开(公告)号:US20220301184A1
公开(公告)日:2022-09-22
申请号:US17591350
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: G06T7/207 , H04N19/577 , H04N19/139
Abstract: A method includes obtaining multiple video frames. The method also includes determining whether a bi-directional optical flow between the multiple video frames satisfies an image quality criterion for bi-directional consistency. The method further includes identifying a non-linear curve based on pixel coordinate values from at least two of the video frames. The at least two video frames include first and second video frames. The method also includes generating interpolated video frames between the first and second video frames by applying non-linear interpolation based on the non-linear curve. In addition, the method includes outputting the interpolated video frames for presentation.
-
公开(公告)号:US11195259B2
公开(公告)日:2021-12-07
申请号:US16703712
申请日:2019-12-04
Applicant: Samsung Electronics Co., Ltd.
Inventor: Yingmao Li , Chenchi Luo , George Q. Chen , Youngjun Yoo
Abstract: A method includes obtaining, using first and second image sensors of an electronic device, first and second images, respectively, of a scene. The method also includes obtaining, using an image depth sensor of the electronic device, a third image and a first depth map of the scene, the first depth map having a resolution lower than a resolution of the first and second images. The method further includes undistorting the first and second images using the third image and the first depth map. The method also includes rectifying the first and second images using the third image and the first depth map. The method further includes generating a disparity map using the first and second images that have been undistorted and rectified. In addition, the method includes generating a second depth map using the disparity map and the first depth map, where the second depth map has a resolution that is higher than the resolution of the first depth map.
-
公开(公告)号:US20210281813A1
公开(公告)日:2021-09-09
申请号:US16811585
申请日:2020-03-06
Applicant: Samsung Electronics Co., Ltd.
Inventor: Kushal K. Vyas , Yingmao Li , Chenchi Luo , George Q. Chen , Hamid R. Sheikh , Youngjun Yoo , Michael O. Polley
IPC: H04N13/128 , G06T3/40 , G06T5/00 , G06T5/50
Abstract: A method includes obtaining, using at least one processor, first and second input image frames, where the first and second input image frames are associated with first and second image planes, respectively. The method also includes obtaining, using the at least one processor, a depth map associated with the first input image frame. The method further includes producing another version of the depth map by performing one or more times: (a) projecting, using the at least one processor, the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane and (b) adjusting, using the at least one processor, at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.
-
公开(公告)号:US20230245328A1
公开(公告)日:2023-08-03
申请号:US17590998
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Yingmao Li , Chenchi Luo , Gyeongmin Choe , John Seokjun Lee
IPC: G06T7/269
CPC classification number: G06T7/269 , G06T2207/10016 , G06T2207/20081
Abstract: A method includes obtaining a first optical flow vector representing motion between consecutive video frames during a previous time step. The method also includes generating a first predicted optical flow vector from the first optical flow vector using a trained prediction model, where the first predicted optical flow vector represents predicted motion during a current time step. The method further includes refining the first predicted optical flow vector using a trained update model to generate a second optical flow vector representing motion during the current time step. The trained update model uses the first predicted optical flow vector, a video frame of the previous time step, and a video frame of the current time step to generate the second optical flow vector.
-
公开(公告)号:US11631163B2
公开(公告)日:2023-04-18
申请号:US16946989
申请日:2020-07-14
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yingmao Li , Youngjun Yoo
Abstract: A method includes processing, using at least one processor of an electronic device, each of multiple images using a photometric augmentation engine, where the photometric augmentation engine performs one or more photometric augmentation operations. The method also includes applying, using the at least one processor, multiple layers of a convolutional neural network to each of the images, where each layer generates a corresponding feature map. The method further includes processing, using the at least one processor, at least one of the feature maps using at least one feature augmentation engine between consecutive layers of the multiple layers, where the at least one feature augmentation engine performs one or more feature augmentation operations.
-
公开(公告)号:US11556784B2
公开(公告)日:2023-01-17
申请号:US16693112
申请日:2019-11-22
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yingmao Li , Youngjun Yoo
Abstract: A method includes identifying, by at least one processor, multiple features of input data using a common feature extractor. The method also includes processing, by the at least one processor, at least some identified features using each of multiple pre-processing branches. Each pre-processing branch includes a first set of neural network layers and generates initial outputs associated with a different one of multiple data processing tasks. The method further includes combining, by the at least one processor, at least two initial outputs from at least two pre-processing branches to produce combined initial outputs. In addition, the method includes processing, by the at least one processor, at least some initial outputs or at least some combined initial outputs using each of multiple post-processing branches. Each post-processing branch includes a second set of neural network layers and generates final outputs associated with a different one of the multiple data processing tasks.
-
公开(公告)号:US11503266B2
公开(公告)日:2022-11-15
申请号:US16811585
申请日:2020-03-06
Applicant: Samsung Electronics Co., Ltd.
Inventor: Kushal Kardam Vyas , Yingmao Li , Chenchi Luo , George Q. Chen , Hamid R. Sheikh , Youngjun Yoo , Michael O. Polley
IPC: H04N13/128 , G06T3/40 , G06T5/00 , G06T5/50 , H04N13/00
Abstract: A method includes obtaining, using at least one processor, first and second input image frames, where the first and second input image frames are associated with first and second image planes, respectively. The method also includes obtaining, using the at least one processor, a depth map associated with the first input image frame. The method further includes producing another version of the depth map by performing one or more times: (a) projecting, using the at least one processor, the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane and (b) adjusting, using the at least one processor, at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.
-
公开(公告)号:US20210248769A1
公开(公告)日:2021-08-12
申请号:US17027106
申请日:2020-09-21
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yingmao Li , Kaimo Lin , Youngjun Yoo
IPC: G06T7/593 , H04N13/271 , H04N13/128
Abstract: A method includes obtaining at least three input image frames of a scene captured using at least three imaging sensors. The input image frames include a reference image frame and multiple non-reference image frames. The method also includes generating multiple disparity maps using the input image frames. Each disparity map is associated with the reference image frame and a different non-reference image frame. The method further includes generating multiple confidence maps using the input image frames. Each confidence map identifies weights associated with one of the disparity maps. In addition, the method includes generating a depth map of the scene using the disparity maps and the confidence maps. The imaging sensors are arranged to define multiple baseline directions, where each baseline direction extends between the imaging sensor used to capture the reference image frame and the imaging sensor used to capture a different non-reference image frame.
-
-
-
-
-
-
-
-
-