-
公开(公告)号:US20230245328A1
公开(公告)日:2023-08-03
申请号:US17590998
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Yingmao Li , Chenchi Luo , Gyeongmin Choe , John Seokjun Lee
IPC: G06T7/269
CPC classification number: G06T7/269 , G06T2207/10016 , G06T2207/20081
Abstract: A method includes obtaining a first optical flow vector representing motion between consecutive video frames during a previous time step. The method also includes generating a first predicted optical flow vector from the first optical flow vector using a trained prediction model, where the first predicted optical flow vector represents predicted motion during a current time step. The method further includes refining the first predicted optical flow vector using a trained update model to generate a second optical flow vector representing motion during the current time step. The trained update model uses the first predicted optical flow vector, a video frame of the previous time step, and a video frame of the current time step to generate the second optical flow vector.
-
公开(公告)号:US12200398B2
公开(公告)日:2025-01-14
申请号:US17591040
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: H04N7/01 , G06T1/00 , G06T3/18 , G06T5/50 , G06T7/207 , H04N1/32 , H04N19/139 , H04N19/577
Abstract: An apparatus includes at least one processing device configured to obtain input frames from a video. The at least one processing device is also configured to generate a forward flow from a first input frame to a second input frame and a backward flow from the second input frame to the first input frame. The at least one processing device is further configured to generate an occlusion map at an interpolated frame coordinate using the forward flow and the backward flow. The at least one processing device is also configured to generate a consistency map at the interpolated frame coordinate using the forward flow and the backward flow. In addition, the at least one processing device is configured to perform blending using the occlusion map and the consistency map to generate an interpolated frame at the interpolated frame coordinate.
-
3.
公开(公告)号:US20220301184A1
公开(公告)日:2022-09-22
申请号:US17591350
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: G06T7/207 , H04N19/577 , H04N19/139
Abstract: A method includes obtaining multiple video frames. The method also includes determining whether a bi-directional optical flow between the multiple video frames satisfies an image quality criterion for bi-directional consistency. The method further includes identifying a non-linear curve based on pixel coordinate values from at least two of the video frames. The at least two video frames include first and second video frames. The method also includes generating interpolated video frames between the first and second video frames by applying non-linear interpolation based on the non-linear curve. In addition, the method includes outputting the interpolated video frames for presentation.
-
4.
公开(公告)号:US12192673B2
公开(公告)日:2025-01-07
申请号:US17591350
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: H04N7/01 , G06T1/00 , G06T3/18 , G06T5/50 , G06T7/207 , H04N1/32 , H04N19/139 , H04N19/577
Abstract: A method includes obtaining multiple video frames. The method also includes determining whether a bi-directional optical flow between the multiple video frames satisfies an image quality criterion for bi-directional consistency. The method further includes identifying a non-linear curve based on pixel coordinate values from at least two of the video frames. The at least two video frames include first and second video frames. The method also includes generating interpolated video frames between the first and second video frames by applying non-linear interpolation based on the non-linear curve. In addition, the method includes outputting the interpolated video frames for presentation.
-
公开(公告)号:US11720782B2
公开(公告)日:2023-08-08
申请号:US17135573
申请日:2020-12-28
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Gyeongmin Choe , Yingmao Li , Zeeshan Nadir , Hamid R. Sheikh , John Seokjun Lee , Youngjun Yoo
CPC classification number: G06N3/045 , G06N3/042 , G06N3/08 , G06T7/44 , G06T7/60 , G06T2207/10024 , G06T2207/20081
Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple calibration parameters associated with multiple sensors of a selected mobile device. The method also includes obtaining, using the at least one processor, an identification of multiple imaging tasks. The method further includes obtaining, using the at least one processor, multiple synthetically-generated scene images. In addition, the method includes generating, using the at least one processor, multiple training images and corresponding meta information based on the calibration parameters, the identification of the imaging tasks, and the scene images. The training images and corresponding meta information are generated concurrently, different ones of the training images correspond to different ones of the sensors, and different pieces of the meta information correspond to different ones of the imaging tasks.
-
公开(公告)号:US12148175B2
公开(公告)日:2024-11-19
申请号:US17590998
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Yingmao Li , Chenchi Luo , Gyeongmin Choe , John Seokjun Lee
IPC: G06T7/269
Abstract: A method includes obtaining a first optical flow vector representing motion between consecutive video frames during a previous time step. The method also includes generating a first predicted optical flow vector from the first optical flow vector using a trained prediction model, where the first predicted optical flow vector represents predicted motion during a current time step. The method further includes refining the first predicted optical flow vector using a trained update model to generate a second optical flow vector representing motion during the current time step. The trained update model uses the first predicted optical flow vector, a video frame of the previous time step, and a video frame of the current time step to generate the second optical flow vector.
-
公开(公告)号:US20220303495A1
公开(公告)日:2022-09-22
申请号:US17591040
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
Abstract: An apparatus includes at least one processing device configured to obtain input frames from a video. The at least one processing device is also configured to generate a forward flow from a first input frame to a second input frame and a backward flow from the second input frame to the first input frame. The at least one processing device is further configured to generate an occlusion map at an interpolated frame coordinate using the forward flow and the backward flow. The at least one processing device is also configured to generate a consistency map at the interpolated frame coordinate using the forward flow and the backward flow. In addition, the at least one processing device is configured to perform blending using the occlusion map and the consistency map to generate an interpolated frame at the interpolated frame coordinate.
-
公开(公告)号:US11297244B2
公开(公告)日:2022-04-05
申请号:US16947274
申请日:2020-07-27
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Hamid R. Sheikh , John SeokJun Lee , Youngjun Yoo
Abstract: A method includes receiving a selection of a selected zoom area on an input image frame displayed on a user interface; determining one or more candidate zoom previews proximate to the selected zoom area using a saliency detecting algorithm; and displaying the one or more candidate zoom previews on the user interface adjacent to the selected zoom area.
-
公开(公告)号:US20210390375A1
公开(公告)日:2021-12-16
申请号:US17135573
申请日:2020-12-28
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Gyeongmin Choe , Yingmao Li , Zeeshan Nadir , Hamid R. Sheikh , John Seokjun Lee , Youngjun Yoo
Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple calibration parameters associated with multiple sensors of a selected mobile device. The method also includes obtaining, using the at least one processor, an identification of multiple imaging tasks. The method further includes obtaining, using the at least one processor, multiple synthetically-generated scene images. In addition, the method includes generating, using the at least one processor, multiple training images and corresponding meta information based on the calibration parameters, the identification of the imaging tasks, and the scene images. The training images and corresponding meta information are generated concurrently, different ones of the training images correspond to different ones of the sensors, and different pieces of the meta information correspond to different ones of the imaging tasks.
-
公开(公告)号:US11132772B2
公开(公告)日:2021-09-28
申请号:US16712882
申请日:2019-12-12
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yingmao Li , Youngjun Yoo , George Q. Chen , Kaimo Lin , David D. Liu , Gyeongmin Choe
IPC: G06T5/00 , G06T7/80 , H04N13/128
Abstract: A method includes obtaining a first image of a scene using a first image sensor of an electronic device and a second image of the scene using a second image sensor of the electronic device. The method also includes generating a first feature map from the first image and a second feature map from the second image. The method further includes generating a third feature map based on the first feature map, the second feature map, and an asymmetric search window. The method additionally includes generating a depth map by restoring spatial resolution to the third feature map.
-
-
-
-
-
-
-
-
-