公开(公告)号：US20210342998A1

公开(公告)日：2021-11-04

申请号：US17246163

申请日：2021-04-30

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingmao Li ,  Chenchi Luo ,  Youngjun Yoo

IPC: G06T7/00 ,  G06T7/215 ,  G06T7/246 ,  G06T7/579 ,  G06T11/00 ,  G06T3/00 ,  G06T7/254

Abstract: A method includes obtaining at least one image and a ground truth map associated with the at least one image. The method also includes generating multiple optical maps using multiple algorithms and the at least one image. The method further includes, for each algorithm, identifying at least one score for the algorithm using one or more of the optical maps generated using the algorithm and the ground truth map. The ground truth map identifies one or more boundaries associated with one or more foreground objects in the at least one image. The scores identify how well the optical maps generated using the algorithms separate the one or more foreground objects from a background in the at least one image.

公开(公告)号：US11132772B2

公开(公告)日：2021-09-28

申请号：US16712882

申请日：2019-12-12

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chenchi Luo ,  Yingmao Li ,  Youngjun Yoo ,  George Q. Chen ,  Kaimo Lin ,  David D. Liu ,  Gyeongmin Choe

IPC: G06T5/00 ,  G06T7/80 ,  H04N13/128

Abstract: A method includes obtaining a first image of a scene using a first image sensor of an electronic device and a second image of the scene using a second image sensor of the electronic device. The method also includes generating a first feature map from the first image and a second feature map from the second image. The method further includes generating a third feature map based on the first feature map, the second feature map, and an asymmetric search window. The method additionally includes generating a depth map by restoring spatial resolution to the third feature map.

公开(公告)号：US12148175B2

公开(公告)日：2024-11-19

申请号：US17590998

申请日：2022-02-02

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingmao Li ,  Chenchi Luo ,  Gyeongmin Choe ,  John Seokjun Lee

IPC: G06T7/269

Abstract: A method includes obtaining a first optical flow vector representing motion between consecutive video frames during a previous time step. The method also includes generating a first predicted optical flow vector from the first optical flow vector using a trained prediction model, where the first predicted optical flow vector represents predicted motion during a current time step. The method further includes refining the first predicted optical flow vector using a trained update model to generate a second optical flow vector representing motion during the current time step. The trained update model uses the first predicted optical flow vector, a video frame of the previous time step, and a video frame of the current time step to generate the second optical flow vector.

公开(公告)号：US11847771B2

公开(公告)日：2023-12-19

申请号：US17246163

申请日：2021-04-30

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingmao Li ,  Chenchi Luo ,  Youngjun Yoo

IPC: G06T7/00 ,  G06T7/215 ,  G06T7/246 ,  G06T7/579 ,  G06T3/00 ,  G06T7/254 ,  G06T11/00

CPC classification number: G06T7/0002 ,  G06T3/0093 ,  G06T7/215 ,  G06T7/248 ,  G06T7/254 ,  G06T7/579 ,  G06T11/00 ,  G06T2207/20081 ,  G06T2207/30168

Abstract: A method includes obtaining at least one image and a ground truth map associated with the at least one image. The method also includes generating multiple optical maps using multiple algorithms and the at least one image. The method further includes, for each algorithm, identifying at least one score for the algorithm using one or more of the optical maps generated using the algorithm and the ground truth map. The ground truth map identifies one or more boundaries associated with one or more foreground objects in the at least one image. The scores identify how well the optical maps generated using the algorithms separate the one or more foreground objects from a background in the at least one image.

公开(公告)号：US11816855B2

公开(公告)日：2023-11-14

申请号：US17027106

申请日：2020-09-21

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chenchi Luo ,  Yingmao Li ,  Kaimo Lin ,  Youngjun Yoo

IPC: G06T7/593 ,  H04N13/271 ,  H04N13/128 ,  H04N13/00

CPC classification number: G06T7/593 ,  H04N13/128 ,  H04N13/271 ,  G06T2207/10028 ,  H04N2013/0081

Abstract: A method includes obtaining at least three input image frames of a scene captured using at least three imaging sensors. The input image frames include a reference image frame and multiple non-reference image frames. The method also includes generating multiple disparity maps using the input image frames. Each disparity map is associated with the reference image frame and a different non-reference image frame. The method further includes generating multiple confidence maps using the input image frames. Each confidence map identifies weights associated with one of the disparity maps. In addition, the method includes generating a depth map of the scene using the disparity maps and the confidence maps. The imaging sensors are arranged to define multiple baseline directions, where each baseline direction extends between the imaging sensor used to capture the reference image frame and the imaging sensor used to capture a different non-reference image frame.

公开(公告)号：US20220303495A1

公开(公告)日：2022-09-22

申请号：US17591040

申请日：2022-02-02

Applicant: Samsung Electronics Co., Ltd.

Inventor： Gyeongmin Choe ,  Yingmao Li ,  John Seokjun Lee ,  Hamid R. Sheikh ,  Michael O. Polley

IPC: H04N7/01 ,  G06T3/00 ,  G06T1/00 ,  H04N1/32

Abstract: An apparatus includes at least one processing device configured to obtain input frames from a video. The at least one processing device is also configured to generate a forward flow from a first input frame to a second input frame and a backward flow from the second input frame to the first input frame. The at least one processing device is further configured to generate an occlusion map at an interpolated frame coordinate using the forward flow and the backward flow. The at least one processing device is also configured to generate a consistency map at the interpolated frame coordinate using the forward flow and the backward flow. In addition, the at least one processing device is configured to perform blending using the occlusion map and the consistency map to generate an interpolated frame at the interpolated frame coordinate.

公开(公告)号：US11449968B2

公开(公告)日：2022-09-20

申请号：US17139894

申请日：2020-12-31

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kaimo Lin ,  Chenchi Luo ,  Yingmao Li ,  Youngjun Yoo

IPC: G06T5/00 ,  G06T7/571 ,  G06T5/20 ,  G06T5/50 ,  G06T3/40 ,  G06T7/215

Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple video frames of a video stream and multiple depth frames corresponding to the multiple video frames. The method also includes generating, using the at least one processor, multiple blur kernel maps based on the multiple depth frames. The method further includes reducing, using the at least one processor, depth errors in each of the multiple blur kernel maps. The method also includes performing, using the at least one processor, temporal smoothing on the multiple blur kernel maps to suppress temporal artifacts between different ones of the multiple blur kernel maps. In addition, the method includes generating, using the at least one processor, blur effects in the video stream using the multiple blur kernel maps.

公开(公告)号：US20220207655A1

公开(公告)日：2022-06-30

申请号：US17139894

申请日：2020-12-31

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kaimo Lin ,  Chenchi Luo ,  Yingmao Li ,  Youngjun Yoo

IPC: G06T5/00 ,  G06T7/571 ,  G06T5/20 ,  G06T5/50 ,  G06T7/215 ,  G06T3/40

Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple video frames of a video stream and multiple depth frames corresponding to the multiple video frames. The method also includes generating, using the at least one processor, multiple blur kernel maps based on the multiple depth frames. The method further includes reducing, using the at least one processor, depth errors in each of the multiple blur kernel maps. The method also includes performing, using the at least one processor, temporal smoothing on the multiple blur kernel maps to suppress temporal artifacts between different ones of the multiple blur kernel maps. In addition, the method includes generating, using the at least one processor, blur effects in the video stream using the multiple blur kernel maps.

公开(公告)号：US20220012903A1

公开(公告)日：2022-01-13

申请号：US16946956

申请日：2020-07-13

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kushal K. Vyas ,  Yingmao Li ,  Chenchi Luo ,  George Q. Chen ,  Hamid R. Sheikh ,  Youngjun Yoo ,  Michael O. Polley

IPC: G06T7/50 ,  G06T3/40 ,  G06T5/00 ,  G06T7/70

Abstract: A method includes obtaining, using at least one processor, an input image frame. The method also includes identifying, using the at least one processor, one or more regions of the input image frame containing redundant information. In addition, the method includes performing, using the at least one processor, an image processing task using the input image frame. The image processing task is guided based on the one or more identified regions of the input image frame. The method may further include obtaining, using the at least one processor, a coarse depth map associated with the input image frame. Performing the image processing task may include refining the coarse depth map to produce a refined depth map, where the refining of the coarse depth map is guided based on the one or more identified regions of the input image frame.