公开(公告)号：US11532091B2

公开(公告)日：2022-12-20

申请号：US16946956

申请日：2020-07-13

Applicant: Samsung Electronics Co., Ltd.

Inventor： Kushal Kardam Vyas ,  Yingmao Li ,  Chenchi Luo ,  George Q. Chen ,  Hamid R. Sheikh ,  Youngjun Yoo ,  Michael O. Polley

IPC: G06T7/00 ,  G06T7/50 ,  G06T3/40 ,  G06T7/70 ,  G06T5/00

Abstract: A method includes obtaining, using at least one processor, an input image frame. The method also includes identifying, using the at least one processor, one or more regions of the input image frame containing redundant information. In addition, the method includes performing, using the at least one processor, an image processing task using the input image frame. The image processing task is guided based on the one or more identified regions of the input image frame. The method may further include obtaining, using the at least one processor, a coarse depth map associated with the input image frame. Performing the image processing task may include refining the coarse depth map to produce a refined depth map, where the refining of the coarse depth map is guided based on the one or more identified regions of the input image frame.

公开(公告)号：US11119915B2

公开(公告)日：2021-09-14

申请号：US15892195

申请日：2018-02-08

Applicant: Samsung Electronics, Co. Ltd.

Inventor： Chenchi Luo ,  Hyejung Kim ,  Seok-Jun Lee ,  David Liu ,  Michael Polley

IPC: G06F12/06 ,  G06N3/063 ,  G06N3/04 ,  G06N3/08

Abstract: A method to map a plurality of feature maps of a neural network onto a memory hierarchy includes mapping a first feature map of the plurality of feature maps to a memory in a memory hierarchy having available memory space and providing quickest access to the first feature map. The method also includes, when the first feature map expires, removing the first feature map from the memory used to store the first feature map.

公开(公告)号：US20210248722A1

公开(公告)日：2021-08-12

申请号：US16946989

申请日：2020-07-14

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chenchi Luo ,  Yingmao Li ,  Youngjun Yoo

IPC: G06T5/00 ,  G06T5/50 ,  G06N3/04 ,  G06T3/40

Abstract: A method includes processing, using at least one processor of an electronic device, each of multiple images using a photometric augmentation engine, where the photometric augmentation engine performs one or more photometric augmentation operations. The method also includes applying, using the at least one processor, multiple layers of a convolutional neural network to each of the images, where each layer generates a corresponding feature map. The method further includes processing, using the at least one processor, at least one of the feature maps using at least one feature augmentation engine between consecutive layers of the multiple layers, where the at least one feature augmentation engine performs one or more feature augmentation operations.

公开(公告)号：US20210174479A1

公开(公告)日：2021-06-10

申请号：US16703712

申请日：2019-12-04

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingmao Li ,  Chenchi Luo ,  George Q. Chen ,  Youngjun Yoo

IPC: G06T5/00 ,  G06T5/40 ,  G06T5/50 ,  G06T7/55 ,  G06T7/73 ,  G06T3/00

Abstract: A method includes obtaining, using first and second image sensors of an electronic device, first and second images, respectively, of a scene. The method also includes obtaining, using an image depth sensor of the electronic device, a third image and a first depth map of the scene, the first depth map having a resolution lower than a resolution of the first and second images. The method further includes undistorting the first and second images using the third image and the first depth map. The method also includes rectifying the first and second images using the third image and the first depth map. The method further includes generating a disparity map using the first and second images that have been undistorted and rectified. In addition, the method includes generating a second depth map using the disparity map and the first depth map, where the second depth map has a resolution that is higher than the resolution of the first depth map.

公开(公告)号：US20210158142A1

公开(公告)日：2021-05-27

申请号：US16693112

申请日：2019-11-22

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chenchi Luo ,  Yingmao Li ,  Youngjun Yoo

IPC: G06N3/08 ,  G06N3/04

Abstract: A method includes identifying, by at least one processor, multiple features of input data using a common feature extractor. The method also includes processing, by the at least one processor, at least some identified features using each of multiple pre-processing branches. Each pre-processing branch includes a first set of neural network layers and generates initial outputs associated with a different one of multiple data processing tasks. The method further includes combining, by the at least one processor, at least two initial outputs from at least two pre-processing branches to produce combined initial outputs. In addition, the method includes processing, by the at least one processor, at least some initial outputs or at least some combined initial outputs using each of multiple post-processing branches. Each post-processing branch includes a second set of neural network layers and generates final outputs associated with a different one of the multiple data processing tasks.

公开(公告)号：US20190243755A1

公开(公告)日：2019-08-08

申请号：US15892195

申请日：2018-02-08

Applicant: Samsung Electronics, Co. Ltd.

Inventor： Chenchi Luo ,  Hyejung Kim ,  Seok-Jun Lee ,  David Liu ,  Michael Polley

IPC: G06F12/06 ,  G06N3/063 ,  G06N3/08 ,  G06N3/04

CPC classification number: G06F12/0638 ,  G06F2212/1024 ,  G06N3/04 ,  G06N3/063 ,  G06N3/08

Abstract: A method to map a plurality of feature maps of a neural network onto a memory hierarchy includes mapping a first feature map of the plurality of feature maps to a memory in a memory hierarchy having available memory space and providing quickest access to the first feature map. The method also includes, when the first feature map expires, removing the first feature map from the memory used to store the first feature map.

公开(公告)号：US12148175B2

公开(公告)日：2024-11-19

申请号：US17590998

申请日：2022-02-02

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingmao Li ,  Chenchi Luo ,  Gyeongmin Choe ,  John Seokjun Lee

IPC: G06T7/269

Abstract: A method includes obtaining a first optical flow vector representing motion between consecutive video frames during a previous time step. The method also includes generating a first predicted optical flow vector from the first optical flow vector using a trained prediction model, where the first predicted optical flow vector represents predicted motion during a current time step. The method further includes refining the first predicted optical flow vector using a trained update model to generate a second optical flow vector representing motion during the current time step. The trained update model uses the first predicted optical flow vector, a video frame of the previous time step, and a video frame of the current time step to generate the second optical flow vector.

公开(公告)号：US11989637B2

公开(公告)日：2024-05-21

申请号：US16399998

申请日：2019-04-30

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chenchi Luo ,  David Liu ,  Youngjun Yoo

IPC: G06N3/08 ,  G06N3/04

CPC classification number: G06N3/04 ,  G06N3/0409 ,  G06N3/08

Abstract: An electronic device, method, and computer readable medium for an invertible wavelet layer for neural networks are provided. The electronic device includes a memory and at least one processor coupled to the memory. The at least one processor is configured to receive an input to a neural network, apply a wavelet transform to the input at a wavelet layer of the neural network, and generate a plurality of subbands of the input as a result of the wavelet transform.

公开(公告)号：US11847771B2

公开(公告)日：2023-12-19

申请号：US17246163

申请日：2021-04-30

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingmao Li ,  Chenchi Luo ,  Youngjun Yoo

IPC: G06T7/00 ,  G06T7/215 ,  G06T7/246 ,  G06T7/579 ,  G06T3/00 ,  G06T7/254 ,  G06T11/00

CPC classification number: G06T7/0002 ,  G06T3/0093 ,  G06T7/215 ,  G06T7/248 ,  G06T7/254 ,  G06T7/579 ,  G06T11/00 ,  G06T2207/20081 ,  G06T2207/30168

Abstract: A method includes obtaining at least one image and a ground truth map associated with the at least one image. The method also includes generating multiple optical maps using multiple algorithms and the at least one image. The method further includes, for each algorithm, identifying at least one score for the algorithm using one or more of the optical maps generated using the algorithm and the ground truth map. The ground truth map identifies one or more boundaries associated with one or more foreground objects in the at least one image. The scores identify how well the optical maps generated using the algorithms separate the one or more foreground objects from a background in the at least one image.

公开(公告)号：US11816855B2

公开(公告)日：2023-11-14

申请号：US17027106

申请日：2020-09-21

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chenchi Luo ,  Yingmao Li ,  Kaimo Lin ,  Youngjun Yoo

IPC: G06T7/593 ,  H04N13/271 ,  H04N13/128 ,  H04N13/00

CPC classification number: G06T7/593 ,  H04N13/128 ,  H04N13/271 ,  G06T2207/10028 ,  H04N2013/0081

Abstract: A method includes obtaining at least three input image frames of a scene captured using at least three imaging sensors. The input image frames include a reference image frame and multiple non-reference image frames. The method also includes generating multiple disparity maps using the input image frames. Each disparity map is associated with the reference image frame and a different non-reference image frame. The method further includes generating multiple confidence maps using the input image frames. Each confidence map identifies weights associated with one of the disparity maps. In addition, the method includes generating a depth map of the scene using the disparity maps and the confidence maps. The imaging sensors are arranged to define multiple baseline directions, where each baseline direction extends between the imaging sensor used to capture the reference image frame and the imaging sensor used to capture a different non-reference image frame.