公开(公告)号：US11276154B2

公开(公告)日：2022-03-15

申请号：US16947106

申请日：2020-07-17

Applicant: Samsung Electronics Co., Ltd.

Inventor： Deboleena Roy ,  Long N. Le ,  Hamid R. Sheikh

IPC: G06T5/00 ,  G06T5/50 ,  G06T7/55 ,  H04N5/243

Abstract: A method includes capturing a plurality of first images using a first image sensor and a plurality of second images using a second image sensor. The method also includes generating a short single view, short depth map, long single view, and long depth map from the first and second images. The method further includes generating a multi-frame depth map using the short single view, short depth map, long single view, and long depth map. The method also includes generating a gain map using the multi-frame depth map and lighting conditions, where the lighting conditions introduce a relighting effect into the gain map. The method further includes generating a relit short single view and a relit long single view by applying the gain map to the short and long single views. In addition, the method includes generating a relit image by fusing the relit short and long single views.

公开(公告)号：US20220198722A1

公开(公告)日：2022-06-23

申请号：US17566320

申请日：2021-12-30

Applicant: Samsung Electronics Co., Ltd.

Inventor： Deboleena Roy ,  Long N. Le ,  Hamid R. Sheikh

IPC: G06T11/00 ,  G06V10/60 ,  G06T7/55 ,  G06V10/774 ,  G06V10/776

Abstract: A method includes capturing a plurality of first images using a first image sensor and capturing a plurality of second images using a second image sensor. The method also includes estimating depth information based on at least one of the first images and at least one of the second images. The method further includes obtaining information related to a lighting direction from an artificial intelligence (AI) light director, where the AI light director is trained to determine one or more lighting directions. In addition, the method includes generating at least one relit image using at least one of the first and second images based on the obtained information related to the lighting direction and the estimated depth information.

公开(公告)号：US20220020128A1

公开(公告)日：2022-01-20

申请号：US16947106

申请日：2020-07-17

Applicant: Samsung Electronics Co., Ltd.

Inventor： Deboleena Roy ,  Long N. Le ,  Hamid R. Sheikh

IPC: G06T5/50 ,  G06T7/55 ,  G06T5/00 ,  H04N5/243

Abstract: A method includes capturing a plurality of first images using a first image sensor and a plurality of second images using a second image sensor. The method also includes generating a short single view, short depth map, long single view, and long depth map from the first and second images. The method further includes generating a multi-frame depth map using the short single view, short depth map, long single view, and long depth map. The method also includes generating a gain map using the multi-frame depth map and lighting conditions, where the lighting conditions introduce a relighting effect into the gain map. The method further includes generating a relit short single view and a relit long single view by applying the gain map to the short and long single views. In addition, the method includes generating a relit image by fusing the relit short and long single views.

公开(公告)号：US12141894B2

公开(公告)日：2024-11-12

申请号：US17566320

申请日：2021-12-30

Applicant: Samsung Electronics Co., Ltd.

Inventor： Deboleena Roy ,  Long N. Le ,  Hamid R. Sheikh

IPC: G06T11/00 ,  G06T7/55 ,  G06V10/60 ,  G06V10/774 ,  G06V10/776 ,  H04N23/45

Abstract: A method includes capturing a plurality of first images using a first image sensor and capturing a plurality of second images using a second image sensor. The method also includes estimating depth information based on at least one of the first images and at least one of the second images. The method further includes obtaining information related to a lighting direction from an artificial intelligence (AI) light director, where the AI light director is trained to determine one or more lighting directions. In addition, the method includes generating at least one relit image using at least one of the first and second images based on the obtained information related to the lighting direction and the estimated depth information.