公开(公告)号：US20240135673A1

公开(公告)日：2024-04-25

申请号：US18049213

申请日：2022-10-23

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibo Xu ,  Weidi Liu ,  Hamid R. Sheikh ,  John Seokjun Lee

IPC: G06V10/70 ,  G06T5/00 ,  G06V10/60

CPC classification number: G06V10/70 ,  G06T5/003 ,  G06V10/60

Abstract: A method includes obtaining an under-display camera (UDC) image captured using a camera located under a display. The method also includes processing, using at least one processing device of an electronic device, the UDC image based on a machine learning model to restore the UDC image. The method further includes displaying or storing the restored image corresponding to the UDC image. The machine learning model is trained using (i) a ground truth image and (ii) a synthetic image generated using the ground truth image and a point spread function that is based on an optical transmission model of the display.

公开(公告)号：US20240233319A9

公开(公告)日：2024-07-11

申请号：US18049213

申请日：2022-10-24

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibo Xu ,  Weidi Liu ,  Hamid R. Sheikh ,  John Seokjun Lee

IPC: G06V10/70 ,  G06T5/00 ,  G06V10/60

CPC classification number: G06V10/70 ,  G06T5/003 ,  G06V10/60

Abstract: A method includes obtaining an under-display camera (UDC) image captured using a camera located under a display. The method also includes processing, using at least one processing device of an electronic device, the UDC image based on a machine learning model to restore the UDC image. The method further includes displaying or storing the restored image corresponding to the UDC image. The machine learning model is trained using (i) a ground truth image and (ii) a synthetic image generated using the ground truth image and a point spread function that is based on an optical transmission model of the display.

公开(公告)号：US20240119570A1

公开(公告)日：2024-04-11

申请号：US18045696

申请日：2022-10-11

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibo Xu ,  Weidi Liu ,  Hamid R. Sheikh ,  John Seokjun Lee

IPC: G06T5/00 ,  G06T5/20 ,  G06T5/50

CPC classification number: G06T5/003 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10024 ,  G06T2207/20081 ,  H04N23/50

Abstract: A method includes identifying, using at least one processing device of an electronic device, a spatially-variant point spread function associated with an under-display camera. The spatially-variant point spread function is based on an optical transmission model and a layout of a display associated with the under-display camera. The method also includes generating, using the at least one processing device, a ground truth image. The method further includes performing, using the at least one processing device, a convolution of the ground truth image based on the spatially-variant point spread function in order to generate a synthetic sensor image. The synthetic sensor image represents a simulated image captured by the under-display camera. In addition, the method includes providing, using the at least one processing device, the synthetic sensor image and the ground truth image as an image pair to train a machine learning model to perform under-display camera point spread function inversion.