公开(公告)号：US11915460B2

公开(公告)日：2024-02-27

申请号：US17860030

申请日：2022-07-07

Applicant: Apple Inc.

Inventor： Carlos E. Guestrin ,  Leon A. Gatys ,  Shreyas V. Joshi ,  Gustav M. Larsson ,  Kory R. Watson ,  Srikrishna Sridhar ,  Karla P. Vega ,  Shawn R. Scully ,  Thorsten Gernoth ,  Onur C Hamsici

IPC: G06T7/194 ,  G06V10/143 ,  G06N20/00 ,  G06T3/40 ,  G06V10/774

CPC classification number: G06V10/143 ,  G06N20/00 ,  G06T3/40 ,  G06T7/194 ,  G06V10/774 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/20081 ,  G06T2207/20224 ,  G06T2207/30201

Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.

公开(公告)号：US11842460B1

公开(公告)日：2023-12-12

申请号：US17351820

申请日：2021-06-18

Applicant: Apple Inc.

Inventor： Chen Chen ,  Gustav M. Larsson ,  Jiangkun Liu ,  Srikrishna Sridhar ,  Abdelrahman Abdelhamed

IPC: G06T5/00 ,  G06T5/50

CPC classification number: G06T5/002 ,  G06T5/50 ,  G06T2200/24 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20182 ,  G06T2207/20221

Abstract: Electronic devices, methods, and non-transitory program storage devices for leveraging machine learning to perform improved image fusion and/or noise reduction are disclosed. When a capture request is received, a neural network may be used to perform fusion and denoising operations on a first set of captured input images. According to some embodiments, the neural network's architecture comprises: a first plurality of network layers configured to compute optical flow information between the first set of input images; a second plurality of network layers configured to perform, at least in part, the fusion and denoising operations on the first set of input images; and a third plurality of skip connections between layers of the second plurality of network layers, wherein parameters for each skip connection of the third plurality of skip connections are warped based on at least part of the optical flow information computed by the first plurality of network layers.

公开(公告)号：US11386355B2

公开(公告)日：2022-07-12

申请号：US16706578

申请日：2019-12-06

Applicant: Apple Inc.

Inventor： Carlos E. Guestrin ,  Leon A. Gatys ,  Shreyas V. Joshi ,  Gustav M. Larsson ,  Kory R. Watson ,  Srikrishna Sridhar ,  Karla P. Vega ,  Shawn R. Scully ,  Thorsten Gernoth ,  Onur C Hamsici

IPC: G06T7/194 ,  G06N20/00 ,  G06T3/40

Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.