公开(公告)号：US20240153201A1

公开(公告)日：2024-05-09

申请号：US18451242

申请日：2023-08-17

Applicant: Apple Inc.

Inventor： Anurag Ranjan ,  Kwang M. Yi ,  Cuneyt O. Tuzel

IPC: G06T15/50 ,  G06T15/08 ,  G06T17/00

CPC classification number: G06T15/50 ,  G06T15/08 ,  G06T17/00

Abstract: An electronic device may include a light based image generation system configured to generate images of a 3-dimensional object in a scene. The light based image generation system can include a feature extractor, a triplane decoder, and a volume renderer. The feature extractor can receive lighting information about the scene and a perspective of the object in the scene and generate corresponding triplane features. The triplane decoder can decode diffuse and specular reflection parameters based on the triplane features. The volume renderer can render a set of images based on the diffuse and specular reflection parameters. A super resolution image can be generated from the set of images and compared with ground truth images to fine tune weights, biases, and other machine learning parameters associated with the light based image generation system. The light based image generation system can be conditioned to generate photorealistic images of human faces.