PERSONALIZED MACHINE-LEARNED MODEL ENSEMBLES FOR RENDERING OF PHOTOREALISTIC FACIAL REPRESENTATIONS

    公开(公告)号:US20250124653A1

    公开(公告)日:2025-04-17

    申请号:US18487577

    申请日:2023-10-16

    Abstract: Video data that depicts a face of a particular user is obtained. The video data is processed with a plurality of machine-learned models of a user-specific model ensemble for photorealistic facial representation to obtain a corresponding plurality of model outputs. The plurality of machine-learned models comprises one or more of a mesh representation model trained to generate a 3D polygonal mesh representation of the face of the particular user, a machine-learned texture representation model trained to generate a plurality of textures representative of the face of the particular user, or subsurface anatomical representation model(s) trained to generate sub-surface model outputs, each including a representation of a different sub-surface anatomy of the face of the particular user. At least one machine-learned model is optimized based on a loss function that evaluates the at least one model output.

Patent Agency Ranking