Cascaded domain bridging for image generation

    公开(公告)号:US12299799B2

    公开(公告)日:2025-05-13

    申请号:US18046073

    申请日:2022-10-12

    Abstract: A method of generating a stylized 3D avatar is provided. The method includes receiving an input image of a user, generating, using a generative adversarial network (GAN) generator, a stylized image, based on the input image, and providing the stylized image to a first model to generate a first plurality of parameters. The first plurality of parameters include a discrete parameter and a continuous parameter. The method further includes providing the stylized image and the first plurality of parameters to a second model that is trained to generate an avatar image, receiving, from the second model, the avatar image, comparing the stylized image to the avatar image, based on a loss function, to determine an error, updating the first model to generate a second plurality of parameters that correspond to the first plurality of parameters, based on the error, and providing the second plurality of parameters as an output.

    MULTI-DIMENSIONAL IMAGE STYLIZATION USING TRANSFER LEARNING

    公开(公告)号:US20240273871A1

    公开(公告)日:2024-08-15

    申请号:US18168867

    申请日:2023-02-14

    Applicant: Lemon Inc.

    CPC classification number: G06V10/7715 G06V10/28 G06V10/454

    Abstract: A method for generating a multi-dimensional stylized image. The method includes providing input data into a latent space for a style conditioned multi-dimensional generator of a multi-dimensional generative model and generating the multi-dimensional stylized image from the input data by the style conditioned multi-dimensional generator. The method further includes synthesizing content for the multi-dimensional stylized image using a latent code and corresponding camera pose from the latent space to formulate an intermediate code to modulate synthesis convolution layers to generate feature images as multi-planar representations and synthesizing stylized feature images of the feature images for generating the multi-dimensional stylized image of the input data. The style conditioned multi-dimensional generator is tuned using a guided transfer learning process using a style prior generator.

    Portrait stylization framework to control the similarity between stylized portraits and original photo

    公开(公告)号:US12217466B2

    公开(公告)日:2025-02-04

    申请号:US17519711

    申请日:2021-11-05

    Applicant: Lemon Inc.

    Abstract: Systems and methods directed to controlling the similarity between stylized portraits and an original photo are described. In examples, an input image is received and encoded using a variational autoencoder to generate a latent vector. The latent vector may be blended with latent vectors that best represent a face in the original user portrait image. The resulting blended latent vector may be provided to a generative adversarial network (GAN) generator to generate a controlled stylized image. In examples, one or more layers of the stylized GAN generator may be swapped with one or more layers of the original GAN generator. Accordingly, a user can interactively determine how much stylization vs. personalization should be included in a resulting stylized portrait.

    PORTRAIT STYLIZATION FRAMEWORK USING A TWO-PATH IMAGE STYLIZATION AND BLENDING

    公开(公告)号:US20230124252A1

    公开(公告)日:2023-04-20

    申请号:US17501990

    申请日:2021-10-14

    Applicant: Lemon Inc.

    Abstract: Systems and method directed to generating a stylized image are disclosed. In particular, the method includes, in a first data path, (a) applying first stylization to an input image and (b) applying enlargement to the stylized image from (a). The method also includes, in a second data path, (c) applying segmentation to the input image to identify a face region of the input image and generate a mask image, and (d) applying second stylization to an entirety of the input image and inpainting to the identified face region of the stylized image. Machine-assisted blending is performed based on (1) the stylized image after the enlargement from the first data path, (2) the inpainted image from the second data path, and (3) the mask image, in order to obtain a final stylized image.

Patent Agency Ranking