METHODS FOR A RASTERIZATION-BASED DIFFERENTIABLE RENDERER FOR TRANSLUCENT OBJECTS

    公开(公告)号:US20240096018A1

    公开(公告)日:2024-03-21

    申请号:US17932640

    申请日:2022-09-15

    Applicant: Lemon Inc.

    CPC classification number: G06T17/20 G06T2210/62

    Abstract: Systems and methods for rendering a translucent object are provided. In one aspect, the system includes a processor coupled to a storage medium that stores instructions, which, upon execution by the processor, cause the processor to receive at least one mesh representing at least one translucent object. For each pixel to be rendered, the processor performs a rasterization-based differentiable rendering of the pixel to be rendered using the at least one mesh and determines a plurality of values for the pixel to be rendered based on the rasterization-based differentiable rendering. The rasterization-based differentiable rendering can include performing a probabilistic rasterization process along with aggregation techniques to compute the plurality of values for the pixel to be rendered. The plurality of values includes a set of color channel values and an opacity channel value. Once values are determined for all pixels, an image can be rendered.

    PORTRAIT STYLIZATION FRAMEWORK TO CONTROL THE SIMILARITY BETWEEN STYLIZED PORTRAITS AND ORIGINAL PHOTO

    公开(公告)号:US20230146676A1

    公开(公告)日:2023-05-11

    申请号:US17519711

    申请日:2021-11-05

    Applicant: Lemon Inc.

    CPC classification number: G06T9/002 G06T11/60 G06N3/08

    Abstract: Systems and methods directed to controlling the similarity between stylized portraits and an original photo are described. In examples, an input image is received and encoded using a variational autoencoder to generate a latent vector. The latent vector may be blended with latent vectors that best represent a face in the original user portrait image. The resulting blended latent vector may be provided to a generative adversarial network (GAN) generator to generate a controlled stylized image. In examples, one or more layers of the stylized GAN generator may be swapped with one or more layers of the original GAN generator. Accordingly, a user can interactively determine how much stylization vs. personalization should be included in a resulting stylized portrait.

Patent Agency Ranking