-
公开(公告)号:US20240404170A1
公开(公告)日:2024-12-05
申请号:US18354546
申请日:2023-07-18
Applicant: Lemon Inc.
Inventor: Kin Chung Wong , Blake Garrett Fuselier , Jason Yang , Yizhe Zhu
Abstract: A computing system provides a social media platform. The computing system includes one or more processors configured to execute instructions stored in associated memory to receive a base image including a human face and receive an image mask defining a region for inpainting to occur and a region for inpainting to not occur. The region for inpainting to not occur includes at least an eye region. The one or more processors are configured to receive a user text prompt and generate, at an artificial intelligence (AI) model, a face decoration texture using the base image, the image mask, and the user text prompt as input.
-
2.
公开(公告)号:US12079902B2
公开(公告)日:2024-09-03
申请号:US18052862
申请日:2022-11-04
Applicant: Lemon Inc.
Inventor: Qing Yan , Bingchen Liu , Yizhe Zhu , Xiao Yang
Abstract: Systems and methods are provided that include a processor executing a program to process an initial image through a first diffusion stage to generate a final first stage image, wherein the first diffusion stage includes using a diffusion model, a gradient estimator model smaller than the diffusion model, and a text-image match gradient calculator. The processor further executes the program to process the final first stage image through a second diffusion stage to generate a final second stage image. The second diffusion stage includes, for a second predetermined number of iterations, inputting the final first stage image to through the diffusion model, back-propagate the image through the text-image match gradient calculator to calculate a second stage gradient against the input text, and update the final first stage image by applying the second stage gradient to the final first stage image.
-
公开(公告)号:US12136141B2
公开(公告)日:2024-11-05
申请号:US18052866
申请日:2022-11-04
Applicant: Lemon Inc.
Inventor: Bingchen Liu , Yizhe Zhu , Xiao Yang
Abstract: Systems and methods are provided that include a processor executing a program to receive input text from a user. The processor is further configured to, for a predetermined number of iterations, input an initial image into a diffusion process to generate a processed image, back-propagate the processed image through a text-image match gradient calculator to calculate a gradient against the input text, and update the initial image with an image generated by applying the calculated gradient to the processed image. The pixel values of the processed image during a first portion of the predetermined number of iterations are value clamped to a first range, and pixel values of the processed image during a second portion of the predetermined number of iterations are value clamped to a second range that is a subset of the first range.
-
公开(公告)号:US12131406B2
公开(公告)日:2024-10-29
申请号:US18052870
申请日:2022-11-04
Applicant: Lemon Inc.
Inventor: Bingchen Liu , Yizhe Zhu , Xiao Yang
Abstract: Systems and methods are provided that include a processor executing a program to receive an input from a user, where the input including a first input text and a second input text. The processor is further configured to provide an initial image and, for a predetermined number of iterations, define a first and second regions of the initial image associated with the first and second input texts, respectively, define a plurality of patches of the initial image, input the initial image into a diffusion process to generate a processed image, back-propagate the processed image through a text-image match gradient calculator by generating an image embedding based on the processed image, generating a text embedding based on the region and the input text that are associated with a patch, and calculating a differential between the image embedding and the text embedding.
-
-
-