-
公开(公告)号:US20230036903A1
公开(公告)日:2023-02-02
申请号:US17390440
申请日:2021-07-30
Applicant: Lemon Inc.
Inventor: Wanchun MA , Shuo CHENG , Chao WANG , Michael Leong Hou TAY , Linjie LUO
Abstract: The present disclosure describes techniques for face tracking. The techniques comprise receiving landmark data associated with a plurality of images indicative of at least one facial part. Representative images corresponding to the plurality of images may be generated based on the landmark data. Each representative image may depict a plurality of segments, and each segment may correspond to a region of the at least one facial part. The plurality of images and corresponding representative images may be input into a neural network to train the neural network to predict a feature associated with a subsequently received image comprising a face. An animation associated with a facial expression may be controlled based on output from the trained neural network.
-
公开(公告)号:US20230328197A1
公开(公告)日:2023-10-12
申请号:US18332243
申请日:2023-06-09
Applicant: Lemon Inc.
Inventor: Yaxi GAO , Chenyu SUN , Xiao YANG , Zhili CHEN , Linjie LUO , Jing LIU , Hengkai GUO , Huaxia LI , Hwankyoo Shawn KIM , Jianchao YANG
IPC: G06T7/73 , G06T7/12 , G11B27/036 , H04N5/265 , G11B27/10
CPC classification number: H04N5/265 , G06T7/12 , G06T7/73 , G11B27/036 , G11B27/10 , G06T2200/24 , G06T2207/10021 , G06T2207/20101
Abstract: Embodiments of the present disclosure provide a display method and apparatus based on augmented reality, a device, and a storage medium, the method includes receiving a first video; acquiring a video material by segmenting a target object from the first video; acquiring and displaying a real scene image, where the real scene image is acquired by an image collection apparatus; and displaying the video material at a target position of the real scene image in an augmented manner and playing the video material. Since the video material is acquired by receiving the first video and segmenting the target object from the first video, the video material may be set according to the needs of the user.
-
公开(公告)号:US20220375024A1
公开(公告)日:2022-11-24
申请号:US17321384
申请日:2021-05-14
Applicant: Lemon Inc.
Inventor: Linjie LUO , Guoxian SONG , Jing LIU , Wanchun MA
Abstract: Systems and method directed to an inversion-consistent transfer learning framework for generating portrait stylization using only limited exemplars. In examples, an input image is received and encoded using a variational autoencoder to generate a latent vector. The latent vector may be provided to a generative adversarial network (GAN) generator to generate a stylized image. In examples, the variational autoencoder is trained using a plurality of images while keeping the weights of a pre-trained GAN generator fixed, where the pre-trained GAN generator acts as a decoder for the encoder. In other examples, a multi-path attribute aware generator is trained using a plurality of exemplar images and learning transfer using the pre-trained GAN generator.
-
公开(公告)号:US20230377368A1
公开(公告)日:2023-11-23
申请号:US17751393
申请日:2022-05-23
Applicant: LEMON Inc.
Inventor: Shuo CHENG , Guoxian SONG , Wanchun MA , Chao Wang , Linjie LUO
CPC classification number: G06V40/172 , G06V10/761 , G06V10/82 , G06T11/60
Abstract: Methods and systems for generating synthetic images based on an input image are described. The method may include receiving an input image; generating, using an encoder, a first latent code vector representation based on the input image; receiving a latent code corresponding to a feature to be added to the input image; modifying the first latent code vector representation based on the latent code corresponding to the feature to be added; generating, by an image decoder, a synthesized image based on the modified first latent code vector representation; identifying, using a landmark detector, one or more landmarks in the base image; identifying, using a landmark detector, one or more landmarks in the synthesized image; determining a measure of similarity between the landmark identified on the base image and the landmark identified in the synthesized image; and discarding the synthesized image based on the comparison.
-
公开(公告)号:US20240265628A1
公开(公告)日:2024-08-08
申请号:US18165619
申请日:2023-02-07
Applicant: Lemon Inc.
Inventor: Hongyi XU , Sizhe AN , Yichun SHI , Guoxian SONG , Linjie LUO
CPC classification number: G06T17/00 , G06T3/4053 , G06T7/194 , G06T7/70 , G06T11/00 , G06T15/10 , G06T19/20 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196 , G06T2210/12 , G06T2210/22 , G06T2219/2004 , G06T2219/2016
Abstract: A three-dimensional generative adversarial network includes a generator, a discriminator, and a renderer. The generator is configured to receive an intermediate latent code mapped from a latent code and a camera pose, generate two-dimensional backgrounds for a set of images, and generate, based on the intermediate latent code, multi-grid representation features. The renderer is configured to synthesize images based on the camera pose, a camera pose offset, and the multi-grid representation features; the camera pose offset being mapped from the latent code and the camera pose; and render a foreground mask. The discriminator is configured to supervise a training of the foreground mask with an up-sampled image and a super-resolved image.
-
公开(公告)号:US20230325975A1
公开(公告)日:2023-10-12
申请号:US18208761
申请日:2023-06-12
Applicant: Lemon Inc.
Inventor: Tiancheng ZHI , Shen SANG , Jing LIU , Linjie LUO
CPC classification number: G06T3/4046 , G06T5/50 , G06T2207/20084 , G06T2207/20081 , G06T2207/20132 , G06T2207/20024
Abstract: A method for training an image processor having a neural network model is described. A first training set of images having a first image resolution is generated. A second training set of images having a second image resolution is generated. The second image resolution is larger than the first image resolution. The neural network model of the image processor is trained using the first training set of images during a first training session. The neural network model of the image processor is trained using the second training set of images during a second training session after the first training session.
-
-
-
-
-