公开(公告)号：US20250097545A1

公开(公告)日：2025-03-20

申请号：US18711530

申请日：2022-11-18

Applicant: Lemon Inc.

Inventor： Weibo GONG ,  Xiaojie JIN ,  Ding LIU ,  Xiaohui SHEN

IPC: H04N21/81 ,  G06V10/42 ,  G06V10/44

Abstract: The embodiments of the present disclosure provide a video generation method, an apparatus, a device, and a storage medium, the video generation method including: obtaining a plurality of images and music matched to the plurality of images; determining first feature information for the plurality of images and second feature information for the music; according to the first feature information, the second feature information and a plurality of pre-stored rendering effects, determining a target rendering effect combination; the rendering effects being animation, special effects or a transition; and generating a video according to the plurality of images, the music and the target rendering effect combination.

公开(公告)号：US20250086758A1

公开(公告)日：2025-03-13

申请号：US18728042

申请日：2023-01-13

Applicant: Lemon Inc.

Inventor： Yichun SHI ,  Xiao YANG ,  Xiaohui SHEN

IPC: G06T5/60 ,  G06T5/50

Abstract: The present disclosure provides an image processing method and device. The image processing method includes: performing, by an encoder and a first model, multiple iterations on an initial image to obtain a target image feature corresponding to the initial image; and performing, by a second model, image reconstruction based on the target image feature to obtain a reconstructed image of the initial image, both of the first model and the second model being neural networks for image reconstruction, wherein in the multiple iterations, an image feature extracted by the first model in the image reconstruction and an output image of the first model are feedback information for the encoder to assist the encoder in encoding the initial image.

公开(公告)号：US20250056084A1

公开(公告)日：2025-02-13

申请号：US18711497

申请日：2022-11-18

Applicant: LEMON INC.

Inventor： Xiaojie JIN ,  Weibo GONG ,  Quanwei HUANG ,  Xiaohui SHEN

IPC: H04N21/431 ,  G06V10/42 ,  G06V10/44 ,  H04N21/81 ,  H04N21/845

Abstract: The embodiments of the present disclosure provide a video generation method, an apparatus, an electronic device, a storage medium, a computer program product and a computer program, the method including: obtaining a plurality of video segments; determining feature information corresponding to the plurality of video segments; according to the feature information and a plurality of pre-stored rendering effects, determining an effect combination to be added; the rendering effects being animation, special effects or a transition; and generating a target video according to the plurality of video segments and the effect combination to be added.

公开(公告)号：US20240104810A1

公开(公告)日：2024-03-28

申请号：US18257158

申请日：2021-11-22

Applicant: Lemon Inc.

Inventor： Xiao YANG ,  Jianwei LI ,  Ding LIU ,  Yangyue WAN ,  Xiaohui SHEN ,  Jianchao YANG

IPC: G06T11/60 ,  G06T5/70 ,  G06T5/77 ,  G06T7/12 ,  G06V10/25 ,  G06V10/56

CPC classification number: G06T11/60 ,  G06T5/70 ,  G06T5/77 ,  G06T7/12 ,  G06V10/25 ,  G06V10/56 ,  G06T2207/10024

Abstract: Embodiments of the disclosure provide a method and a device for processing a portrait image, the method includes: acquiring a to-be-processed portrait image; inputting the to-be-processed portrait image into an image processing model, and acquiring a head smear image output by the image processing model, where the image processing model is configured to smear a hair area of a portrait located above a preset boundary in the portrait image, and the image processing model is generated by training a sample data set of a sample portrait image and a sample head smear image corresponding to the sample portrait image; rendering the head smear image with a head effect material to obtain a portrait image added with an effect; and displaying the portrait image added with the effect.

公开(公告)号：US20250104423A1

公开(公告)日：2025-03-27

申请号：US18725683

申请日：2022-12-27

Applicant: Lemon Inc.

Inventor： Longyin WEN ,  Kai XU ,  Xiaohui SHEN

IPC: G06V20/40 ,  G06V10/26 ,  G06V10/764 ,  G06V10/77 ,  G06V10/82

Abstract: Provided in the embodiments of the present disclosure are a video processing method and device. The video processing method includes: determining a target image to be processed in a video; performing semantic segmentation on the target image through a convolutional neural network to obtain a first feature map, wherein the first feature map comprises a feature map corresponding to at least one semantic class; determining a target image region corresponding to the at least one semantic class in the target image according to the first feature map; wherein the at least one semantic class comprises an object-in-hand, and a training image adopted by the convolutional neural network in a training process is marked with an image region corresponding to the at least one semantic class.

公开(公告)号：US20250071390A1

公开(公告)日：2025-02-27

申请号：US18723804

申请日：2022-12-15

Applicant: Lemon Inc.

Inventor： Weibo GONG ,  Xiaojie JIN ,  Xiaohui SHEN

IPC: H04N21/81 ,  G10H1/00 ,  H04N21/439 ,  H04N21/44

Abstract: The present disclosure provides a video generation method based on music beats, a video generation apparatus based on music beats, an electronic device and a computer-readable storage medium. The method includes: acquiring a plurality of video objects and audio information respectively; determining a plurality of initial music beats in the audio information and characteristic information of each initial music beat, in which the characteristic information at least includes a sound intensity of each initial music beat and time of each initial music beat in the audio information; according to the characteristic information, selecting a target music beat from the plurality of initial music beats; and generating a target video according to the target music beat and the plurality of video objects.

公开(公告)号：US20250078570A1

公开(公告)日：2025-03-06

申请号：US18726709

申请日：2023-01-04

Applicant: Lemon Inc.

Inventor： Yizhe ZHU ,  Xiao YANG ,  Jianwei LI ,  Xiaohui SHEN

IPC: G06V40/16 ,  G06V10/46 ,  G06V10/82

Abstract: The present disclosure provides an expression driving method and apparatus, and a training method and apparatus of an expression driving model. The expression driving method includes acquiring a first video; and inputting the first video into a pre-trained expression driving model to obtain a second video. The expression driving model is trained based on a target sample image and a plurality of first sample images. A facial image in the second video is generated based on the target sample image. A gesture expression feature of the facial image in the second video is the same as a gesture expression feature of a facial image in the first video.

公开(公告)号：US20250078392A1

公开(公告)日：2025-03-06

申请号：US18238780

申请日：2023-08-28

Applicant: Lemon Inc.

Inventor： Yichun SHI ,  Peng WANG ,  Jianglong YE ,  Long MAI ,  Xiao YANG ,  Xiaohui SHEN

IPC: G06T15/20 ,  G06N3/0455 ,  G06N3/096

Abstract: An image generation system is described. The system comprises a neural network model configured to perform a diffusion process to generate a set of multi-view images from a same input prompt. The set of multi-view images have a same subject from different view orientation. The neural network model comprises a self-attention layer configured to relate pixels across the set of multi-view images.

公开(公告)号：US20250061641A1

公开(公告)日：2025-02-20

申请号：US18723339

申请日：2022-12-14

Applicant: Lemon Inc.

Inventor： Yizhe ZHU ,  Bingchen LIU ,  Chunpong LAI ,  Xiao YANG ,  Xiaohui SHEN

IPC: G06T15/04 ,  G06T7/11 ,  G06T7/73 ,  G06T11/00 ,  G06V10/77 ,  G06V10/80 ,  G06V40/16

Abstract: The present disclosure provides a method of generating an image with metallic texture, and a method of training a metallic texture image generation model. The method of generating an image with metallic texture includes: acquiring a first video; and inputting the first video into a pre-trained metallic texture image generation model to obtain a second video. Each frame of images in the second video is an image with metallic texture. The metallic texture image generation model is trained based on a plurality of first sample images and second sample images with metallic texture corresponding to each first sample image.

公开(公告)号：US20250054271A1

公开(公告)日：2025-02-13

申请号：US18723150

申请日：2022-12-22

Applicant: Lemon Inc.

Inventor： Yichun SHI ,  Xiao YANG ,  Xiaohui SHEN

IPC: G06V10/44 ,  G06T3/4007 ,  G06V10/74

Abstract: The present disclosure provides a video generation method and device. The video generation method includes: extracting a first image feature from a first image; obtaining a plurality of intermediate image features by means of nonlinear interpolation according to the first image feature and a second image feature, wherein the second image feature is an image feature of a second image; and performing image reconstruction by means of an image generation model based on the first image feature, the second image feature, and the plurality of intermediate image features, so as to generate a target video, wherein the target video is used for presenting a process of a gradual change from the first image to the second image.