公开(公告)号：US11671616B2

公开(公告)日：2023-06-06

申请号：US17200628

申请日：2021-03-12

Applicant: Lemon Inc.

Inventor： Na Zhang ,  Kai Zhang ,  Hongbin Liu ,  Li Zhang ,  Yue Wang

IPC: H04N19/533 ,  H04N19/513 ,  H04N19/137 ,  H04N19/176 ,  H04N19/159 ,  H04N19/105

CPC classification number: H04N19/513 ,  H04N19/105 ,  H04N19/137 ,  H04N19/159 ,  H04N19/176

Abstract: Embodiments of the present disclosure provide methods, apparatuses and computer storage media for video processing. One example method comprises determining, during a conversion between a current video block of a video and a bitstream of the video, a set of motion candidates for the current video block; determining, for each motion candidate in the set of motion candidates, a refined motion candidate by performing a local search around the each motion candidate based on a template matching cost rule; determining, from a set of refined motion candidates generated for the set of motion candidates, a target motion candidate for the current video block; and performing the conversion based on the target motion candidate.

公开(公告)号：US20230162408A1

公开(公告)日：2023-05-25

申请号：US17531462

申请日：2021-11-19

Applicant: Lemon Inc.

Inventor： Nathan Schager ,  Yixin Zhao

IPC: G06T11/00 ,  G06T7/12

CPC classification number: G06T11/00 ,  G06T7/12 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Methods, systems and storage media for applying a pattern application effect to one or more frames of video are disclosed. Some examples may include: obtaining video data including one or more video frames, determining one or more segments in each of the one or more video frames, determining one or more object masks based on the one or more segments in each of the one or more video frames, combining, the one or more object masks into a single mask, obtaining pattern information, the pattern information representing one or more graphical effects to be applied to at least one layer of the one or more video frames, applying the pattern information to the single mask to generate masked pattern information and generating, by the computing device, a rendered video by adding the masked pattern information to the one or more video frames.

公开(公告)号：US20230161899A1

公开(公告)日：2023-05-25

申请号：US17535398

申请日：2021-11-24

Applicant: Lemon Inc.

Inventor： Xin Yang ,  Yuanshun Yao ,  Tianyi Liu ,  Jiankai Sun ,  Chong Wang ,  Ruihan Wu

IPC: G06F21/62

CPC classification number: G06F21/6245

Abstract: The present disclosure describes techniques of releasing data while protecting individual privacy. A dataset may be compressed by applying a first random matrix. The dataset may be owned by a party among a plurality of parties and there may be a plurality of datasets owned by the plurality of parties. A noise may be added by applying a random Gaussian matrix to the compressed dataset to obtain a processed dataset. The processed dataset ensures data privacy protection. The processed dataset may be released to other parties.

公开(公告)号：US20230153758A1

公开(公告)日：2023-05-18

申请号：US17859988

申请日：2022-07-07

Applicant: Lemon Inc.

Inventor： Yuhui Zhang ,  Jiamin Chen ,  Hongjie Dong ,  Ruchir Astavans ,  Tianzi Yuan ,  Minghan Jiang ,  Jianqiu Yang ,  Justin Moonsoo Kang

IPC: G06Q10/10

CPC classification number: G06Q10/103

Abstract: The present disclosure describes techniques for facilitating a collaborative environment. The techniques may comprise aggregating data shared by at least a subset of a plurality of users via a plurality of message threads and a plurality of virtual rooms in the collaborative environment. The data may be categorized into a plurality of categories based on determining relatedness of the data. Data associated with any category among the plurality of categories may be classified based on a plurality of types of the data associated with the category. One of the plurality of types of the data associated with the category may be displayed on a first computing device associated with a first user among the plurality of users.

公开(公告)号：US20230143789A1

公开(公告)日：2023-05-11

申请号：US18149462

申请日：2023-01-03

Applicant: Lemon Inc.

Inventor： Shangyu Xie ,  Jiankai Sun ,  Xin Yang ,  Yuanshun Yao ,  Tianyi Liu ,  Taiqing Wang

IPC: G06N3/084 ,  G06N3/045

CPC classification number: G06N3/084 ,  G06N3/045

Abstract: Split learning is provided to train a composite neural network (CNN) model that is split into first and second submodels, including receiving a noise-laden backpropagation gradient, training the surrogate submodel by optimizing a gradient distance loss, and computing an updated dummy label using the first submodel and the trained surrogate submodel to infer label information of the second submodel. Noise can be added to a label of the second submodel or a shared backpropagation gradient to protect the label information.

公开(公告)号：US20230132137A1

公开(公告)日：2023-04-27

申请号：US18089348

申请日：2022-12-27

Applicant: Lemon Inc.

Inventor： Shupeng ZHANG ,  Boheng QIU ,  Peng WANG ,  Jie LIAO

IPC: H04N5/265 ,  G06T7/194 ,  G06T5/00 ,  H04N5/262

Abstract: A method and apparatus for converting a picture into a video, and a device and a storage medium. The method for converting a picture into a video includes: partitioning an original picture to obtain a foreground region and a background region; performing an iterative transformation for visual depth on the background region, and storing an image obtained through each transformation as a picture frame to obtain multiple frames of images; and splicing the multiple frames of images to obtain a target video. The iterative transformation includes at least two transformations for visual depth.

公开(公告)号：US20230131975A1

公开(公告)日：2023-04-27

申请号：US18087576

申请日：2022-12-22

Applicant: Lemon Inc.

Inventor： Tao XIONG ,  Shihkuang CHU ,  Hao HUANG ,  Shaoyuan LI ,  Chenyu SUN

IPC: G06F16/435 ,  G06F16/44

Abstract: A music playing method and apparatus based on user interaction, a device and a storage medium, which relate to the technical field of music videos. The method includes: capturing a target video through a video capturing apparatus; determining an audio processing mode corresponding to a target action when it is identified in the target video that a target object presents the target action; and playing music according to the audio processing mode. The target video is captured by the video capturing apparatus, and when the target object in the target video is identified to generate the target action, the corresponding audio processing mode is determined based on the target action, and music is played according to the audio processing mode.

公开(公告)号：US20230131151A1

公开(公告)日：2023-04-27

申请号：US18088167

申请日：2022-12-23

Applicant: Lemon Inc.

Inventor： Zhixiong LU ,  Zhili CHEN

IPC: H04N5/262 ,  H04N5/265 ,  G06T7/11 ,  H04N23/80

Abstract: A video capturing method, an apparatus, a device and a storage medium are provided. The method is applied to a terminal device, the terminal device includes a camera, and the method includes: segmenting a to-be-segmented target object to obtain a target segmentation result in response to an input event of selecting the to-be-segmented target object among a plurality of objects presented in an acquisition image of the camera; displaying the target segmentation result; and fusing the target segmentation result, that is adjusted, with a to-be-fused video scene to generate a video in response to a triggering operation for adjusting the target segmentation result.

公开(公告)号：US20230124252A1

公开(公告)日：2023-04-20

申请号：US17501990

申请日：2021-10-14

Applicant: Lemon Inc.

Inventor： Jing Liu ,  Chunpong Lai ,  Guoxian Song ,  Linjie Luo ,  Ye Yuan

IPC: G06T5/00 ,  G06T3/40 ,  G06T5/50 ,  G06T11/00 ,  G06T7/11

Abstract: Systems and method directed to generating a stylized image are disclosed. In particular, the method includes, in a first data path, (a) applying first stylization to an input image and (b) applying enlargement to the stylized image from (a). The method also includes, in a second data path, (c) applying segmentation to the input image to identify a face region of the input image and generate a mask image, and (d) applying second stylization to an entirety of the input image and inpainting to the identified face region of the stylized image. Machine-assisted blending is performed based on (1) the stylized image after the enlargement from the first data path, (2) the inpainted image from the second data path, and (3) the mask image, in order to obtain a final stylized image.

公开(公告)号：US11611752B2

公开(公告)日：2023-03-21

申请号：US17475826

申请日：2021-09-15

Applicant: Lemon Inc.

Inventor： Ye-Kui Wang

IPC: H04N19/132 ,  H04N19/117 ,  H04N19/169 ,  H04N19/30

Abstract: Systems, methods and apparatus for encoding or decoding a file format that stores one or more images are described. One example method includes performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule, where the format rule specifies that first adaptation parameter set network abstraction layer units are disallowed from being simultaneously stored in in the visual media file in (1) any one or both of samples of video coding layer tracks or sample entries of the video coding layer tracks, and (2) samples of non-video coding layer tracks, where the video coding layer tracks are tracks containing video coding layer network abstraction layer units, and where the first adaptation parameter set network abstraction layer units includes luma mapping with chroma scaling parameters for a video stream and scaling list parameters for the video stream.