Creation of videos using virtual characters

    公开(公告)号:US11978143B2

    公开(公告)日:2024-05-07

    申请号:US17751222

    申请日:2022-05-23

    Applicant: Lemon Inc.

    CPC classification number: G06T13/40 G06T15/005 G06T15/04 G06V40/10

    Abstract: The present disclosure describes techniques for creating videos using virtual characters. Creation of a video may be initiated by a user. Camera input comprising a human body of the user may be received. The camera input may be split into a first stream for removing the human body and a second stream for animating a virtual character in the video. An inpainting filter may be applied to remove the human body in real time from the camera input. The inpainting filter may be configured to accelerate texture sampling. Output of the inpainting filter may be blended with images comprised in the camera input to generate camera input backgrounds.

    View synthesis from sparse volume data structure

    公开(公告)号:US12190558B2

    公开(公告)日:2025-01-07

    申请号:US17806410

    申请日:2022-06-10

    Applicant: Lemon Inc.

    Abstract: A computer-implemented method for transforming a neural radiance field model is described. A plurality of inputs are provided to a neural radiance field (NeRF) model that represents a 3-dimensional space having a subject, wherein each input of the plurality of inputs includes a location and a view direction and corresponds to respective colors of voxels that represent the 3-dimensional space. A spectral analysis is performed on a plurality of outputs of the NeRF model based on the plurality of inputs, wherein the plurality of outputs include the respective colors of the voxels. Frequency components of the spectral analysis that represent colors for at least some of the voxels are extracted. A sparse volume data structure that represents the 3-dimensional space and the respective colors for the at least some of the voxels is generated.

    Character display method and apparatus, electronic device, and storage medium

    公开(公告)号:US11836437B2

    公开(公告)日:2023-12-05

    申请号:US18060454

    申请日:2022-11-30

    Applicant: Lemon Inc.

    CPC classification number: G06F40/109 G06T19/006

    Abstract: A text display method, a text display apparatus, an electronic device and a storage medium are disclosed. A real scene image and a to-be-displayed text are acquired, motion track data for texts is invoked, the to-be-displayed text is processed with a dynamic special effect, and the text which has been subject to the dynamic special effect processing is displayed on a real scene image, thus realizing a function of displaying a text with dynamic special effect in augmented reality display, making the text display effect more vivid. The display method can be widely used in various application scenarios to bring users a better visual and sensory experience.

    SEGMENTATION CONTOUR SYNCHRONIZATION WITH BEAT

    公开(公告)号:US20220406337A1

    公开(公告)日:2022-12-22

    申请号:US17353441

    申请日:2021-06-21

    Applicant: Lemon Inc.

    Abstract: Systems and methods for rendering a segmentation contour effect are described. More specifically, video data including one or more video frames and audio data are obtained. Based on the video data, one or more segments in each of the one or more video frame are determined. The audio data is analyzed to determine beat characteristics of each beat. A segmentation contour effect to be applied to the one or more segments in the video data is determined based on the beat characteristics. A rendered video is generated by synchronizing the segmentation contour effect to audio data.

    RENDERING VIRTUAL ARTICLES OF CLOTHING BASED ON AUDIO CHARACTERISTICS

    公开(公告)号:US20220406001A1

    公开(公告)日:2022-12-22

    申请号:US17353296

    申请日:2021-06-21

    Applicant: Lemon Inc.

    Abstract: Systems and methods for generating a virtual article of clothing at a display are described. Some examples may include: obtaining video data and audio data, analyzing the video data to determine one or more body joints of a target object appearing in the video data. A mesh based on the determined one or more body joints may be generated. The audio data may be analyzed to determine audio characteristics associated with the audio data. Texture rendering information associated with a virtual article of clothing may be determined based on the audio characteristics. A rendered video may be generated by rendering the virtual article of clothing to the generated mesh using the texture rendering information.

    Animation effect attachment based on audio characteristics

    公开(公告)号:US11521341B1

    公开(公告)日:2022-12-06

    申请号:US17353455

    申请日:2021-06-21

    Applicant: Lemon Inc.

    Abstract: Systems and methods for rendering a video effect to a display are described. More specifically, video data and audio data are obtained. The video data is analyzed to determine one or more attachment points of a target object that appears in the video data. The audio data is analyzed to determine audio characteristics. A video effect associated with an animation to be added to the one or more attachment points is determined based on the audio characteristics. A rendered video is generated by applying the video effect to the video data.

    NOVEL VIEW SYNTHESIS FROM SPARSE VOLUME DATA STRUCTURE

    公开(公告)号:US20230401815A1

    公开(公告)日:2023-12-14

    申请号:US17806410

    申请日:2022-06-10

    Applicant: Lemon Inc.

    CPC classification number: G06V10/513 G06V10/82 G06V10/56

    Abstract: A computer-implemented method for transforming a neural radiance field model is described. A plurality of inputs are provided to a neural radiance field (NeRF) model that represents a 3-dimensional space having a subject, wherein each input of the plurality of inputs includes a location and a view direction and corresponds to respective colors of voxels that represent the 3-dimensional space. A spectral analysis is performed on a plurality of outputs of the NeRF model based on the plurality of inputs, wherein the plurality of outputs include the respective colors of the voxels. Frequency components of the spectral analysis that represent colors for at least some of the voxels are extracted. A sparse volume data structure that represents the 3-dimensional space and the respective colors for the at least some of the voxels is generated.

    CREATION OF VIDEOS USING VIRTUAL CHARACTERS
    9.
    发明公开

    公开(公告)号:US20230377236A1

    公开(公告)日:2023-11-23

    申请号:US17751222

    申请日:2022-05-23

    Applicant: Lemon Inc.

    CPC classification number: G06T13/40 G06T15/04 G06T15/005 G06V40/10

    Abstract: The present disclosure describes techniques for creating videos using virtual characters. Creation of a video may be initiated by a user. Camera input comprising a human body of the user may be received. The camera input may be split into a first stream for removing the human body and a second stream for animating a virtual character in the video. An inpainting filter may be applied to remove the human body in real time from the camera input. The inpainting filter may be configured to accelerate texture sampling. Output of the inpainting filter may be blended with images comprised in the camera input to generate camera input backgrounds.

Patent Agency Ranking