VOICE GENERATION FOR VIRTUAL CHARACTERS
    1.
    发明公开

    公开(公告)号:US20230377556A1

    公开(公告)日:2023-11-23

    申请号:US17751324

    申请日:2022-05-23

    Applicant: Lemon Inc.

    CPC classification number: G10L13/02 G06T13/40 G06T13/205

    Abstract: The present disclosure describes techniques of generating voices for virtual characters. A plurality of source sounds may be received. The plurality of source sounds may correspond to a plurality of frames of a video. The video may comprise a virtual character. The plurality of source sounds may be converted into a plurality of representations in a latent space using a first model. Each representation among the plurality of representations may comprise a plurality of parameters. The plurality of parameters may correspond to a plurality of sound features. A plurality of sounds may be generated in real time for the virtual character in the video based at least in part on modifying at least one of the plurality of parameters of each representation.

    SEGMENTATION CONTOUR SYNCHRONIZATION WITH BEAT

    公开(公告)号:US20220406337A1

    公开(公告)日:2022-12-22

    申请号:US17353441

    申请日:2021-06-21

    Applicant: Lemon Inc.

    Abstract: Systems and methods for rendering a segmentation contour effect are described. More specifically, video data including one or more video frames and audio data are obtained. Based on the video data, one or more segments in each of the one or more video frame are determined. The audio data is analyzed to determine beat characteristics of each beat. A segmentation contour effect to be applied to the one or more segments in the video data is determined based on the beat characteristics. A rendered video is generated by synchronizing the segmentation contour effect to audio data.

    RENDERING VIRTUAL ARTICLES OF CLOTHING BASED ON AUDIO CHARACTERISTICS

    公开(公告)号:US20220406001A1

    公开(公告)日:2022-12-22

    申请号:US17353296

    申请日:2021-06-21

    Applicant: Lemon Inc.

    Abstract: Systems and methods for generating a virtual article of clothing at a display are described. Some examples may include: obtaining video data and audio data, analyzing the video data to determine one or more body joints of a target object appearing in the video data. A mesh based on the determined one or more body joints may be generated. The audio data may be analyzed to determine audio characteristics associated with the audio data. Texture rendering information associated with a virtual article of clothing may be determined based on the audio characteristics. A rendered video may be generated by rendering the virtual article of clothing to the generated mesh using the texture rendering information.

    Animation effect attachment based on audio characteristics

    公开(公告)号:US11521341B1

    公开(公告)日:2022-12-06

    申请号:US17353455

    申请日:2021-06-21

    Applicant: Lemon Inc.

    Abstract: Systems and methods for rendering a video effect to a display are described. More specifically, video data and audio data are obtained. The video data is analyzed to determine one or more attachment points of a target object that appears in the video data. The audio data is analyzed to determine audio characteristics. A video effect associated with an animation to be added to the one or more attachment points is determined based on the audio characteristics. A rendered video is generated by applying the video effect to the video data.

    Content creation using interactive effects

    公开(公告)号:US12192597B2

    公开(公告)日:2025-01-07

    申请号:US17589673

    申请日:2022-01-31

    Applicant: Lemon Inc.

    Abstract: The present disclosure describes techniques for facilitating interaction with content using interactive effects. The techniques comprise receiving a video from a first computing device associated with a first user among a plurality of users. The video is generated using an interactive effect. The interactive effect comprises overlaying at least one component on at least one subset of frames of the video. The interactive effect enables the video to be interacted with other users among the plurality of users. The video is presented on a second computing device associated with a second user among the plurality of users. The video comprises information indicative of instructions on how to interact with the video. Display of an animation associated with the at least one component may be automatically caused on the second computing device in response to receiving an indication of interacting with the video by the second user.

    Animation effect attachment based on audio characteristics

    公开(公告)号:US11481945B1

    公开(公告)日:2022-10-25

    申请号:US17353455

    申请日:2021-06-21

    Applicant: Lemon Inc.

    Abstract: Systems and methods for rendering a video effect to a display are described. More specifically, video data and audio data are obtained. The video data is analyzed to determine one or more attachment points of a target object that appears in the video data. The audio data is analyzed to determine audio characteristics. A video effect associated with an animation to be added to the one or more attachment points is determined based on the audio characteristics. A rendered video is generated by applying the video effect to the video data.

Patent Agency Ranking