-
公开(公告)号:US20230377556A1
公开(公告)日:2023-11-23
申请号:US17751324
申请日:2022-05-23
Applicant: Lemon Inc.
Inventor: Zeng Dai , Chen Sun , Ari Shapiro , Kin Chung Wong , Weishan Yu , August Yadon
CPC classification number: G10L13/02 , G06T13/40 , G06T13/205
Abstract: The present disclosure describes techniques of generating voices for virtual characters. A plurality of source sounds may be received. The plurality of source sounds may correspond to a plurality of frames of a video. The video may comprise a virtual character. The plurality of source sounds may be converted into a plurality of representations in a latent space using a first model. Each representation among the plurality of representations may comprise a plurality of parameters. The plurality of parameters may correspond to a plurality of sound features. A plurality of sounds may be generated in real time for the virtual character in the video based at least in part on modifying at least one of the plurality of parameters of each representation.
-
公开(公告)号:US20230283864A1
公开(公告)日:2023-09-07
申请号:US17589673
申请日:2022-01-31
Applicant: Lemon Inc.
Inventor: Masoud Loghmani , Seong Kuan Wang , Yanli Li , Chenyu Li , Dong Zhao , Xingyi Shi , Jingjing Zhao , Nick Newberg , Lin Zhou , Guangyao Ni , Jian Huang , Chen Sun , Richard F. Tucker
IPC: H04N21/8545 , H04N21/81 , H04N21/431
CPC classification number: H04N21/8545 , H04N21/4312 , H04N21/8146
Abstract: The present disclosure describes techniques for facilitating interaction with content using interactive effects. The techniques comprise receiving a video from a first computing device associated with a first user among a plurality of users. The video is generated using an interactive effect. The interactive effect comprises overlaying at least one component on at least one subset of frames of the video. The interactive effect enables the video to be interacted with other users among the plurality of users. The video is presented on a second computing device associated with a second user among the plurality of users. The video comprises information indicative of instructions on how to interact with the video. Display of an animation associated with the at least one component may be automatically caused on the second computing device in response to receiving an indication of interacting with the video by the second user.
-
公开(公告)号:US20220406337A1
公开(公告)日:2022-12-22
申请号:US17353441
申请日:2021-06-21
Applicant: Lemon Inc.
Inventor: Yunzhu Li , Zihao Chen , Chen Sun
IPC: G11B27/031
Abstract: Systems and methods for rendering a segmentation contour effect are described. More specifically, video data including one or more video frames and audio data are obtained. Based on the video data, one or more segments in each of the one or more video frame are determined. The audio data is analyzed to determine beat characteristics of each beat. A segmentation contour effect to be applied to the one or more segments in the video data is determined based on the beat characteristics. A rendered video is generated by synchronizing the segmentation contour effect to audio data.
-
公开(公告)号:US20220406001A1
公开(公告)日:2022-12-22
申请号:US17353296
申请日:2021-06-21
Applicant: Lemon Inc.
Inventor: Yunzhu Li , Haiying Cheng , Chen Sun
Abstract: Systems and methods for generating a virtual article of clothing at a display are described. Some examples may include: obtaining video data and audio data, analyzing the video data to determine one or more body joints of a target object appearing in the video data. A mesh based on the determined one or more body joints may be generated. The audio data may be analyzed to determine audio characteristics associated with the audio data. Texture rendering information associated with a virtual article of clothing may be determined based on the audio characteristics. A rendered video may be generated by rendering the virtual article of clothing to the generated mesh using the texture rendering information.
-
公开(公告)号:US11521341B1
公开(公告)日:2022-12-06
申请号:US17353455
申请日:2021-06-21
Applicant: Lemon Inc.
Inventor: Yunzhu Li , Chen Sun , Gamze Inanc
Abstract: Systems and methods for rendering a video effect to a display are described. More specifically, video data and audio data are obtained. The video data is analyzed to determine one or more attachment points of a target object that appears in the video data. The audio data is analyzed to determine audio characteristics. A video effect associated with an animation to be added to the one or more attachment points is determined based on the audio characteristics. A rendered video is generated by applying the video effect to the video data.
-
公开(公告)号:US12192597B2
公开(公告)日:2025-01-07
申请号:US17589673
申请日:2022-01-31
Applicant: Lemon Inc.
Inventor: Masoud Loghmani , Seong Kuan Wang , Yanli Li , Chenyu Li , Dong Zhao , Xingyi Shi , Jingjing Zhao , Nick Newberg , Lin Zhou , Guangyao Ni , Jian Huang , Chen Sun , Richard F. Tucker
IPC: H04N21/8545 , H04N21/431 , H04N21/81
Abstract: The present disclosure describes techniques for facilitating interaction with content using interactive effects. The techniques comprise receiving a video from a first computing device associated with a first user among a plurality of users. The video is generated using an interactive effect. The interactive effect comprises overlaying at least one component on at least one subset of frames of the video. The interactive effect enables the video to be interacted with other users among the plurality of users. The video is presented on a second computing device associated with a second user among the plurality of users. The video comprises information indicative of instructions on how to interact with the video. Display of an animation associated with the at least one component may be automatically caused on the second computing device in response to receiving an indication of interacting with the video by the second user.
-
公开(公告)号:US11769289B2
公开(公告)日:2023-09-26
申请号:US17353296
申请日:2021-06-21
Applicant: Lemon Inc.
Inventor: Yunzhu Li , Haiying Cheng , Chen Sun
CPC classification number: G06T15/04 , G06T13/205 , G06T17/20 , G06V40/10 , G10L25/03 , G10L25/48 , G06T2210/16 , G06T2210/62
Abstract: Systems and methods for generating a virtual article of clothing at a display are described. Some examples may include: obtaining video data and audio data, analyzing the video data to determine one or more body joints of a target object appearing in the video data. A mesh based on the determined one or more body joints may be generated. The audio data may be analyzed to determine audio characteristics associated with the audio data. Texture rendering information associated with a virtual article of clothing may be determined based on the audio characteristics. A rendered video may be generated by rendering the virtual article of clothing to the generated mesh using the texture rendering information.
-
公开(公告)号:US11481945B1
公开(公告)日:2022-10-25
申请号:US17353455
申请日:2021-06-21
Applicant: Lemon Inc.
Inventor: Yunzhu Li , Chen Sun , Gamze Inanc
Abstract: Systems and methods for rendering a video effect to a display are described. More specifically, video data and audio data are obtained. The video data is analyzed to determine one or more attachment points of a target object that appears in the video data. The audio data is analyzed to determine audio characteristics. A video effect associated with an animation to be added to the one or more attachment points is determined based on the audio characteristics. A rendered video is generated by applying the video effect to the video data.
-
-
-
-
-
-
-