-
11.发明授权公开(公告)号：US12026817B2
公开(公告)日：2024-07-02
申请号：US17869799
申请日：2022-07-21
Applicant: Snap Inc.
Inventor： Sergei Gorbatyuk , Nikolai Smirnov , Aleksandr Mashrabov , Egor Nemchinov
IPC: G09G5/00 , G06F3/0482 , G06F3/04845 , G06T7/194 , G06T7/20 , G06T7/70 , G06T13/40 , G06T19/00
CPC classification number: G06T13/40 , G06F3/0482 , G06F3/04845 , G06T7/194 , G06T7/20 , G06T7/70 , G06T19/00 , G06T2200/24 , G06T2207/10016 , G06T2207/30196
Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes receiving an input image that includes an image of a body, receiving, through an interface, a user input including parameters associated with a motion, generating, based on the image of the body and the parameters associated with the motion, a video featuring the body repeating the motion, and providing an option to share the parameters associated with the motion with a further user of a further computing device. The method further includes, prior to generating the video, receiving a further user input including a hair animation effect selected from a list of hair animation effects, and while generating the video, applying the hair animation effect to a hair image in frames of the video.
-
公开(公告)号：US11847756B2
公开(公告)日：2023-12-19
申请号：US17506215
申请日：2021-10-20
Applicant: Snap Inc.
Inventor： Gleb Dmukhin , Egor Nemchinov , Yurii Volkov
CPC classification number: G06T19/20 , G06N3/02 , G06T17/205 , H04L51/10
Abstract: A messaging system processes three-dimensional (3D) models to generate ground truths for training machine learning models for applications of the messaging system. A method of generating ground truths for machine learning includes generating a plurality of first rendered images from a first 3D base model where each first rendered image includes the 3D base model modified by first augmentations of a plurality of augmentations. The method further includes determining for a second 3D base model incompatible augmentations of the first plurality of augmentations, where the incompatible augmentations indicate changes to fixed features of the second 3D base model, and generating a plurality of second rendered images from a second 3D base model, each second rendered image comprising the second 3D base model modified by second augmentations, the second augmentations corresponding to the first augmentations of a corresponding first rendered image, where the second augmentations comprises augmentations of the first augmentations that are not incompatible augmentations.
-
公开(公告)号：US20230343012A1
公开(公告)日：2023-10-26
申请号：US18214538
申请日：2023-06-27
Applicant: Snap Inc.
Inventor： Egor Nemchinov , Sergei Gorbatyuk , Aleksandr Mashrabov , Egor Spirin , Iaroslav Sokolov , Andrei Smirdin , Igor Tukh
Abstract: Systems and methods for single image-based body animation are provided. An example method includes receiving an input image including an image of a body of a person, fitting a model to the image of the body of the person, where the model is configured to receive a set of pose parameters corresponding to a pose of the body and generate, based on the set of pose parameters, an output image including an image of the body adopting the pose, receiving a further set of pose parameters corresponding to a further pose of the body, providing the further set of pose parameters to the model to generate the output image of the body adopting the further pose, and generating, based on the output image, a frame of an output video including the output image.
-
公开(公告)号：US20220207819A1
公开(公告)日：2022-06-30
申请号：US17506248
申请日：2021-10-20
Applicant: Snap Inc.
Inventor： Gleb Dmukhin , Egor Nemchinov , Yurii Volkov
Abstract: A messaging system performs image processing to estimate lighting properties with neural networks for images provided by users of the messaging system. A method of estimating light properties includes receiving an input image with first lighting properties and processing the input image using a convolutional neural network to generate an estimate of the first lighting properties. The method may further include modifying the input image with an augmentation to generate a modified input image, where the augmentation has second lighting properties, and changing the second lighting properties of the augmentation in the modified input image to the estimate of the first lighting properties.
-
公开(公告)号：US20240070976A1
公开(公告)日：2024-02-29
申请号：US18387212
申请日：2023-11-06
Applicant: Snap Inc.
Inventor： Yurii Volkov , Egor Nemchinov , Gleb Dmukhin
CPC classification number: G06T15/503 , G06T7/75 , G06T15/506 , G06T19/20 , G06T2200/24 , G06T2207/20081 , G06T2207/20084 , G06T2219/2012
Abstract: A messaging system performs image processing to relight objects with neural networks for images provided by users of the messaging system. A method of relighting objects with neural networks includes receiving an input image with first lighting properties comprising an object with second lighting properties and processing the input image using a convolutional neural network to generate an output image with the first lighting properties and comprising the object with third lighting properties, where the convolutional neural network is trained to modify the second lighting properties to be consistent with lighting conditions indicated by the first lighting properties to generate the third lighting properties. The method further includes modifying the second lighting properties of the object to generate the object with modified second lighting properties and blending the third lighting properties with the modified second lighting properties to generate a modified output image comprising the object with fourth lighting properties.
-
Patent Agency Ranking
公开(公告)号：US20240062500A1
公开(公告)日：2024-02-22
申请号：US18386515
申请日：2023-11-02
Applicant: Snap Inc.
Inventor： Gleb Dmukhin , Egor Nemchinov , Yurii Volkov
CPC classification number: G06T19/20 , G06N3/02 , G06T17/205 , H04L51/10
Abstract: A messaging system processes three-dimensional (3D) models to generate ground truths for training machine learning models for applications of the messaging system. A method of generating ground truths for machine learning includes generating a plurality of first rendered images from a first 3D base model where each first rendered image includes the 3D base model modified by first augmentations of a plurality of augmentations. The method further includes determining for a second 3D base model incompatible augmentations of the first plurality of augmentations, where the incompatible augmentations indicate changes to fixed features of the second 3D base model, and generating a plurality of second rendered images from a second 3D base model, each second rendered image comprising the second 3D base model modified by second augmentations, the second augmentations corresponding to the first augmentations of a corresponding first rendered image, where the second augmentations comprises augmentations of the first augmentations that are not incompatible augmentations.
-
公开(公告)号：US20230118572A1
公开(公告)日：2023-04-20
申请号：US17506215
申请日：2021-10-20
Applicant: Snap Inc.
Inventor： Gleb Dmukhin , Egor Nemchinov , Yurii Volkov
Abstract: A messaging system processes three-dimensional (3D) models to generate ground truths for training machine learning models for applications of the messaging system. A method of generating ground truths for machine learning includes generating a plurality of first rendered images from a first 3D base model where each first rendered image includes the 3D base model modified by first augmentations of a plurality of augmentations. The method further includes determining for a second 3D base model incompatible augmentations of the first plurality of augmentations, where the incompatible augmentations indicate changes to fixed features of the second 3D base model, and generating a plurality of second rendered images from a second 3D base model, each second rendered image comprising the second 3D base model modified by second augmentations, the second augmentations corresponding to the first augmentations of a corresponding first rendered image, where the second augmentations comprises augmentations of the first augmentations that are not incompatible augmentations.
-
18.发明申请公开(公告)号：US20220358707A1
公开(公告)日：2022-11-10
申请号：US17869799
申请日：2022-07-21
Applicant: Snap Inc.
Inventor： Sergei Gorbatyuk , Nikolai Smirnov , Aleksandr Mashrabov , Egor Nemchinov
IPC: G06T13/40 , G06T7/194 , G06T7/70 , G06F3/0482 , G06F3/04845 , G06T7/20 , G06T19/00
Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes receiving an input image that includes an image of a body, receiving, through an interface, a user input including parameters associated with a motion, generating, based on the image of the body and the parameters associated with the motion, a video featuring the body repeating the motion, and providing an option to share the parameters associated with the motion with a further user of a further computing device. The method further includes, prior to generating the video, receiving a further user input including a hair animation effect selected from a list of hair animation effects, and while generating the video, applying the hair animation effect to a hair image in frames of the video.
-
公开(公告)号：US20220207810A1
公开(公告)日：2022-06-30
申请号：US17695902
申请日：2022-03-16
Applicant: Snap Inc.
Inventor： Egor Nemchinov , Sergei Gorbatyuk , Aleksandr Mashrabov , Egor Spirin , Iaroslav Sokolov , Andrei Smirdin , Igor Tukh
Abstract: Disclosed are systems and methods for single image-based body animation. An example method includes receiving an input image, the input image including a body image of a person, extracting the body image of the person from the input image, fitting a generic model to the body image, where the generic model is configured to receive a set of pose parameters corresponding to a pose of the person and generate a generic body shape adopting the pose, generating a three-dimensional (3D) model, where the 3D model is configured to receive a set of further pose parameters corresponding to the pose of the person and generate an output image of the person adopting the pose, the output image including a feature of the body image being omitted from the generic body shape, and providing a further set of further pose parameters to generate a frame of an output video.
-
公开(公告)号：US20220101596A1
公开(公告)日：2022-03-31
申请号：US17385462
申请日：2021-07-26
Applicant: Snap Inc.
Inventor： Yuriy Volkov , Egor Nemchinov , Gleb Dmukhin
Abstract: A messaging system performs image processing to relight objects with neural networks for images provided by users of the messaging system. A method of relighting objects with neural networks includes receiving an input image with first lighting properties comprising an object with second lighting properties and processing the input image using a convolutional neural network to generate an output image with the first lighting properties and comprising the object with third lighting properties, where the convolutional neural network is trained to modify the second lighting properties to be consistent with lighting conditions indicated by the first lighting properties to generate the third lighting properties. The method further includes modifying the second lighting properties of the object to generate the object with modified second lighting properties and blending the third lighting properties with the modified second lighting properties to generate a modified output image comprising the object with fourth lighting properties.
-
-
-
-
-
-
-
-
-
Search Results
20
records
(took 0.016 seconds)
