-
公开(公告)号:US20230215062A1
公开(公告)日:2023-07-06
申请号:US17804268
申请日:2022-05-26
Applicant: Snap Inc.
Inventor: Konstantin Gudkov , Sergey Demyanov , Andrei Zharkov , Fedor Zhdanov , Vadim Velicodnii
CPC classification number: G06T11/60 , G06N20/20 , G06T2210/44
Abstract: Systems and methods herein describe an image stylization system. The image stylization system accesses a set of images corresponding to a target domain style, generates a set of paired images using a first machine learning model, analyze the generated set of paired images using a second machine learning model trained to analyze the generated set of paired images based on a plurality of protected feature criteria, determines a set of image transformations for the generated set of pairs, generates a transformed set of paired images by performing the set of image transformations on the set of paired images, and generates stylized images corresponding to the target domain style using a supervised image translation model trained on the transformed set of paired images.
-
公开(公告)号:US20230410479A1
公开(公告)日:2023-12-21
申请号:US17841333
申请日:2022-06-15
Applicant: Snap Inc.
Inventor: Sergey Demyanov , Konstantin Gudkov , Fedor Zhdanov , Andrei Zharkov
CPC classification number: G06V10/774 , G06V10/82 , G06V10/74 , G06V40/16 , G06T3/0093 , G06T11/00 , G06T7/68 , G06T2207/20081 , G06T2207/20084 , G06T2207/30201 , G06T2207/20221
Abstract: An image manipulation system for generating modified images using a generative adversarial network (GAN) trains GANs using domain changes, aligns input images with generated images, classifies and associates target images based on a symmetry, and uses a modified discriminator structure. A method for domain changes includes generating, using a pre-trained GAN trained on a plurality of first target images, a plurality of images, and determining a feature for each of the plurality of images. The method further includes determining the feature for each of a plurality of second target images and matching, based on the feature, second target images of the plurality of second target images with the plurality of images. The method further includes training a discriminator of the pre-trained GAN with the second target images and the plurality of images.
-
公开(公告)号:US20250037436A1
公开(公告)日:2025-01-30
申请号:US18911590
申请日:2024-10-10
Applicant: Snap Inc.
Inventor: Sergey Demyanov , Konstantin Gudkov , Fedor Zhdanov , Andrei Zharkov
Abstract: An image manipulation system for generating modified images using a generative adversarial network (GAN) trains GANs using domain changes, aligns input images with generated images, classifies and associates target images based on a symmetry, and uses a modified discriminator structure. A method for domain changes includes generating, using a pre-trained GAN trained on a plurality of first target images, a plurality of images, and determining a feature for each of the plurality of images. The method further includes determining the feature for each of a plurality of second target images and matching, based on the feature, second target images of the plurality of second target images with the plurality of images. The method further includes training a discriminator of the pre-trained GAN with the second target images and the plurality of images.
-
公开(公告)号:US20220207355A1
公开(公告)日:2022-06-30
申请号:US17318658
申请日:2021-05-12
Applicant: Snap Inc.
Inventor: Sergey Demyanov , Konstantin Gudkov , Aleksei Stoliar , Roman Ushakov , Fedor Zhdanov
Abstract: Systems and methods herein describe an image manipulation system for generating modified images using a generative adversarial network. The image manipulation system accesses a pre-trained generative adversarial network (GAN), fine-tunes the pre-trained GAN by training a portion of existing neural network layers of the pre-trained GAN and newly added layers of the pre-trained GAN on a secondary image domain, adjusts the weights of the fine-tuned GAN using the weights of the pre-trained GAN, and stores the fine-tuned GAN. An image transformation system uses the generated modified images to train a subsequent neural network, which can access a face from a client device and transform it to a domain of images used for GAN fine-tuning.
-
公开(公告)号:US11900565B2
公开(公告)日:2024-02-13
申请号:US18116682
申请日:2023-03-02
Applicant: Snap Inc.
Inventor: Sergey Demyanov , Aleksei Podkin , Aleksei Stoliar , Vadim Velicodnii , Fedor Zhdanov
CPC classification number: G06T5/001 , G06T5/10 , G06T2200/16 , G06T2207/10004 , G06T2207/20048 , G06T2207/20081 , G06T2207/30196 , H04L51/10
Abstract: A data item is identified on a device. A neural network that includes an adversarial transformation subnetwork is applied to the data item to generate a modified data item. Output indicative of the modified data item is caused to be presented on the device. The neural network further comprises an encoder and a decoder. The neural network is trained in at least two stages. At least one of the encoder and the decoder is trained in a first stage and the adversarial transformation subnetwork is trained in a second stage.
-
公开(公告)号:US20230206398A1
公开(公告)日:2023-06-29
申请号:US18116682
申请日:2023-03-02
Applicant: Snap Inc.
Inventor: Sergey Demyanov , Aleksei Podkin , Aleksei Stoliar , Vadim Velicodnii , Fedor Zhdanov
CPC classification number: G06T5/001 , G06T5/10 , G06T2207/20081 , H04L51/10
Abstract: A data item is identified on a device. A neural network that includes an adversarial transformation subnetwork is applied to the data item to generate a modified data item. Output indicative of the modified data item is caused to be presented on the device. The neural network further comprises an encoder and a decoder. The neural network is trained in at least two stages. At least one of the encoder and the decoder is trained in a first stage and the adversarial transformation subnetwork is trained in a second stage.
-
公开(公告)号:US12148202B2
公开(公告)日:2024-11-19
申请号:US17841333
申请日:2022-06-15
Applicant: Snap Inc.
Inventor: Sergey Demyanov , Konstantin Gudkov , Fedor Zhdanov , Andrei Zharkov
Abstract: An image manipulation system for generating modified images using a generative adversarial network (GAN) trains GANs using domain changes, aligns input images with generated images, classifies and associates target images based on a symmetry, and uses a modified discriminator structure. A method for domain changes includes generating, using a pre-trained GAN trained on a plurality of first target images, a plurality of images, and determining a feature for each of the plurality of images. The method further includes determining the feature for each of a plurality of second target images and matching, based on the feature, second target images of the plurality of second target images with the plurality of images. The method further includes training a discriminator of the pre-trained GAN with the second target images and the plurality of images.
-
公开(公告)号:US11657479B2
公开(公告)日:2023-05-23
申请号:US17445362
申请日:2021-08-18
Applicant: Snap Inc.
Inventor: Sergey Demyanov , Aleksei Podkin , Aleksei Stoliar , Vadim Velicodnii , Fedor Zhdanov
CPC classification number: G06T5/001 , G06T5/10 , G06T2200/16 , G06T2207/10004 , G06T2207/20048 , G06T2207/20081 , G06T2207/30196 , H04L51/10
Abstract: A mobile device can implement a neural network-based domain transfer scheme to modify an image in a first domain appearance to a second domain appearance. The domain transfer scheme can be configured to detect an object in the image, apply an effect to the image, and blend the image using color space adjustments and blending schemes to generate a realistic result image. The domain transfer scheme can further be configured to efficiently execute on the constrained device by removing operational layers based on resources available on the mobile device.
-
公开(公告)号:US20210383509A1
公开(公告)日:2021-12-09
申请号:US17445362
申请日:2021-08-18
Applicant: Snap Inc.
Inventor: Sergey Demyanov , Aleksei Podkin , Aleksei Stoliar , Vadim Velicodnii , Fedor Zhdanov
Abstract: A mobile device can implement a neural network-based domain transfer scheme to modify an image in a first domain appearance to a second domain appearance. The domain transfer scheme can be configured to detect an object in the image, apply an effect to the image, and blend the image using color space adjustments and blending schemes to generate a realistic result image. The domain transfer scheme can further be configured to efficiently execute on the constrained device by removing operational layers based on resources available on the mobile device.
-
公开(公告)号:US11120526B1
公开(公告)日:2021-09-14
申请号:US16376564
申请日:2019-04-05
Applicant: Snap Inc.
Inventor: Sergey Demyanov , Aleksei Podkin , Aleksei Stoliar , Vadim Velicodnii , Fedor Zhdanov
Abstract: A mobile device can implement a neural network-based domain transfer scheme to modify an image in a first domain appearance to a second domain appearance. The domain transfer scheme can be configured to detect an object in the image, apply an effect to the image, and blend the image using color space adjustments and blending schemes to generate a realistic result image. The domain transfer scheme can further be configured to efficiently execute on the constrained device by removing operational layers based on resources available on the mobile device.
-
-
-
-
-
-
-
-
-