-
公开(公告)号:US20240144623A1
公开(公告)日:2024-05-02
申请号:US18304147
申请日:2023-04-20
Applicant: Adobe Inc.
Inventor: Giorgio Gori , Yi Zhou , Yangtuanfeng Wang , Yang Zhou , Krishna Kumar Singh , Jae Shin Yoon , Duygu Ceylan Aksit
CPC classification number: G06T19/20 , G06T7/70 , G06T15/00 , G06T17/00 , G06T2200/24 , G06T2207/20084 , G06T2207/30196 , G06T2207/30244 , G06T2219/2004
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images. The disclosed systems further use three-dimensional representations of two-dimensional images to customize focal points for the two-dimensional images.
-
公开(公告)号:US11830138B2
公开(公告)日:2023-11-28
申请号:US17206813
申请日:2021-03-19
Applicant: ADOBE INC.
Inventor: Duygu Ceylan Aksit , Mianlun Zheng , Yi Zhou
Abstract: Various disclosed embodiments are directed to estimating that a first vertex of a patch will change from a first position to a second position (the second position being at least partially indicative of secondary motion) based at least in part on one or more features of: primary motion data, one or more material properties, and constraint data associated with the particular patch. Such estimation can be made for some or all of the patches of an entire volumetric mesh in order to accurately predict the overall secondary motion of an object. This, among other functionality described herein resolves the inaccuracies, computer resource consumption, and the user experience of existing technologies.
-
公开(公告)号:US11978144B2
公开(公告)日:2024-05-07
申请号:US17875081
申请日:2022-07-27
Applicant: Adobe Inc.
Inventor: Yi Zhou , Yangtuanfeng Wang , Xin Sun , Qingyang Tan , Duygu Ceylan Aksit
CPC classification number: G06T13/40 , G06T2210/16 , G06T2210/21
Abstract: Embodiments are disclosed for using machine learning models to perform three-dimensional garment deformation due to character body motion with collision handling. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input, the input including character body shape parameters and character body pose parameters defining a character body, and garment parameters. The disclosed systems and methods further comprise generating, by a first neural network, a first set of garment vertices defining deformations of a garment with the character body based on the input. The disclosed systems and methods further comprise determining, by a second neural network, that the first set of garment vertices includes a second set of garment vertices penetrating the character body. The disclosed systems and methods further comprise modifying, by a third neural network, each garment vertex in the second set of garment vertices to positions outside the character body.
-
公开(公告)号:US20240046566A1
公开(公告)日:2024-02-08
申请号:US17816813
申请日:2022-08-02
Applicant: ADOBE INC.
Inventor: Jimei Yang , Chun-han Yao , Duygu Ceylan Aksit , Yi Zhou
IPC: G06T17/20
CPC classification number: G06T17/20
Abstract: Systems and methods for mesh generation are described. One aspect of the systems and methods includes receiving an image depicting a visible portion of a body; generating an intermediate mesh representing the body based on the image; generating visibility features indicating whether parts of the body are visible based on the image; generating parameters for a morphable model of the body based on the intermediate mesh and the visibility features; and generating an output mesh representing the body based on the parameters for the morphable model, wherein the output mesh includes a non-visible portion of the body that is not depicted by the image.
-
公开(公告)号:US10964084B2
公开(公告)日:2021-03-30
申请号:US16451813
申请日:2019-06-25
Applicant: Adobe Inc.
Inventor: Jingwan Lu , Yi Zhou , Connelly Barnes , Jimei Yang
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating a digital animation of a digital animation character by utilizing a generative adversarial network and a hip motion prediction network. For example, the disclosed systems can utilize an unconditional generative adversarial network to generate a sequence of local poses of a digital animation character based on an input of a random code vector. The disclosed systems can also utilize a conditional generative adversarial network to generate a sequence of local poses based on an input of a set of keyframes. Based on the sequence of local poses, the disclosed systems can utilize a hip motion prediction network to generate a sequence of global poses based on hip velocities. In addition, the disclosed systems can generate an animation of a digital animation character based on the sequence of global poses.
-
公开(公告)号:US20240378809A1
公开(公告)日:2024-11-14
申请号:US18316490
申请日:2023-05-12
Applicant: Adobe Inc.
Inventor: Yangtuanfeng Wang , Yi Zhou , Yasamin Jafarian , Nathan Aaron Carr , Jimei Yang , Duygu Ceylan Aksit
IPC: G06T17/20
Abstract: Decal application techniques as implemented by a computing device are described to perform decaling of a digital image. In one example, learned features of a digital image using machine learning are used by a computing device as a basis to predict the surface geometry of an object in the digital image. Once the surface geometry of the object is predicted, machine learning techniques are then used by the computing device to configure an overlay object to be applied onto the digital image according to the predicted surface geometry of the overlaid object.
-
公开(公告)号:US12067680B2
公开(公告)日:2024-08-20
申请号:US17816813
申请日:2022-08-02
Applicant: ADOBE INC.
Inventor: Jimei Yang , Chun-han Yao , Duygu Ceylan Aksit , Yi Zhou
IPC: G06T17/20
CPC classification number: G06T17/20
Abstract: Systems and methods for mesh generation are described. One aspect of the systems and methods includes receiving an image depicting a visible portion of a body; generating an intermediate mesh representing the body based on the image; generating visibility features indicating whether parts of the body are visible based on the image; generating parameters for a morphable model of the body based on the intermediate mesh and the visibility features; and generating an output mesh representing the body based on the parameters for the morphable model, wherein the output mesh includes a non-visible portion of the body that is not depicted by the image.
-
公开(公告)号:US20240428491A1
公开(公告)日:2024-12-26
申请号:US18340445
申请日:2023-06-23
Applicant: Adobe Inc.
Inventor: Jae Shin Yoon , Duygu Ceylan Aksit , Yangtuanfeng Wang , Jingwan Lu , Jimei Yang , Zhixin Shu , Chengan He , Yi Zhou , Jun Saito , James Zachary
IPC: G06T13/40
Abstract: The present disclosure relates to a system that utilizes neural networks to generate looping animations from still images. The system fits a 3D model to a pose of a person in a digital image. The system receives a 3D animation sequence that transitions between a starting pose and an ending pose. The system generates, utilizing an animation transition neural network, first and second 3D animation transition sequences that respectively transition between the pose of the person and the starting pose and between the ending pose and the pose of the person. The system modifies each of the 3D animation sequence, the first 3D animation transition sequence, and the second 3D animation transition sequence by applying a texture map. The system generates a looping 3D animation by combining the modified 3D animation sequence, the modified first 3D animation transition sequence, and the modified second 3D animation transition sequence.
-
9.
公开(公告)号:US20240144520A1
公开(公告)日:2024-05-02
申请号:US18304144
申请日:2023-04-20
Applicant: Adobe Inc.
Inventor: Giorgio Gori , Yi Zhou , Yangtuanfeng Wang , Yang Zhou , Krishna Kumar Singh , Jae Shin Yoon , Duygu Ceylan Aksit
IPC: G06T7/73
CPC classification number: G06T7/73 , G06T2207/20084 , G06T2207/30196
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images. The disclosed systems further use three-dimensional representations of two-dimensional images to customize focal points for the two-dimensional images.
-
公开(公告)号:US20220301262A1
公开(公告)日:2022-09-22
申请号:US17206813
申请日:2021-03-19
Applicant: ADOBE INC.
Inventor: Duygu Ceylan Aksit , Mianlun Zheng , Yi Zhou
Abstract: Various disclosed embodiments are directed to estimating that a first vertex of a patch will change from a first position to a second position (the second position being at least partially indicative of secondary motion) based at least in part on one or more features of: primary motion data, one or more material properties, and constraint data associated with the particular patch. Such estimation can be made for some or all of the patches of an entire volumetric mesh in order to accurately predict the overall secondary motion of an object. This, among other functionality described herein resolves the inaccuracies, computer resource consumption, and the user experience of existing technologies.
-
-
-
-
-
-
-
-
-