公开(公告)号：US20240144623A1

公开(公告)日：2024-05-02

申请号：US18304147

申请日：2023-04-20

Applicant: Adobe Inc.

Inventor： Giorgio Gori ,  Yi Zhou ,  Yangtuanfeng Wang ,  Yang Zhou ,  Krishna Kumar Singh ,  Jae Shin Yoon ,  Duygu Ceylan Aksit

IPC: G06T19/20 ,  G06T7/70 ,  G06T15/00 ,  G06T17/00

CPC classification number: G06T19/20 ,  G06T7/70 ,  G06T15/00 ,  G06T17/00 ,  G06T2200/24 ,  G06T2207/20084 ,  G06T2207/30196 ,  G06T2207/30244 ,  G06T2219/2004

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images. The disclosed systems further use three-dimensional representations of two-dimensional images to customize focal points for the two-dimensional images.

公开(公告)号：US20250078406A1

公开(公告)日：2025-03-06

申请号：US18242380

申请日：2023-09-05

Applicant: Adobe Inc.

Inventor： Jae Shin Yoon ,  Yangtuanfeng Wang ,  Krishna Kumar Singh ,  Junying Wang ,  Jingwan Lu

IPC: G06T17/10 ,  G06T5/00 ,  G06T7/70

Abstract: A modeling system accesses a two-dimensional (2D) input image displayed via a user interface, the 2D input image depicting, at a first view, a first object. At least one region of the first object is not represented by pixel values of the 2D input image. The modeling system generates, by applying a 3D representation generation model to the 2D input image, a three-dimensional (3D) representation of the first object that depicts an entirety of the first object including the first region. The modeling system displays, via the user interface, the 3D representation, wherein the 3D representation is viewable via the user interface from a plurality of views including the first view.

公开(公告)号：US20240428491A1

公开(公告)日：2024-12-26

申请号：US18340445

申请日：2023-06-23

Applicant: Adobe Inc.

Inventor： Jae Shin Yoon ,  Duygu Ceylan Aksit ,  Yangtuanfeng Wang ,  Jingwan Lu ,  Jimei Yang ,  Zhixin Shu ,  Chengan He ,  Yi Zhou ,  Jun Saito ,  James Zachary

IPC: G06T13/40

Abstract: The present disclosure relates to a system that utilizes neural networks to generate looping animations from still images. The system fits a 3D model to a pose of a person in a digital image. The system receives a 3D animation sequence that transitions between a starting pose and an ending pose. The system generates, utilizing an animation transition neural network, first and second 3D animation transition sequences that respectively transition between the pose of the person and the starting pose and between the ending pose and the pose of the person. The system modifies each of the 3D animation sequence, the first 3D animation transition sequence, and the second 3D animation transition sequence by applying a texture map. The system generates a looping 3D animation by combining the modified 3D animation sequence, the modified first 3D animation transition sequence, and the modified second 3D animation transition sequence.

公开(公告)号：US20240144520A1

公开(公告)日：2024-05-02

申请号：US18304144

申请日：2023-04-20

Applicant: Adobe Inc.

Inventor： Giorgio Gori ,  Yi Zhou ,  Yangtuanfeng Wang ,  Yang Zhou ,  Krishna Kumar Singh ,  Jae Shin Yoon ,  Duygu Ceylan Aksit

IPC: G06T7/73

CPC classification number: G06T7/73 ,  G06T2207/20084 ,  G06T2207/30196

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images. The disclosed systems further use three-dimensional representations of two-dimensional images to customize focal points for the two-dimensional images.