-
公开(公告)号：US20240338915A1
公开(公告)日：2024-10-10
申请号：US18132272
申请日：2023-04-07
Applicant: Adobe Inc.
Inventor： Zhixin Shu , Zexiang Xu , Shahrukh Athar , Sai Bi , Kalyan Sunkavalli , Fujun Luan
CPC classification number: G06T19/20 , G06N3/08 , G06T15/80 , G06T17/20 , G06T2210/44 , G06T2219/2012 , G06T2219/2021
Abstract: Certain aspects and features of this disclosure relate to providing a controllable, dynamic appearance for neural 3D portraits. For example, a method involves projecting a color at points in a digital video portrait based on location, surface normal, and viewing direction for each respective point in a canonical space. The method also involves projecting, using the color, dynamic face normals for the points as changing according to an articulated head pose and facial expression in the digital video portrait. The method further involves disentangling, based on the dynamic face normals, a facial appearance in the digital video portrait into intrinsic components in the canonical space. The method additionally involves storing and/or rendering at least a portion of a head pose as a controllable, neural 3D portrait based on the digital video portrait using the intrinsic components.
-
公开(公告)号：US20250104349A1
公开(公告)日：2025-03-27
申请号：US18894176
申请日：2024-09-24
Applicant: ADOBE INC.
Inventor： Sai Bi , Jiahao Li , Hao Tan , Kai Zhang , Zexiang Xu , Fujun Luan , Yinghao Xu , Yicong Hong , Kalyan K. Sunkavalli
Abstract: A method, apparatus, non-transitory computer readable medium, and system for 3D model generation include obtaining a plurality of input images depicting an object and a set of 3D position embeddings, where each of the plurality of input images depicts the object from a different perspective, encoding the plurality of input images to obtain a plurality of 2D features corresponding to the plurality of input images, respectively, generating 3D features based on the plurality of 2D features and the set of 3D position embeddings, and generating a 3D model of the object based on the 3D features.
-
公开(公告)号：US20250029323A1
公开(公告)日：2025-01-23
申请号：US18354855
申请日：2023-07-19
Applicant: Adobe Inc.
Inventor： Krishna Bhargava Mullia Lakshminarayana , Xin Sun , Miloš Hašan , Fujun Luan
Abstract: Techniques for generation of compressed representations for appearance of fiber-based digital assets are described that support computationally efficient and high fidelity rendering of digital assets that include fiber primitives under a variety of lighting conditions and view directions. A processing device, for instance, receives a digital asset that includes fiber primitives to be included in a three-dimensional digital scene. The processing device generates a compressed representation of the digital asset that maintains a geometry of the digital asset and includes a precomputed light transport. The processing device then inserts the compressed representation into the digital scene, such as at a location relative to one or more light sources. The content processing system applies one or more lighting effects to the compressed representation based on the precomputed light transport and the location relative to the one or more light sources.
-
Patent Agency Ranking
公开(公告)号：US12211138B2
公开(公告)日：2025-01-28
申请号：US18065456
申请日：2022-12-13
Applicant: Adobe Inc.
Inventor： Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Kalyan K. Sunkavalli
Abstract: Embodiments of the present disclosure provide systems, methods, and computer storage media for generating editable synthesized views of scenes by inputting image rays into neural networks using neural basis decomposition. In embodiments, a set of input images of a scene depicting at least one object are collected and used to generate a plurality of rays of the scene. The rays each correspond to three-dimensional coordinates and viewing angles taken from the images. A volume density of the scene is determined by inputting the three-dimensional coordinates from the neural radiance fields into a first neural network to generate a 3D geometric representation of the object. An appearance decomposition is produced by inputting the three-dimensional coordinates and the viewing angles of the rays into a second neural network.
-
公开(公告)号：US20240169653A1
公开(公告)日：2024-05-23
申请号：US17993854
申请日：2022-11-23
Applicant: Adobe Inc. , The Regents of the University of California
Inventor： Krishna Bhargava Mullia Lakshminarayana , Zexiang Xu , Milos Hasan , Fujun Luan , Alexandr Kuznetsov , Xuezheng Wang , Ravi Ramamoorthi
CPC classification number: G06T15/06 , G06T15/04 , G06T15/506 , G06T2215/12
Abstract: A scene modeling system accesses a three-dimensional (3D) scene including a 3D object. The scene modeling system applies a silhouette bidirectional texture function (SBTF) model to the 3D object to generate an output image of a textured material rendered as a surface of the 3D object. Applying the SBTF model includes determining a bounding geometry for the surface of the 3D object. Applying the SBTF model includes determining, for each pixel of the output image, a pixel value based on the bounding geometry. The scene modeling system displays, via a user interface, the output image based on the determined pixel values.
-
6.发明公开公开(公告)号：US20230360327A1
公开(公告)日：2023-11-09
申请号：US17661878
申请日：2022-05-03
Applicant: Adobe Inc.
Inventor： Sai Bi , Yang Liu , Zexiang Xu , Fujun Luan , Kalyan Sunkavalli
CPC classification number: G06T17/205 , G06T13/20 , G06T2210/21
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media that generate three-dimensional hybrid mesh-volumetric representations for digital objects. For instance, in one or more embodiments, the disclosed systems generate a mesh for a digital object from a plurality of digital images that portray the digital object using a multi-view stereo model. Additionally, the disclosed systems determine a set of sample points for a thin volume around the mesh. Using a neural network, the disclosed systems further generate a three-dimensional hybrid mesh-volumetric representation for the digital object utilizing the set of sample points for the thin volume and the mesh.
-
7.发明授权公开(公告)号：US12254570B2
公开(公告)日：2025-03-18
申请号：US17661878
申请日：2022-05-03
Applicant: Adobe Inc.
Inventor： Sai Bi , Yang Liu , Zexiang Xu , Fujun Luan , Kalyan Sunkavalli
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media that generate three-dimensional hybrid mesh-volumetric representations for digital objects. For instance, in one or more embodiments, the disclosed systems generate a mesh for a digital object from a plurality of digital images that portray the digital object using a multi-view stereo model. Additionally, the disclosed systems determine a set of sample points for a thin volume around the mesh. Using a neural network, the disclosed systems further generate a three-dimensional hybrid mesh-volumetric representation for the digital object utilizing the set of sample points for the thin volume and the mesh.
-
公开(公告)号：US20240193850A1
公开(公告)日：2024-06-13
申请号：US18065456
申请日：2022-12-13
Applicant: Adobe Inc.
Inventor： Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Kalyan K. Sunkavalli
CPC classification number: G06T15/08 , G06T15/06 , G06T15/503 , G06T15/80 , G06T19/20 , G06T2219/2012
Abstract: Embodiments of the present disclosure provide systems, methods, and computer storage media for generating editable synthesized views of scenes by inputting image rays into neural networks using neural basis decomposition. In embodiments, a set of input images of a scene depicting at least one object are collected and used to generate a plurality of rays of the scene. The rays each correspond to three-dimensional coordinates and viewing angles taken from the images. A volume density of the scene is determined by inputting the three-dimensional coordinates from the neural radiance fields into a first neural network to generate a 3D geometric representation of the object. An appearance decomposition is produced by inputting the three-dimensional coordinates and the viewing angles of the rays into a second neural network.
-
-
-
-
-
-
-
Search Results
8
records
(took 0.015 seconds)
