-
11.
公开(公告)号:US20240144586A1
公开(公告)日:2024-05-02
申请号:US18304179
申请日:2023-04-20
申请人: Adobe Inc.
IPC分类号: G06T15/60
CPC分类号: G06T15/60 , G06T2215/12
摘要: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images. The disclosed systems further use three-dimensional representations of two-dimensional images to customize focal points for the two-dimensional images.
-
公开(公告)号:US20230360285A1
公开(公告)日:2023-11-09
申请号:US18341618
申请日:2023-06-26
申请人: Adobe Inc.
发明人: Milos Hasan , Liang Shi , Tamy Boubekeur , Kalyan Sunkavalli , Radomir Mech
CPC分类号: G06T11/001 , G06T15/04 , G06N3/084 , G06T11/40
摘要: The present disclosure relates to using end-to-end differentiable pipeline for optimizing parameters of a base procedural material to generate a procedural material corresponding to a target physical material. For example, the disclosed systems can receive a digital image of a target physical material. In response, the disclosed systems can retrieve a differentiable procedural material for use as a base procedural material in response. The disclosed systems can compare a digital image of the base procedural material with the digital image of the target physical material using a loss function, such as a style loss function that compares visual appearance. Based on the determined loss, the disclosed systems can modify the parameters of the base procedural material to determine procedural material parameters for the target physical material. The disclosed systems can generate a procedural material corresponding to the base procedural material using the determined procedural material parameters.
-
公开(公告)号:US11663762B2
公开(公告)日:2023-05-30
申请号:US17083899
申请日:2020-10-29
申请人: Adobe Inc.
发明人: Jianming Zhang , Zhe Lin , Radomir Mech , Xiaohui Shen
CPC分类号: G06T11/60 , G06T3/0012 , G06T7/12 , G06T2207/20132 , G06T2210/22
摘要: Embodiments of the present invention are directed to facilitating region of interest preservation. In accordance with some embodiments of the present invention, a region of interest preservation score using adaptive margins is determined. The region of interest preservation score indicates an extent to which at least one region of interest is preserved in a candidate image crop associated with an image. A region of interest positioning score is determined that indicates an extent to which a position of the at least one region of interest is preserved in the candidate image crop associated with the image. The region of interest preservation score and/or the preserving score are used to select a set of one or more candidate image crops as image crop suggestions.
-
公开(公告)号:US20220351436A1
公开(公告)日:2022-11-03
申请号:US17867082
申请日:2022-07-18
申请人: Adobe Inc.
发明人: Vojtech Krs , Radomir Mech , Mathieu Gaillard , Giorgio Gori
摘要: Procedural model digital content editing techniques are described that overcome the limitations of conventional techniques to make procedural models available for interaction by a wide range of users without requiring specialized knowledge and do so without “breaking” the underlying model. In the techniques described herein, an inverse procedural model system receives a user input that specifies an edit to digital content generated by a procedural model. Input parameters from these candidate input parameters are selected by the system which cause the digital content generated by the procedural model to incorporate the edit.
-
公开(公告)号:US11488356B2
公开(公告)日:2022-11-01
申请号:US17195099
申请日:2021-03-08
申请人: ADOBE INC.
发明人: Radomir Mech , Minhyuk Sung , Minghua Liu
摘要: This disclosure includes technologies for deformation of 3D shapes using meta-handles. The disclosed 3D conditional generative system takes control points with biharmonic coordinates as deformation handles for a shape to train a network to learn a set of meta-handles for the shape. Further, each deformation axis of the latent space of deformation is explicitly associated with a meta-handle from a set of disentangled meta-handles, and the disentangled meta-handles factorize plausible deformations of the shape. Advantageously, an intuitive deformation of the shape may be generated by manipulating coefficients of the meta-handles, e.g., via a user interface.
-
公开(公告)号:US20220262011A1
公开(公告)日:2022-08-18
申请号:US17735728
申请日:2022-05-03
申请人: ADOBE INC.
发明人: Lu Zhang , Jianming Zhang , Zhe Lin , Radomir Mech
摘要: Systems and methods provide editing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. An eye-gaze network may produce a hotspot map of predicted focal points in a video frame. These predicted focal points may then be used by a gaze-to-mask network to determine objects in the image and generate an object mask for each of the detected objects. This process may then be repeated to effectively track the trajectory of objects and object focal points in videos. Based on the determined trajectory of an object in a video clip and editing parameters, the editing engine may produce editing effects relative to an object for the video clip.
-
公开(公告)号:US11410038B2
公开(公告)日:2022-08-09
申请号:US17204370
申请日:2021-03-17
申请人: Adobe Inc.
发明人: Zhe Lin , Xiaohui Shen , Radomir Mech , Jian Ren
摘要: Various embodiments describe frame selection based on training and using a neural network. In an example, the neural network is a convolutional neural network trained with training pairs. Each training pair includes two training frames from a frame collection. The loss function relies on the estimated quality difference between the two training frames. Further, the definition of the loss function varies based on the actual quality difference between these two frames. In a further example, the neural network is trained by incorporating facial heatmaps generated from the training frames and facial quality scores of faces detected in the training frames. In addition, the training involves using a feature mean that represents an average of the features of the training frames belonging to the same frame collection. Once the neural network is trained, a frame collection is input thereto and a frame is selected based on generated quality scores.
-
公开(公告)号:US20220078358A1
公开(公告)日:2022-03-10
申请号:US17526853
申请日:2021-11-15
申请人: Adobe Inc.
发明人: Lu Zhang , Jianming Zhang , Zhe Lin , Radomir Mech
IPC分类号: H04N5/262 , G11B27/031 , G06K9/00 , G06K9/46
摘要: Systems and methods provide reframing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. A reframing engine may processes video clips using a segmentation and hotspot module to determine a salient region of an object, generate a mask of the object, and track the trajectory of an object in the video clips. The reframing engine may then receive reframing parameters from a crop suggestion module and a user interface. Based on the determined trajectory of an object in a video clip and reframing parameters, the reframing engine may use reframing logic to produce temporally consistent reframing effects relative to an object for the video clip.
-
公开(公告)号:US11184558B1
公开(公告)日:2021-11-23
申请号:US16900435
申请日:2020-06-12
申请人: ADOBE INC.
发明人: Lu Zhang , Jianming Zhang , Zhe Lin , Radomir Mech
IPC分类号: H04N5/262 , G11B27/031 , G06K9/00 , G06K9/46
摘要: Systems and methods provide reframing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. A reframing engine may processes video clips using a segmentation and hotspot module to determine a salient region of an object, generate a mask of the object, and track the trajectory of an object in the video clips. The reframing engine may then receive reframing parameters from a crop suggestion module and a user interface. Based on the determined trajectory of an object in a video clip and reframing parameters, the reframing engine may use reframing logic to produce temporally consistent reframing effects relative to an object for the video clip.
-
公开(公告)号:US11037341B1
公开(公告)日:2021-06-15
申请号:US16744105
申请日:2020-01-15
申请人: Adobe Inc.
发明人: Giorgio Gori , Tamy Boubekeur , Radomir Mech , Nathan Aaron Carr , Matheus Abrantes Gadelha , Duygu Ceylan Aksit
摘要: Generative shape creation and editing is leveraged in a digital medium environment. An object editor system represents a set of training shapes as sets of visual elements known as “handles,” and converts sets of handles into signed distance field (SDF) representations. A handle processor model is then trained using the SDF representations to enable the handle processor model to generate new shapes that reflect salient visual features of the training shapes. The trained handle processor model, for instance, generates new sets of handles based on salient visual features learned from the training handle set. Thus, utilizing the described techniques, accurate characterizations of a set of shapes can be learned and used to generate new shapes. Further, generated shapes can be edited and transformed in different ways.
-
-
-
-
-
-
-
-
-