GENERATING SHADOWS FOR OBJECTS IN TWO-DIMENSIONAL IMAGES UTILIZING A PLURALITY OF SHADOW MAPS

    公开(公告)号:US20240144586A1

    公开(公告)日:2024-05-02

    申请号:US18304179

    申请日:2023-04-20

    申请人: Adobe Inc.

    IPC分类号: G06T15/60

    CPC分类号: G06T15/60 G06T2215/12

    摘要: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images. The disclosed systems further use three-dimensional representations of two-dimensional images to customize focal points for the two-dimensional images.

    GENERATING DIFFERENTIABLE PROCEDURAL MATERIALS

    公开(公告)号:US20230360285A1

    公开(公告)日:2023-11-09

    申请号:US18341618

    申请日:2023-06-26

    申请人: Adobe Inc.

    摘要: The present disclosure relates to using end-to-end differentiable pipeline for optimizing parameters of a base procedural material to generate a procedural material corresponding to a target physical material. For example, the disclosed systems can receive a digital image of a target physical material. In response, the disclosed systems can retrieve a differentiable procedural material for use as a base procedural material in response. The disclosed systems can compare a digital image of the base procedural material with the digital image of the target physical material using a loss function, such as a style loss function that compares visual appearance. Based on the determined loss, the disclosed systems can modify the parameters of the base procedural material to determine procedural material parameters for the target physical material. The disclosed systems can generate a procedural material corresponding to the base procedural material using the determined procedural material parameters.

    Preserving regions of interest in automatic image cropping

    公开(公告)号:US11663762B2

    公开(公告)日:2023-05-30

    申请号:US17083899

    申请日:2020-10-29

    申请人: Adobe Inc.

    IPC分类号: G06T11/60 G06T3/00 G06T7/12

    摘要: Embodiments of the present invention are directed to facilitating region of interest preservation. In accordance with some embodiments of the present invention, a region of interest preservation score using adaptive margins is determined. The region of interest preservation score indicates an extent to which at least one region of interest is preserved in a candidate image crop associated with an image. A region of interest positioning score is determined that indicates an extent to which a position of the at least one region of interest is preserved in the candidate image crop associated with the image. The region of interest preservation score and/or the preserving score are used to select a set of one or more candidate image crops as image crop suggestions.

    Digital Content Editing using a Procedural Model

    公开(公告)号:US20220351436A1

    公开(公告)日:2022-11-03

    申请号:US17867082

    申请日:2022-07-18

    申请人: Adobe Inc.

    IPC分类号: G06T11/60 G06T3/00

    摘要: Procedural model digital content editing techniques are described that overcome the limitations of conventional techniques to make procedural models available for interaction by a wide range of users without requiring specialized knowledge and do so without “breaking” the underlying model. In the techniques described herein, an inverse procedural model system receives a user input that specifies an edit to digital content generated by a procedural model. Input parameters from these candidate input parameters are selected by the system which cause the digital content generated by the procedural model to incorporate the edit.

    Deformation with meta-handles of 3D meshes

    公开(公告)号:US11488356B2

    公开(公告)日:2022-11-01

    申请号:US17195099

    申请日:2021-03-08

    申请人: ADOBE INC.

    IPC分类号: G06T11/60 G06T17/20 G06N3/04

    摘要: This disclosure includes technologies for deformation of 3D shapes using meta-handles. The disclosed 3D conditional generative system takes control points with biharmonic coordinates as deformation handles for a shape to train a network to learn a set of meta-handles for the shape. Further, each deformation axis of the latent space of deformation is explicitly associated with a meta-handle from a set of disentangled meta-handles, and the disentangled meta-handles factorize plausible deformations of the shape. Advantageously, an intuitive deformation of the shape may be generated by manipulating coefficients of the meta-handles, e.g., via a user interface.

    SYSTEM FOR AUTOMATIC OBJECT MASK AND HOTSPOT TRACKING

    公开(公告)号:US20220262011A1

    公开(公告)日:2022-08-18

    申请号:US17735728

    申请日:2022-05-03

    申请人: ADOBE INC.

    摘要: Systems and methods provide editing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. An eye-gaze network may produce a hotspot map of predicted focal points in a video frame. These predicted focal points may then be used by a gaze-to-mask network to determine objects in the image and generate an object mask for each of the detected objects. This process may then be repeated to effectively track the trajectory of objects and object focal points in videos. Based on the determined trajectory of an object in a video clip and editing parameters, the editing engine may produce editing effects relative to an object for the video clip.

    Frame selection based on a trained neural network

    公开(公告)号:US11410038B2

    公开(公告)日:2022-08-09

    申请号:US17204370

    申请日:2021-03-17

    申请人: Adobe Inc.

    摘要: Various embodiments describe frame selection based on training and using a neural network. In an example, the neural network is a convolutional neural network trained with training pairs. Each training pair includes two training frames from a frame collection. The loss function relies on the estimated quality difference between the two training frames. Further, the definition of the loss function varies based on the actual quality difference between these two frames. In a further example, the neural network is trained by incorporating facial heatmaps generated from the training frames and facial quality scores of faces detected in the training frames. In addition, the training involves using a feature mean that represents an average of the features of the training frames belonging to the same frame collection. Once the neural network is trained, a frame collection is input thereto and a frame is selected based on generated quality scores.

    SYSTEM FOR AUTOMATIC VIDEO REFRAMING

    公开(公告)号:US20220078358A1

    公开(公告)日:2022-03-10

    申请号:US17526853

    申请日:2021-11-15

    申请人: Adobe Inc.

    摘要: Systems and methods provide reframing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. A reframing engine may processes video clips using a segmentation and hotspot module to determine a salient region of an object, generate a mask of the object, and track the trajectory of an object in the video clips. The reframing engine may then receive reframing parameters from a crop suggestion module and a user interface. Based on the determined trajectory of an object in a video clip and reframing parameters, the reframing engine may use reframing logic to produce temporally consistent reframing effects relative to an object for the video clip.

    System for automatic video reframing

    公开(公告)号:US11184558B1

    公开(公告)日:2021-11-23

    申请号:US16900435

    申请日:2020-06-12

    申请人: ADOBE INC.

    摘要: Systems and methods provide reframing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. A reframing engine may processes video clips using a segmentation and hotspot module to determine a salient region of an object, generate a mask of the object, and track the trajectory of an object in the video clips. The reframing engine may then receive reframing parameters from a crop suggestion module and a user interface. Based on the determined trajectory of an object in a video clip and reframing parameters, the reframing engine may use reframing logic to produce temporally consistent reframing effects relative to an object for the video clip.

    Generative shape creation and editing

    公开(公告)号:US11037341B1

    公开(公告)日:2021-06-15

    申请号:US16744105

    申请日:2020-01-15

    申请人: Adobe Inc.

    摘要: Generative shape creation and editing is leveraged in a digital medium environment. An object editor system represents a set of training shapes as sets of visual elements known as “handles,” and converts sets of handles into signed distance field (SDF) representations. A handle processor model is then trained using the SDF representations to enable the handle processor model to generate new shapes that reflect salient visual features of the training shapes. The trained handle processor model, for instance, generates new sets of handles based on salient visual features learned from the training handle set. Thus, utilizing the described techniques, accurate characterizations of a set of shapes can be learned and used to generate new shapes. Further, generated shapes can be edited and transformed in different ways.