-
公开(公告)号:US20210160466A1
公开(公告)日:2021-05-27
申请号:US16696160
申请日:2019-11-26
Applicant: Adobe Inc.
Inventor: Pulkit Gera , Oliver Wang , Kalyan Krishna Sunkavalli , Elya Shechtman , Chetan Nanda
Abstract: Systems and techniques for automatic digital parameter adjustment are described that leverage insights learned from an image set to automatically predict parameter values for an input item of digital visual content. To do so, the automatic digital parameter adjustment techniques described herein captures visual and contextual features of digital visual content to determine balanced visual output in a range of visual scenes and settings. The visual and contextual features of digital visual content are used to train a parameter adjustment model through machine learning techniques that captures feature patterns and interactions. The parameter adjustment model exploits these feature interactions to determine visually pleasing parameter values for an input item of digital visual content. The predicted parameter values are output, allowing further adjustment to the parameter values.
-
公开(公告)号:US10671855B2
公开(公告)日:2020-06-02
申请号:US15949935
申请日:2018-04-10
Applicant: Adobe Inc.
Inventor: Joon-Young Lee , Seoungwug Oh , Kalyan Krishna Sunkavalli
Abstract: Various embodiments describe video object segmentation using a neural network and the training of the neural network. The neural network both detects a target object in the current frame based on a reference frame and a reference mask that define the target object and propagates the segmentation mask of the target object for a previous frame to the current frame to generate a segmentation mask for the current frame. In some embodiments, the neural network is pre-trained using synthetically generated static training images and is then fine-tuned using training videos.
-
公开(公告)号:US10573040B2
公开(公告)日:2020-02-25
申请号:US15346638
申请日:2016-11-08
Applicant: Adobe Inc.
Inventor: Kalyan Krishna Sunkavalli , Nathan Aaron Carr , Michal Lukac , Elya Shechtman
Abstract: Image modification using detected symmetry is described. In example implementations, an image modification module detects multiple local symmetries in an original image by discovering repeated correspondences that are each related by a transformation. The transformation can include a translation, a rotation, a reflection, a scaling, or a combination thereof. Each repeated correspondence includes three patches that are similar to one another and are respectively defined by three pixels of the original image. The image modification module generates a global symmetry of the original image by analyzing an applicability to the multiple local symmetries of multiple candidate homographies contributed by the multiple local symmetries. The image modification module associates individual pixels of the original image with a global symmetry indicator to produce a global symmetry association map. The image modification module produces a manipulated image by manipulating the original image under global symmetry constraints imposed by the global symmetry association map.
-
公开(公告)号:US20190361994A1
公开(公告)日:2019-11-28
申请号:US15986401
申请日:2018-05-22
Applicant: Adobe Inc.
Inventor: Xiaohui Shen , Zhe Lin , Kalyan Krishna Sunkavalli , Hengshuang Zhao , Brian Lynn Price
Abstract: Compositing aware digital image search techniques and systems are described that leverage machine learning. In one example, a compositing aware image search system employs a two-stream convolutional neural network (CNN) to jointly learn feature embeddings from foreground digital images that capture a foreground object and background digital images that capture a background scene. In order to train models of the convolutional neural networks, triplets of training digital images are used. Each triplet may include a positive foreground digital image and a positive background digital image taken from the same digital image. The triplet also contains a negative foreground or background digital image that is dissimilar to the positive foreground or background digital image that is also included as part of the triplet.
-
公开(公告)号:US12211225B2
公开(公告)日:2025-01-28
申请号:US17231833
申请日:2021-04-15
Applicant: ADOBE INC.
Inventor: Sai Bi , Zexiang Xu , Kalyan Krishna Sunkavalli , Miloš Hašan , Yannick Hold-Geoffroy , David Jay Kriegman , Ravi Ramamoorthi
Abstract: A scene reconstruction system renders images of a scene with high-quality geometry and appearance and supports view synthesis, relighting, and scene editing. Given a set of input images of a scene, the scene reconstruction system trains a network to learn a volume representation of the scene that includes separate geometry and reflectance parameters. Using the volume representation, the scene reconstruction system can render images of the scene under arbitrary viewing (view synthesis) and lighting (relighting) locations. Additionally, the scene reconstruction system can render images that change the reflectance of objects in the scene (scene editing).
-
26.
公开(公告)号:US11669986B2
公开(公告)日:2023-06-06
申请号:US17233122
申请日:2021-04-16
Applicant: ADOBE INC.
Inventor: Sai Bi , Zexiang Xu , Kalyan Krishna Sunkavalli , David Jay Kriegman , Ravi Ramamoorthi
IPC: G06T7/514 , G06T17/20 , H04N13/111 , H04N13/282 , H04N13/128
CPC classification number: G06T7/514 , G06T17/20 , H04N13/111 , H04N13/128 , H04N13/282 , G06T2207/10012 , G06T2207/10028
Abstract: Enhanced methods and systems for generating both a geometry model and an optical-reflectance model (an object reconstruction model) for a physical object, based on a sparse set of images of the object under a sparse set of viewpoints. The geometry model is a mesh model that includes a set of vertices representing the object's surface. The reflectance model is SVBRDF that is parameterized via multiple channels (e.g., diffuse albedo, surface-roughness, specular albedo, and surface-normals). For each vertex of the geometry model, the reflectance model includes a value for each of the multiple channels. The object reconstruction model is employed to render graphical representations of a virtualized object (a VO based on the physical object) within a computation-based (e.g., a virtual or immersive) environment. Via the reconstruction model, the VO may be rendered from arbitrary viewpoints and under arbitrary lighting conditions.
-
公开(公告)号:US11178368B2
公开(公告)日:2021-11-16
申请号:US16696160
申请日:2019-11-26
Applicant: Adobe Inc.
Inventor: Pulkit Gera , Oliver Wang , Kalyan Krishna Sunkavalli , Elya Shechtman , Chetan Nanda
Abstract: Systems and techniques for automatic digital parameter adjustment are described that leverage insights learned from an image set to automatically predict parameter values for an input item of digital visual content. To do so, the automatic digital parameter adjustment techniques described herein captures visual and contextual features of digital visual content to determine balanced visual output in a range of visual scenes and settings. The visual and contextual features of digital visual content are used to train a parameter adjustment model through machine learning techniques that captures feature patterns and interactions. The parameter adjustment model exploits these feature interactions to determine visually pleasing parameter values for an input item of digital visual content. The predicted parameter values are output, allowing further adjustment to the parameter values.
-
公开(公告)号:US20210012189A1
公开(公告)日:2021-01-14
申请号:US16507675
申请日:2019-07-10
Applicant: Adobe Inc.
Inventor: Oliver Wang , Kevin Wampler , Kalyan Krishna Sunkavalli , Elya Shechtman , Siddhant Jain
Abstract: Techniques for incorporating a black-box function into a neural network are described. For example, an image editing function may be the black-box function and may be wrapped into a layer of the neural network. A set of parameters and a source image are provided to the black-box function, and the output image that represents the source image with the set of parameters applied to the source image is output from the black-box function. To address the issue that the black-box function may not be differentiable, a loss optimization may calculate the gradients of the function using, for example, a finite differences calculation, and the gradients are used to train the neural network to ensure the output image is representative of an expected ground truth image.
-
公开(公告)号:US20200349189A1
公开(公告)日:2020-11-05
申请号:US16929429
申请日:2020-07-15
Applicant: Adobe Inc.
Inventor: Xiaohui Shen , Zhe Lin , Kalyan Krishna Sunkavalli , Hengshuang Zhao , Brian Lynn Price
Abstract: Compositing aware digital image search techniques and systems are described that leverage machine learning. In one example, a compositing aware image search system employs a two-stream convolutional neural network (CNN) to jointly learn feature embeddings from foreground digital images that capture a foreground object and background digital images that capture a background scene. In order to train models of the convolutional neural networks, triplets of training digital images are used. Each triplet may include a positive foreground digital image and a positive background digital image taken from the same digital image. The triplet also contains a negative foreground or background digital image that is dissimilar to the positive foreground or background digital image that is also included as part of the triplet.
-
公开(公告)号:US10818022B2
公开(公告)日:2020-10-27
申请号:US16229759
申请日:2018-12-21
Applicant: ADOBE INC.
Inventor: Kalyan Krishna Sunkavalli , Sunil Hadap , Joon-Young Lee , Zhuo Hui
Abstract: Methods and systems are provided for performing material capture to determine properties of an imaged surface. A plurality of images can be received depicting a material surface. The plurality of images can be calibrated to align corresponding pixels of the images and determine reflectance information for at least a portion of the aligned pixels. After calibration, a set of reference materials from a material library can be selected using the calibrated images. The set of reference materials can be used to determine a material model that accurately represents properties of the material surface.
-
-
-
-
-
-
-
-
-