-
公开(公告)号:US20180268535A1
公开(公告)日:2018-09-20
申请号:US15981166
申请日:2018-05-16
Applicant: Adobe Systems Incorporated
Inventor: Xiaohui Shen , Zhe Lin , Shu Kong , Radomir Mech
CPC classification number: G06T7/0002 , G06K9/623 , G06K9/6256 , G06N3/0454 , G06N3/08 , G06T2207/20081 , G06T2207/30168
Abstract: Systems and methods are disclosed for estimating aesthetic quality of digital images using deep learning. In particular, the disclosed systems and methods describe training a neural network to generate an aesthetic quality score digital images. In particular, the neural network includes a training structure that compares relative rankings of pairs of training images to accurately predict a relative ranking of a digital image. Additionally, in training the neural network, an image rating system can utilize content-aware and user-aware sampling techniques to identify pairs of training images that have similar content and/or that have been rated by the same or different users. Using content-aware and user-aware sampling techniques, the neural network can be trained to accurately predict aesthetic quality ratings that reflect subjective opinions of most users as well as provide aesthetic scores for digital images that represent the wide spectrum of aesthetic preferences of various users.
-
公开(公告)号:US10074161B2
公开(公告)日:2018-09-11
申请号:US15094799
申请日:2016-04-08
Applicant: ADOBE SYSTEMS INCORPORATED
Inventor: Xiaohui Shen , Yi-Hsuan Tsai , Kalyan K. Sunkavalli , Zhe Lin
IPC: G09G5/00 , G06F3/0482 , G06F3/0484 , G06T7/40 , G06T5/00
CPC classification number: G06T5/005 , G06F3/0482 , G06F3/04845 , G06F16/5838 , G06F17/30256 , G06T7/90 , G06T11/001 , G06T2207/20084 , G06T2207/20221
Abstract: Embodiments of the present disclosure relate to a sky editing system and related processes for sky editing. The sky editing system includes a composition detector to determine the composition of a target image. A sky search engine in the sky editing system is configured to find a reference image with similar composition with the target image. Subsequently, a sky editor replaces content of the sky in the target image with content of the sky in the reference image. As such, the sky editing system transforms the target image into a new image with a preferred sky background.
-
公开(公告)号:US10043057B2
公开(公告)日:2018-08-07
申请号:US15254587
申请日:2016-09-01
Applicant: Adobe Systems Incorporated
Inventor: Xiaohui Shen , Zhe Lin , Jonathan W. Brandt
Abstract: Accelerating object detection techniques are described. In one or more implementations, adaptive sampling techniques are used to extract features from an image. Coarse features are extracted from the image and used to generate an object probability map. Then, dense features are extracted from high-probability object regions of the image identified in the object probability map to enable detection of an object in the image. In one or more implementations, cascade object detection techniques are used to detect an object in an image. In a first stage, exemplars in a first subset of exemplars are applied to features extracted from the multiple regions of the image to detect object candidate regions. Then, in one or more validation stages, the object candidate regions are validated by applying exemplars from the first subset of exemplars and one or more additional subsets of exemplars.
-
公开(公告)号:US10042866B2
公开(公告)日:2018-08-07
申请号:US14788113
申请日:2015-06-30
Applicant: ADOBE SYSTEMS INCORPORATED
Inventor: Zhe Lin , Jonathan Brandt , Xiaohui Shen , Jae-Pil Heo , Jianchao Yang
Abstract: In various implementations, a personal asset management application is configured to perform operations that facilitate the ability to search multiple images, irrespective of the images having characterizing tags associated therewith or without, based on a simple text-based query. A first search is conducted by processing a text-based query to produce a first set of result images used to further generate a visually-based query based on the first set of result images. A second search is conducted employing the visually-based query that was based on the first set of result images received in accordance with the first search conducted and based on the text-based query. The second search can generate a second set of result images, each having visual similarity to at least one of the images generated for the first set of result images.
-
公开(公告)号:US10026020B2
公开(公告)日:2018-07-17
申请号:US14997011
申请日:2016-01-15
Applicant: Adobe Systems Incorporated
Inventor: Hailin Jin , Zhou Ren , Zhe Lin , Chen Fang
CPC classification number: G06K9/628 , G06F16/5846 , G06F16/5866 , G06K9/00684 , G06K9/66 , G06K9/726
Abstract: Embedding space for images with multiple text labels is described. In the embedding space both text labels and image regions are embedded. The text labels embedded describe semantic concepts that can be exhibited in image content. The embedding space is trained to semantically relate the embedded text labels so that labels like “sun” and “sunset” are more closely related than “sun” and “bird”. Training the embedding space also includes mapping representative images, having image content which exemplifies the semantic concepts, to respective text labels. Unlike conventional techniques that embed an entire training image into the embedding space for each text label associated with the training image, the techniques described herein process a training image to generate regions that correspond to the multiple text labels. The regions of the training image are then embedded into the training space in a manner that maps the regions to the corresponding text labels.
-
公开(公告)号:US20180173958A1
公开(公告)日:2018-06-21
申请号:US15384831
申请日:2016-12-20
Applicant: Adobe Systems Incorporated
Inventor: Hao Hu , Zhaowen Wang , Joon-Young Lee , Zhe Lin
CPC classification number: G06K9/00744 , G06K9/4628 , G06K9/6271 , G06N3/0445 , G06N3/0454 , G06T2207/20084
Abstract: Techniques and systems are described to generate a compact video feature representation for sequences of frames in a video. In one example, values of features are extracted from each frame of a plurality of frames of a video using machine learning, e.g., through use of a convolutional neural network. A video feature representation is generated of temporal order dynamics of the video, e.g., through use of a recurrent neural network. For example, a maximum value is maintained of each feature of the plurality of features that has been reached for the plurality of frames in the video. A timestamp is also maintained as indicative of when the maximum value is reached for each feature of the plurality of features. The video feature representation is then output as a basis to determine similarity of the video with at least one other video based on the video feature representation.
-
公开(公告)号:US10002415B2
公开(公告)日:2018-06-19
申请号:US15097113
申请日:2016-04-12
Applicant: Adobe Systems Incorporated
Inventor: Xiaohui Shen , Zhe Lin , Shu Kong , Radomir Mech
CPC classification number: G06T7/0002 , G06K9/623 , G06K9/6256 , G06N3/0454 , G06N3/08 , G06T2207/20081 , G06T2207/30168
Abstract: Systems and methods are disclosed for estimating aesthetic quality of digital images using deep learning. In particular, the disclosed systems and methods describe training a neural network to generate an aesthetic quality score digital images. In particular, the neural network includes a training structure that compares relative rankings of pairs of training images to accurately predict a relative ranking of a digital image. Additionally, in training the neural network, an image rating system can utilize content-aware and user-aware sampling techniques to identify pairs of training images that have similar content and/or that have been rated by the same or different users. Using content-aware and user-aware sampling techniques, the neural network can be trained to accurately predict aesthetic quality ratings that reflect subjective opinions of most users as well as provide aesthetic scores for digital images that represent the wide spectrum of aesthetic preferences of various users.
-
公开(公告)号:US09978129B2
公开(公告)日:2018-05-22
申请号:US15707418
申请日:2017-09-18
Applicant: Adobe Systems Incorporated
Inventor: Zhe Lin , Jianchao Yang , Hailin Jin , Xin Lu
CPC classification number: G06T5/005 , G06K9/00664 , G06K9/6218 , G06T5/002 , G06T2207/20081 , G06T2207/20084
Abstract: Patch partition and image processing techniques are described. In one or more implementations, a system includes one or more modules implemented at least partially in hardware. The one or more modules are configured to perform operations including grouping a plurality of patches taken from a plurality of training samples of images into respective ones of a plurality of partitions, calculating an image processing operator for each of the partitions, determining distances between the plurality of partitions that describe image similarity of patches of the plurality of partitions, one to another, and configuring a database to provide the determined distance and the image processing operator to process an image in response to identification of a respective partition that corresponds to a patch taken from the image.
-
公开(公告)号:US20180137624A1
公开(公告)日:2018-05-17
申请号:US15853206
申请日:2017-12-22
Applicant: Adobe Systems Incorporated
Inventor: Xiaohui Shen , Zhe Lin , Yi-Hsuan Tsai , Kalyan K. Sunkavalli
CPC classification number: G06T7/11 , G06K9/00697 , G06K9/34 , G06K9/6269 , G06K9/6297 , G06N3/0454 , G06N7/005 , G06T2207/20016 , G06T2207/20076 , G06T2207/20084 , G06T2207/20092
Abstract: A digital medium environment includes an image processing application that performs object segmentation on an input image. An improved object segmentation method implemented by the image processing application comprises receiving an input image that includes an object region to be segmented by a segmentation process, processing the input image to provide a first segmentation that defines the object region, and processing the first segmentation to provide a second segmentation that provides pixel-wise label assignments for the object region. In some implementations, the image processing application performs improved sky segmentation on an input image containing a depiction of a sky.
-
公开(公告)号:US09972092B2
公开(公告)日:2018-05-15
申请号:US15086590
申请日:2016-03-31
Applicant: Adobe Systems Incorporated
Inventor: Zhe Lin , Yibing Song , Xin Lu , Xiaohui Shen , Jimei Yang
CPC classification number: G06T7/13 , G06K9/00369 , G06K9/38 , G06K9/4628 , G06K9/66 , G06T7/0081 , G06T7/11 , G06T2207/20076 , G06T2207/20081
Abstract: Systems and methods are disclosed for segmenting a digital image to identify an object portrayed in the digital image from background pixels in the digital image. In particular, in one or more embodiments, the disclosed systems and methods use a first neural network and a second neural network to generate image information used to generate a segmentation mask that corresponds to the object portrayed in the digital image. Specifically, in one or more embodiments, the disclosed systems and methods optimize a fit between a mask boundary of the segmentation mask to edges of the object portrayed in the digital image to accurately segment the object within the digital image.
-
-
-
-
-
-
-
-
-