-
公开(公告)号:US20190109981A1
公开(公告)日:2019-04-11
申请号:US15730614
申请日:2017-10-11
Applicant: Adobe Systems Incorporated
Inventor: Jianming Zhang , Zijun Wei , Zhe Lin , Xiaohui Shen , Radomir Mech
IPC: H04N5/232
CPC classification number: H04N5/232935 , G06N3/08 , H04N5/23222 , H04N5/23229 , H04N5/23293
Abstract: Various embodiments describe facilitating real-time crops on an image. In an example, an image processing application executed on a device receives image data corresponding to a field of view of a camera of the device. The image processing application renders a major view on a display of the device in a preview mode. The major view presents a previewed image based on the image data. The image processing application receives a composition score of a cropped image from a deep-learning system. The image processing application renders a sub-view presenting the cropped image based on the composition score in a preview mode. Based on a user interaction, the image processing application renders the cropped image in the major view with the sub-view in the preview mode.
-
公开(公告)号:US10235623B2
公开(公告)日:2019-03-19
申请号:US15094633
申请日:2016-04-08
Applicant: ADOBE SYSTEMS INCORPORATED
Inventor: Zhe Lin , Xiaohui Shen , Jonathan Brandt , Jianming Zhang , Chen Fang
Abstract: Embodiments of the present invention provide an automated image tagging system that can predict a set of tags, along with relevance scores, that can be used for keyword-based image retrieval, image tag proposal, and image tag auto-completion based on user input. Initially, during training, a clustering technique is utilized to reduce cluster imbalance in the data that is input into a convolutional neural network (CNN) for training feature data. In embodiments, the clustering technique can also be utilized to compute data point similarity that can be utilized for tag propagation (to tag untagged images). During testing, a diversity based voting framework is utilized to overcome user tagging biases. In some embodiments, bigram re-weighting can down-weight a keyword that is likely to be part of a bigram based on a predicted tag set.
-
公开(公告)号:US20180268533A1
公开(公告)日:2018-09-20
申请号:US15458826
申请日:2017-03-14
Applicant: Adobe Systems Incorporated
Inventor: Radomir Mech , Ning Yu , Xiaohui Shen , Zhe Lin
CPC classification number: G06T7/0002 , G06N3/0454 , G06N3/08 , G06T2207/20081 , G06T2207/20084 , G06T2207/30168
Abstract: Digital image defect identification and correction techniques are described. In one example, a digital medium environment is configured to identify and correct a digital image defect through identification of a defect in a digital image using machine learning. The identification includes generating a plurality of defect type scores using a plurality of defect type identification models, as part of machine learning, for a plurality of different defect types and determining the digital image includes the defect based on the generated plurality of defect type scores. A correction is generated for the identified defect and the digital image is output as included the generated correction.
-
公开(公告)号:US20180260668A1
公开(公告)日:2018-09-13
申请号:US15456367
申请日:2017-03-10
Applicant: ADOBE SYSTEMS INCORPORATED
Inventor: Xiaohui Shen , Zhe Lin , Yi-Hsuan Tsai , Xin Lu , Kalyan K. Sunkavalli
CPC classification number: H04N1/387 , G06K9/34 , G06K9/4628 , G06K9/4652 , G06K9/6256 , G06K9/627 , G06N3/02 , G06N3/0454 , G06N3/08 , G06N3/084 , G06T11/00 , H04N1/6066
Abstract: Methods and systems are provided for generating harmonized images for input composite images. A neural network system can be trained, where the training includes training a neural network that generates harmonized images for input composite images. This training is performed based on a comparison of a training harmonized image and a reference image, where the reference image is modified to generate a training input composite image used to generate the training harmonized image. In addition, a mask of a region can be input to limit the area of the input image that is to be modified. Such a trained neural network system can be used to input a composite image and mask pair for which the trained system will output a harmonized image.
-
公开(公告)号:US09996768B2
公开(公告)日:2018-06-12
申请号:US14548170
申请日:2014-11-19
Applicant: Adobe Systems Incorporated
Inventor: Xiaohui Shen , Xin Lu , Zhe Lin , Radomir Mech
CPC classification number: G06K9/4676 , G06K9/4628
Abstract: Neural network patch aggregation and statistical techniques are described. In one or more implementations, patches are generated from an image, e.g., randomly, and used to train a neural network. An aggregation of outputs of patches processed by the neural network may be used to label an image using an image descriptor, such as to label aesthetics of the image, classify the image, and so on. In another example, the patches may be used by the neural network to calculate statistics describing the patches, such as to describe statistics such as minimum, maximum, median, and average of activations of image characteristics of the individual patches. These statistics may also be used to support a variety of functionality, such as to label the image as described above.
-
公开(公告)号:US09992387B2
公开(公告)日:2018-06-05
申请号:US15063240
申请日:2016-03-07
Applicant: Adobe Systems Incorporated
Inventor: Hailin Jin , Zhuoyuan Chen , Scott D. Cohen , Jianchao Yang , Zhe Lin
CPC classification number: H04N5/21 , G06T3/4053 , G06T3/4076 , G06T5/002 , G06T5/003 , G06T5/20 , G06T5/50 , G06T7/269 , G06T2207/10016 , G06T2207/20021 , G06T2207/20032 , G06T2207/20182 , G06T2207/20201 , H04N5/144 , H04N5/145 , H04N5/147
Abstract: In techniques for video denoising using optical flow, image frames of video content include noise that corrupts the video content. A reference frame is selected, and matching patches to an image patch in the reference frame are determined from within the reference frame. A noise estimate is computed for previous and subsequent image frames relative to the reference frame. The noise estimate for an image frame is computed based on optical flow, and is usable to determine a contribution of similar motion patches to denoise the image patch in the reference frame. The similar motion patches from the previous and subsequent image frames that correspond to the image patch in the reference frame are determined based on the optical flow computations. The image patch is denoised based on an average of the matching patches from reference frame and the similar motion patches determined from the previous and subsequent image frames.
-
公开(公告)号:US09990558B2
公开(公告)日:2018-06-05
申请号:US15705151
申请日:2017-09-14
Applicant: Adobe Systems Incorporated
Inventor: Zhe Lin , Xiaohui Shen , Jonathan Brandt , Jianming Zhang
CPC classification number: G06K9/4628 , G06K9/6298 , G06K2009/00322 , G06N3/04 , G06N3/08
Abstract: Techniques for increasing robustness of a convolutional neural network based on training that uses multiple datasets and multiple tasks are described. For example, a computer system trains the convolutional neural network across multiple datasets and multiple tasks. The convolutional neural network is configured for learning features from images and accordingly generating feature vectors. By using multiple datasets and multiple tasks, the robustness of the convolutional neural network is increased. A feature vector of an image is used to apply an image-related operation to the image. For example, the image is classified, indexed, or objects in the image are tagged based on the feature vector. Because the robustness is increased, the accuracy of the generating feature vectors is also increased. Hence, the overall quality of an image service is enhanced, where the image service relies on the image-related operation.
-
公开(公告)号:US09940544B2
公开(公告)日:2018-04-10
申请号:US15177197
申请日:2016-06-08
Applicant: Adobe Systems Incorporated
Inventor: Zhe Lin , Yufei Wang , Radomir Mech , Xiaohui Shen , Gavin Stuart Peter Miller
CPC classification number: G06K9/6218 , G06F17/30247 , G06F17/30265 , G06F17/3028 , G06K9/00228 , G06K9/00677 , G06K9/00718 , G06K9/00751 , G06K9/4628 , G06K9/6215 , G06K9/6254 , G06K9/6255 , G06K9/628 , G06N3/0454 , G06N3/084
Abstract: In embodiments of event image curation, a computing device includes memory that stores a collection of digital images associated with a type of event, such as a digital photo album of digital photos associated with the event, or a video of image frames and the video is associated with the event. A curation application implements a convolutional neural network, which receives the digital images and a designation of the type of event. The convolutional neural network can then determine an importance rating of each digital image within the collection of the digital images based on the type of the event. The importance rating of a digital image is representative of an importance of the digital image to a person in context of the type of the event. The convolutional neural network generates an output of representative digital images from the collection based on the importance rating of each digital image.
-
公开(公告)号:US09875528B2
公开(公告)日:2018-01-23
申请号:US13904903
申请日:2013-05-29
Applicant: Adobe Systems Incorporated
Inventor: Hailin Jin , Scott David Cohen , Zhe Lin
IPC: H04N9/88 , H04N5/14 , H04N11/02 , G09G5/02 , G06K9/00 , G06K9/32 , G06K9/40 , G06T5/00 , G06T7/20 , G06T7/246 , G11B27/031 , H04N19/51
CPC classification number: G06T5/002 , G06T5/003 , G06T5/009 , G06T7/20 , G06T7/248 , G06T2207/10016 , G11B27/031 , H04N19/51
Abstract: A method and systems of identifying one or more patches in three or more frames in a video are provided. A region in a reference frame of the video may be detected. A set of regions in a prior frame and subsequent frame that are similar to the region in the reference frame may then be identified. Temporal consistency between the region in the reference frame and two or more regions in the set of regions in the prior and subsequent frames may then be calculated. Patches of regions in the first, reference, and third frames may be identified based at least in part on the calculated temporal consistencies, with each patch identifying a region in the reference frame that can be mapped to a similar region in the prior and subsequent frames.
-
公开(公告)号:US20180005354A1
公开(公告)日:2018-01-04
申请号:US15707418
申请日:2017-09-18
Applicant: Adobe Systems Incorporated
Inventor: Zhe Lin , Jianchao Yang , Hailin Jin , Xin Lu
CPC classification number: G06T5/005 , G06K9/00664 , G06K9/6218 , G06T5/002 , G06T2207/20081 , G06T2207/20084
Abstract: Patch partition and image processing techniques are described. In one or more implementations, a system includes one or more modules implemented at least partially in hardware. The one or more modules are configured to perform operations including grouping a plurality of patches taken from a plurality of training samples of images into respective ones of a plurality of partitions, calculating an image processing operator for each of the partitions, determining distances between the plurality of partitions that describe image similarity of patches of the plurality of partitions, one to another, and configuring a database to provide the determined distance and the image processing operator to process an image in response to identification of a respective partition that corresponds to a patch taken from the image.
-
-
-
-
-
-
-
-
-