-
公开(公告)号:US09940100B2
公开(公告)日:2018-04-10
申请号:US14473104
申请日:2014-08-29
Applicant: Adobe Systems Incorporated
Inventor: Zhe Lin , Jonathan Brandt , Xiaohui Shen , Jae-Pil Heo
CPC classification number: G06F7/24 , G06F17/30268 , G06F17/30271 , G06F17/30622
Abstract: Techniques are disclosed for indexing and searching high-dimensional data using inverted file structures and product quantization encoding. An image descriptor is quantized using a form of product quantization to determine which of several inverted lists the image descriptor is to be stored. The image descriptor is appended to the corresponding inverted list with a compact coding using a product quantization encoding scheme. When processing a query, a shortlist is computed that includes a set of candidate search results. The shortlist is based on the orthogonality between two random vectors in high-dimensional spaces. The inverted lists are traversed in the order of the distance between the query and the centroid of a coarse quantizer corresponding to each inverted list. The shortlist is ranked according to the distance estimated by a form of product quantization, and the top images referred to by the ranked shortlist are reported as the search results.
-
公开(公告)号:US20170344884A1
公开(公告)日:2017-11-30
申请号:US15164310
申请日:2016-05-25
Applicant: Adobe Systems Incorporated
Inventor: Zhe Lin , Xiaohui Shen , Jonathan W. Brandt , Jianming Zhang
CPC classification number: G06N3/084 , G06F17/30259
Abstract: Semantic class localization techniques and systems are described. In one or more implementation, a technique is employed to back communicate relevancies of aggregations back through layers of a neural network. Through use of these relevancies, activation relevancy maps are created that describe relevancy of portions of the image to the classification of the image as corresponding to a semantic class. In this way, the semantic class is localized to portions of the image. This may be performed through communication of positive and not negative relevancies, use of contrastive attention maps to different between semantic classes and even within a same semantic class through use of a self-contrastive technique.
-
公开(公告)号:US09817847B2
公开(公告)日:2017-11-14
申请号:US15470473
申请日:2017-03-27
Applicant: Adobe Systems Incorporated
Inventor: Xiaohui Shen , Xin Lu , Zhe Lin , Radomir Mech
CPC classification number: G06F17/30256 , G06F17/30247 , G06F17/30271 , G06K9/00221 , G06K9/00261 , G06K9/036 , G06K9/4628 , G06K9/6215 , G06K9/6227 , G06K9/6272 , G06K9/66 , G06N3/04 , G06N3/08
Abstract: Neural network image curation techniques are described. In one or more implementations, curation is controlled of images that represent a repository of images. A plurality of images of the repository are curated by one or more computing devices to select representative images of the repository. The curation includes calculating a score based on image and face aesthetics, jointly, for each of the plurality of images through processing by a neural network, ranking the plurality of images based on respective said scores, and selecting one or more of the plurality of images as one of the representative images of the repository based on the ranking and a determination that the one or more said images are not visually similar to images that have already been selected as one of the representative images of the repository.
-
公开(公告)号:US20170287137A1
公开(公告)日:2017-10-05
申请号:US15086590
申请日:2016-03-31
Applicant: Adobe Systems Incorporated
Inventor: Zhe Lin , Yibing Song , Xin Lu , Xiaohui Shen , Jimei Yang
CPC classification number: G06T7/13 , G06K9/00369 , G06K9/38 , G06K9/4628 , G06K9/66 , G06T7/0081 , G06T7/11 , G06T2207/20076 , G06T2207/20081
Abstract: Systems and methods are disclosed for segmenting a digital image to identify an object portrayed in the digital image from background pixels in the digital image. In particular, in one or more embodiments, the disclosed systems and methods use a first neural network and a second neural network to generate image information used to generate a segmentation mask that corresponds to the object portrayed in the digital image. Specifically, in one or more embodiments, the disclosed systems and methods optimize a fit between a mask boundary of the segmentation mask to edges of the object portrayed in the digital image to accurately segment the object within the digital image.
-
公开(公告)号:US20170199898A1
公开(公告)日:2017-07-13
申请号:US15470473
申请日:2017-03-27
Applicant: Adobe Systems Incorporated
Inventor: Xiaohui Shen , Xin Lu , Zhe Lin , Radomir Mech
CPC classification number: G06F17/30256 , G06F17/30247 , G06F17/30271 , G06K9/00221 , G06K9/00261 , G06K9/036 , G06K9/4628 , G06K9/6215 , G06K9/6227 , G06K9/6272 , G06K9/66 , G06N3/04 , G06N3/08
Abstract: Neural network image curation techniques are described. In one or more implementations, curation is controlled of images that represent a repository of images. A plurality of images of the repository are curated by one or more computing devices to select representative images of the repository. The curation includes calculating a score based on image and face aesthetics, jointly, for each of the plurality of images through processing by a neural network, ranking the plurality of images based on respective said scores, and selecting one or more of the plurality of images as one of the representative images of the repository based on the ranking and a determination that the one or more said images are not visually similar to images that have already been selected as one of the representative images of the repository.
-
公开(公告)号:US09697416B2
公开(公告)日:2017-07-04
申请号:US15196478
申请日:2016-06-29
Applicant: Adobe Systems Incorporated
Inventor: Xiaohui Shen , Haoxiang Li , Zhe Lin , Jonathan W. Brandt
CPC classification number: G06K9/00288 , G06K9/4628 , G06K9/6257 , G06N3/0454
Abstract: Different candidate windows in an image are identified, such as by sliding a rectangular or other geometric shape of different sizes over an image to identify portions of the image (groups of pixels in the image). The candidate windows are analyzed by a set of convolutional neural networks, which are cascaded so that the input of one convolutional neural network layer is based on the input of another convolutional neural network layer. Each convolutional neural network layer drops or rejects one or more candidate windows that the convolutional neural network layer determines does not include an object (e.g., a face). The candidate windows that are identified as including an object (e.g., a face) are analyzed by another one of the convolutional neural network layers. The candidate windows identified by the last of the convolutional neural network layers are the indications of the objects (e.g., faces) in the image.
-
公开(公告)号:US20170178291A1
公开(公告)日:2017-06-22
申请号:US15448138
申请日:2017-03-02
Applicant: Adobe Systems Incorporated
Inventor: Zhe Lin , Radomir Mech , Xiaohui Shen , Brian L. Price , Jianming Zhang , Anant Gilra , Jen-Chan Jeff Chien
CPC classification number: G06T3/40 , G06K9/4671 , G06T3/0012 , G06T11/60 , G06T2210/22
Abstract: Image cropping suggestion using multiple saliency maps is described. In one or more implementations, component scores, indicative of visual characteristics established for visually-pleasing croppings, are computed for candidate image croppings using multiple different saliency maps. The visual characteristics on which a candidate image cropping is scored may be indicative of its composition quality, an extent to which it preserves content appearing in the scene, and a simplicity of its boundary. Based on the component scores, the croppings may be ranked with regard to each of the visual characteristics. The rankings may be used to cluster the candidate croppings into groups of similar croppings, such that croppings in a group are different by less than a threshold amount and croppings in different groups are different by at least the threshold amount. Based on the clustering, croppings may then be chosen, e.g., to present them to a user for selection.
-
138.
公开(公告)号:US20170098152A1
公开(公告)日:2017-04-06
申请号:US15002172
申请日:2016-01-20
Applicant: ADOBE SYSTEMS INCORPORATED
Inventor: Bernard James Kerr , Zhe Lin , Patrick Reynolds , Baldo Faieta
IPC: G06N3/02 , G06F3/0484 , G06F17/30
CPC classification number: G06N3/02 , G06F3/04842 , G06F16/583
Abstract: In various implementations, one or more specific attributes found in an image can be modified utilizing one or more specific attributes found in another image. Machine learning, deep neural networks, and other computer vision techniques can be utilized to extract attributes of images, such as color, composition, font, style, and texture from one or more images. A user may modify at least one of these attributes in a first image based on the attribute(s) of another image and initiate a visual-based search using the modified image.
-
公开(公告)号:US09613058B2
公开(公告)日:2017-04-04
申请号:US14573963
申请日:2014-12-17
Applicant: Adobe Systems Incorporated
Inventor: Xiaohui Shen , Xin Lu , Zhe Lin , Radomir Mech
CPC classification number: G06F17/30256 , G06F17/30247 , G06F17/30271 , G06K9/00221 , G06K9/00261 , G06K9/036 , G06K9/4628 , G06K9/6215 , G06K9/6227 , G06K9/6272 , G06K9/66 , G06N3/04 , G06N3/08
Abstract: Neural network image curation techniques are described. In one or more implementations, curation is controlled of images that represent a repository of images. A plurality of images of the repository are curated by one or more computing devices to select representative images of the repository. The curation includes calculating a score based on image and face aesthetics, jointly, for each of the plurality of images through processing by a neural network, ranking the plurality of images based on respective said scores, and selecting one or more of the plurality of images as one of the representative images of the repository based on the ranking and a determination that the one or more said images are not visually similar to images that have already been selected as one of the representative images of the repository.
-
公开(公告)号:US09607014B2
公开(公告)日:2017-03-28
申请号:US14068238
申请日:2013-10-31
Applicant: Adobe Systems Incorporated
Inventor: Zhaowen Wang , Jianchao Yang , Zhe Lin , Jonathan Brandt
CPC classification number: G06F17/30265 , G06K9/6263 , G06K2209/27
Abstract: A system is configured to annotate an image with tags. As configured, the system accesses an image and generates a set of vectors for the image. The set of vectors may be generated by mathematically transforming the image, such as by applying a mathematical transform to predetermined regions of the image. The system may then query a database of tagged images by submitting the set of vectors as search criteria to a search engine. The querying of the database may obtain a set of tagged images. Next, the system may rank the obtained set of tagged images according to similarity scores that quantify degrees of similarity between the image and each tagged image obtained. Tags from a top-ranked subset of the tagged images may be extracted by the system, which may then annotate the image with these extracted tags.
-
-
-
-
-
-
-
-
-