-
公开(公告)号:US10565472B2
公开(公告)日:2020-02-18
申请号:US15935816
申请日:2018-03-26
Applicant: Adobe Inc.
Inventor: Zhe Lin , Yufei Wang , Radomir Mech , Xiaohui Shen , Gavin Stuart Peter Miller
IPC: G06K9/62 , G06F17/30 , G06K9/00 , G06F16/51 , G06F16/58 , G06F16/583 , G06K9/46 , G06N3/04 , G06N3/08
Abstract: In embodiments of event image curation, a computing device includes memory that stores a collection of digital images associated with a type of event, such as a digital photo album of digital photos associated with the event, or a video of image frames and the video is associated with the event. A curation application implements a convolutional neural network, which receives the digital images and a designation of the type of event. The convolutional neural network can then determine an importance rating of each digital image within the collection of the digital images based on the type of the event. The importance rating of a digital image is representative of an importance of the digital image to a person in context of the type of the event. The convolutional neural network generates an output of representative digital images from the collection based on the importance rating of each digital image.
-
公开(公告)号:US20190279074A1
公开(公告)日:2019-09-12
申请号:US15913829
申请日:2018-03-06
Applicant: Adobe Inc.
Inventor: Zhe Lin , Yufei Wang , Xiaohui Shen , Scott David Cohen , Jianming Zhang
Abstract: Semantic segmentation techniques and systems are described that overcome the challenges of limited availability of training data to describe the potentially millions of tags that may be used to describe semantic classes in digital images. In one example, the techniques are configured to train neural networks to leverage different types of training datasets using sequential neural networks and use of vector representations to represent the different semantic classes.
-
公开(公告)号:US10949744B2
公开(公告)日:2021-03-16
申请号:US16507960
申请日:2019-07-10
Applicant: Adobe Inc.
Inventor: Zhe Lin , Yufei Wang , Scott Cohen , Xiaohui Shen
Abstract: Provided are systems and techniques that provide an output phrase describing an image. An example method includes creating, with a convolutional neural network, feature maps describing image features in locations in the image. The method also includes providing a skeletal phrase for the image by processing the feature maps with a first long short-term memory (LSTM) neural network trained based on a first set of ground truth phrases which exclude attribute words. Then, attribute words are provided by processing the skeletal phrase and the feature maps with a second LSTM neural network trained based on a second set of ground truth phrases including words for attributes. Then, the method combines the skeletal phrase and the attribute words to form the output phrase.
-
公开(公告)号:US20190332937A1
公开(公告)日:2019-10-31
申请号:US16507960
申请日:2019-07-10
Applicant: Adobe Inc.
Inventor: Zhe Lin , Yufei Wang , Scott Cohen , Xiaohui Shen
Abstract: Provided are systems and techniques that provide an output phrase describing an image. An example method includes creating, with a convolutional neural network, feature maps describing image features in locations in the image. The method also includes providing a skeletal phrase for the image by processing the feature maps with a first long short-term memory (LSTM) neural network trained based on a first set of ground truth phrases which exclude attribute words. Then, attribute words are provided by processing the skeletal phrase and the feature maps with a second LSTM neural network trained based on a second set of ground truth phrases including words for attributes. Then, the method combines the skeletal phrase and the attribute words to form the output phrase.
-
公开(公告)号:US10387776B2
公开(公告)日:2019-08-20
申请号:US15456348
申请日:2017-03-10
Applicant: ADOBE INC.
Inventor: Zhe Lin , Yufei Wang , Scott Cohen , Xiaohui Shen
Abstract: Provided are systems and techniques that provide an output phrase describing an image. An example method includes creating, with a convolutional neural network, feature maps describing image features in locations in the image. The method also includes providing a skeletal phrase for the image by processing the feature maps with a first long short-term memory (LSTM) neural network trained based on a first set of ground truth phrases which exclude attribute words. Then, attribute words are provided by processing the skeletal phrase and the feature maps with a second LSTM neural network trained based on a second set of ground truth phrases including words for attributes. Then, the method combines the skeletal phrase and the attribute words to form the output phrase.
-
公开(公告)号:US10467529B2
公开(公告)日:2019-11-05
申请号:US15177121
申请日:2016-06-08
Applicant: Adobe Inc.
Inventor: Zhe Lin , Yufei Wang , Radomir Mech , Xiaohui Shen , Gavin Stuart Peter Miller
Abstract: In embodiments of convolutional neural network joint training, a computing system memory maintains different data batches of multiple digital image items, where the digital image items of the different data batches have some common features. A convolutional neural network (CNN) receives input of the digital image items of the different data batches, and classifier layers of the CNN are trained to recognize the common features in the digital image items of the different data batches. The recognized common features are input to fully-connected layers of the CNN that distinguish between the recognized common features of the digital image items of the different data batches. A scoring difference is determined between item pairs of the digital image items in a particular one of the different data batches. A piecewise ranking loss algorithm maintains the scoring difference between the item pairs, and the scoring difference is used to train CNN regression functions.
-
公开(公告)号:US11507800B2
公开(公告)日:2022-11-22
申请号:US15913829
申请日:2018-03-06
Applicant: Adobe Inc.
Inventor: Zhe Lin , Yufei Wang , Xiaohui Shen , Scott David Cohen , Jianming Zhang
IPC: G06T7/10 , G06F16/583 , G06N3/04 , G06N20/00
Abstract: Semantic segmentation techniques and systems are described that overcome the challenges of limited availability of training data to describe the potentially millions of tags that may be used to describe semantic classes in digital images. In one example, the techniques are configured to train neural networks to leverage different types of training datasets using sequential neural networks and use of vector representations to represent the different semantic classes.
-
-
-
-
-
-