公开(公告)号：US20210174193A1

公开(公告)日：2021-06-10

申请号：US16706180

申请日：2019-12-06

Applicant: ADOBE INC.

Inventor： AMIR POURAN BEN VEYSEH ,  FRANCK DERNONCOURT

IPC: G06N3/08 ,  G06N5/04 ,  G06N7/00 ,  G06N20/10 ,  G06N20/20 ,  G06K9/62 ,  G06T11/60 ,  G06F3/16

Abstract: A system, method and non-transitory computer readable medium for editing images with verbal commands are described. Embodiments of the system, method and non-transitory computer readable medium may include an artificial neural network (ANN) comprising a word embedding component configured to convert text input into a set of word vectors, a feature encoder configured to create a combined feature vector for the text input based on the word vectors, a scoring layer configured to compute labeling scores based on the combined feature vectors, wherein the feature encoder, the scoring layer, or both are trained using multi-task learning with a loss function including a first loss value and an additional loss value based on mutual information, context-based prediction, or sentence-based prediction, and a command component configured to identify a set of image editing word labels based on the labeling scores.

公开(公告)号：US20210279414A1

公开(公告)日：2021-09-09

申请号：US16810345

申请日：2020-03-05

Applicant: ADOBE INC.

Inventor： KHALIL MRINI ,  WALlTER CHANG ,  TRUNG BUI ,  QUAN TRAN ,  FRANCK DERNONCOURT

IPC: G06F40/211 ,  G06N3/04 ,  G06N3/08

Abstract: Systems and methods for parsing natural language sentences using an artificial neural network (ANN) are described. Embodiments of the described systems and methods may generate a plurality of word representation matrices for an input sentence, wherein each of the word representation matrices is based on an input matrix of word vectors, a query vector, a matrix of key vectors, and a matrix of value vectors, and wherein a number of the word representation matrices is based on a number of syntactic categories, compress each of the plurality of word representation matrices to produce a plurality of compressed word representation matrices, concatenate the plurality of compressed word representation matrices to produce an output matrix of word vectors, and identify at least one word from the input sentence corresponding to a syntactic category based on the output matrix of word vectors.

公开(公告)号：US20220245179A1

公开(公告)日：2022-08-04

申请号：US17163953

申请日：2021-02-01

Applicant: ADOBE INC.

Inventor： FRANCK DERNONCOURT ,  Amir Pouran Ben Veyseh

IPC: G06F16/332 ,  G06N20/00 ,  G06K9/62 ,  G06F40/289 ,  G06F40/30 ,  G06F16/338

Abstract: Systems and methods for similarity search are described. Embodiments identify a document and a query corresponding to a matching phrase in the document, encode the query and a candidate phrase, score the candidate phrase using at least one learning-based score and at least one surface form score, wherein the at least one learning based score is based on the encoding, and the at least one surface form score is based on a surface form of the query and a surface form of the candidate phrase, and select the matching phrase based on the scoring.

公开(公告)号：US20220138425A1

公开(公告)日：2022-05-05

申请号：US17089920

申请日：2020-11-05

Applicant: ADOBE INC.

Inventor： FRANCK DERNONCOURT ,  Amir Pouran Ben Veyseh

IPC: G06F40/295 ,  G06N3/04 ,  G06F40/274

Abstract: Systems and methods for natural language processing are described. Embodiments of the inventive concept are configured to receive an input sequence and a plurality of candidate long forms for a short form contained in the input sequence, encode the input sequence to produce an input sequence representation, encode each of the plurality of candidate long forms to produce a plurality of candidate long form representations, wherein each of the candidate long form representations is based on a plurality of sample expressions and each of the sample expressions includes a candidate long form and contextual information, compute a plurality of similarity scores based on the candidate long form representations and the input sequence representation, and select a long form for the short form based on the plurality of similarity scores.