-
公开(公告)号:US20240419939A1
公开(公告)日:2024-12-19
申请号:US18702960
申请日:2022-10-20
Applicant: Visa International Service Association
Inventor: Huiyuan Chen , Michael Yeh , Fei Wang , Hao Yang
IPC: G06N3/042 , G06N3/0464
Abstract: Systems, methods, and computer program products for determining long-range dependencies using a non-local graph neural network (GNN): receive a dataset comprising historical data; generate at least one layer of a graph neural network by generating graph convolutions to compute node embeddings for a plurality of nodes of the dataset, the graph convolutions generated by aggregating node data from a first node of the dataset and node data from at least one second node comprising a neighbor node of the first node; cluster the node embeddings to form a plurality of centroids; determine an attention operator for at least one node-centroid pairing, the at least one node-centroid pairing comprising the first node and a first centroid; and generate relational data corresponding to a relation between the first node and at least one third node comprising a non-neighbor node of the first node using the attention operator.
-
2.
公开(公告)号:US20240412065A1
公开(公告)日:2024-12-12
申请号:US18702382
申请日:2022-09-30
Applicant: Visa International Service Association
Inventor: Huiyuan Chen , Yu-San Lin , Menghai Pan , Lan Wang , Michael Yeh , Fei Wang , Hao Yang
IPC: G06N3/08
Abstract: Described are a system, method, and computer program product for denoising sequential machine learning models. The method includes receiving data associated with a plurality of sequences and training a sequential machine learning model based on the data associated with the plurality of sequences to produce a trained sequential machine learning model. Training the sequential machine learning model includes denoising a plurality of sequential dependencies between items in the plurality of sequences using at least one trainable binary mask. The method also includes generating an output of the trained sequential machine learning model based on the denoised sequential dependencies. The method further includes generating a prediction of an item associated with a sequence of items based on the output of the trained sequential machine learning model.
-
公开(公告)号:US20240386327A1
公开(公告)日:2024-11-21
申请号:US18667221
申请日:2024-05-17
Applicant: Visa International Service Association
Inventor: Yan Zheng , Prince Osei Aboagye , Michael Yeh , Junpeng Wang , Huiyuan Chen , Xin Dai , Liang Wang , Wei Zhang
IPC: G06N20/00
Abstract: Methods, systems, and computer program products are provided for embedding learning to provide uniformity and orthogonality of embeddings. A method may include receiving a dataset that includes a plurality of data points including a first plurality of data points having a first classification and a second plurality of data points having a second classification, generating a first normalized class mean vector of the first plurality of data instances having the first classification, generating a second normalized class mean vector of the second plurality of data instances having the second classification, performing a class rectification operation on the first plurality of data instances having the first classification and the second plurality of data instances having a second classification, and generating embeddings of the dataset based on original embedding space projections of the dataset.
-
公开(公告)号:US11966832B2
公开(公告)日:2024-04-23
申请号:US18264052
申请日:2021-07-02
Applicant: Visa International Service Association
Inventor: Huiyuan Chen , Yu-San Lin , Lan Wang , Michael Yeh , Fei Wang , Hao Yang
IPC: G06N3/0464 , G06N3/047 , G06Q30/0282 , G06Q30/0601
CPC classification number: G06N3/0464 , G06N3/047 , G06Q30/0282 , G06Q30/0631
Abstract: A method includes receiving a first data set comprising embeddings of first and second types, generating a fixed adjacency matrix from the first dataset, and applying a first stochastic binary mask to the fixed adjacency matrix to obtain a first subgraph of the fixed adjacency matrix. The method also includes processing the first subgraph through a first layer of a graph convolutional network (GCN) to obtain a first embedding matrix, and applying a second stochastic binary mask to the fixed adjacency matrix to obtain a second subgraph of the fixed adjacency matrix. The method includes processing the first embedding matrix and the second subgraph through a second layer of the GCN to obtain a second embedding matrix, and then determining a plurality of gradients of a loss function, and modifying the first stochastic binary mask and the second stochastic binary mask using at least one of the plurality of gradients.
-
公开(公告)号:US12118462B2
公开(公告)日:2024-10-15
申请号:US17148984
申请日:2021-01-14
Applicant: Visa International Service Association
Inventor: Zhongfang Zhuang , Michael Yeh , Liang Wang , Wei Zhang , Junpeng Wang
Abstract: Described are a system, method, and computer program product for multivariate event prediction using multi-stream recurrent neural networks. The method includes receiving event data from a sample time period and generating feature vectors for each subperiod of each day. The method also includes providing the feature vectors as inputs to a set of first recurrent neural network (RNN) models and generating first outputs for each RNN node. The method further includes merging the first outputs for each same subperiod to form aggregated time-series layers. The method further includes providing the aggregated time-series layers as an input to a second RNN model and generating final outputs for each RNN node of the second RNN model.
-
6.
公开(公告)号:US20240273095A1
公开(公告)日:2024-08-15
申请号:US18567717
申请日:2022-06-01
Applicant: Visa International Service Association
Inventor: Michael Yeh , Yan Zheng , Junpeng Wang , Wei Zhang , Zhongfang Zhuang
IPC: G06F16/2453 , G06F16/2458
CPC classification number: G06F16/24537 , G06F16/2465 , G06F16/2477
Abstract: A method is disclosed. The method comprises determining a time series, a subsequence length. The length of the time series may then be determined, and an initial matrix profile may then be computed. The method may then form a processed matrix profile for a first subsequence of the subsequence length by applying the first subsequence to the initial matrix profile. A second subsequence may then be determined from the processed matrix profile. The method may then include comparing the second subsequence to other subsequences in a dictionary and adding it to the dictionary. The subsequences in the dictionary may be used to generate a plurality of subsequence matrix profiles. The method may then include forming an approximate matrix profile using the plurality of subsequence matrix profiles and then determining one or more anomalies in the time series or another time series using the approximate matrix profile.
-
7.
公开(公告)号:US20240160854A1
公开(公告)日:2024-05-16
申请号:US18280792
申请日:2022-03-30
Applicant: Visa International Service Association
Inventor: Sunipa Dev , Yan Zheng , Michael Yeh , Junpeng Wang , Wei Zhang , Archit Rathore
IPC: G06F40/40
CPC classification number: G06F40/40
Abstract: Described are a system, method, and computer program product for debiasing embedding vectors of machine learning models. The method includes receiving embedding vectors and generating two clusters thereof. The method includes determining a first mean vector of the first cluster and a second mean vector of the second cluster. The method includes determining a bias associated with each of a plurality of first candidate vectors and replacing the first mean vector with a first candidate vector based on the bias. The method includes determining a bias associated with each of a plurality of second candidate vectors and replacing the second mean vector with a second candidate vector based on the bias. The method includes repeatedly replacing the first and second mean vectors until an extremum of the bias score is reached, and debiasing the embedding vectors by linear projection using a direction defined by the first and second mean vectors.
-
8.
公开(公告)号:US20240134599A1
公开(公告)日:2024-04-25
申请号:US18530710
申请日:2023-12-06
Applicant: Visa International Service Association
Inventor: Yan Zheng , Michael Yeh , Junpeng Wang , Wei Zhang , Liang Wang , Hao Yang , Prince Osei Aboagye
Abstract: Provided is a method for normalizing embeddings for cross-embedding alignment. The method may include applying mean centering to the at least one embedding set, applying spectral normalization to the at least one embedding set, and/or applying length normalization to the at least one embedding set. Spectral normalization may include decomposing the at least one embedding set, determining an average singular value of the at least one embedding set, determining a respective substitute singular value for each respective singular value of a diagonal matrix, and/or replacing the at least one embedding set with a product of the at least one embedding set, a right singular vector, and an inverse of the substitute diagonal matrix. The mean centering, spectral normalization, and/or length normalization may be iteratively repeated for a configurable number of iterations. A system and computer program product are also disclosed.
-
公开(公告)号:US20240078416A1
公开(公告)日:2024-03-07
申请号:US18271301
申请日:2023-01-30
Applicant: Visa International Service Association
Inventor: Jiarui Sun , Mengting Gu , Michael Yeh , Liang Wang , Wei Zhang
Abstract: Described are a system, method, and computer program product for dynamic node classification in temporal-based machine learning classification models. The method includes receiving graph data of a discrete time dynamic graph including graph snapshots, and node classifications associated with all nodes in the discrete time dynamic graph. The method includes converting the discrete time dynamic graph to a time-augmented spatio-temporal graph and generating an adjacency matrix based on a temporal walk of the time-augmented spatio-temporal graph. The method includes generating an adaptive information transition matrix based on the adjacency matrix and determining feature vectors based on the nodes and the node attribute matrix of each graph snapshot. The method includes generating and propagating initial node representations across information propagation layers using the adaptive information transition matrix and classifying a node of the discrete time dynamic graph subsequent to the first time period based on final node representations.
-
10.
公开(公告)号:US20230214177A1
公开(公告)日:2023-07-06
申请号:US18006649
申请日:2022-05-25
Applicant: Visa International Service Association
Inventor: Yan Zheng , Michael Yeh , Junpeng Wang , Wei Zhang , Liang Wang , Hao Yang , Prince Osei Aboagye
Abstract: Provided is a method for normalizing embeddings for cross-embedding alignment. The method may include applying mean centering to the at least one embedding set, applying spectral normalization to the at least one embedding set, and/or applying length normalization to the at least one embedding set. Spectral normalization may include decomposing the at least one embedding set, determining an average singular value of the at least one embedding set, determining a respective substitute singular value for each respective singular value of a diagonal matrix, and/or replacing the at least one embedding set with a product of the at least one embedding set, a right singular vector, and an inverse of the substitute diagonal matrix. The mean centering, spectral normalization, and/or length normalization may be iteratively repeated for a configurable number of iterations. A system and computer program product are also disclosed.
-
-
-
-
-
-
-
-
-