Invention Publication
- Patent Title: Method, System, and Computer Program Product for Normalizing Embeddings for Cross-Embedding Alignment
-
Application No.: US18006649Application Date: 2022-05-25
-
Publication No.: US20230214177A1Publication Date: 2023-07-06
- Inventor: Yan Zheng , Michael Yeh , Junpeng Wang , Wei Zhang , Liang Wang , Hao Yang , Prince Osei Aboagye
- Applicant: Visa International Service Association
- Applicant Address: US CA San Francisco
- Assignee: Visa International Service Association
- Current Assignee: Visa International Service Association
- Current Assignee Address: US CA San Francisco
- International Application: PCT/US22/30813 2022.05.25
- Date entered country: 2023-01-24
- Main IPC: G06F5/01
- IPC: G06F5/01 ; G06F17/16 ; G06F40/40

Abstract:
Provided is a method for normalizing embeddings for cross-embedding alignment. The method may include applying mean centering to the at least one embedding set, applying spectral normalization to the at least one embedding set, and/or applying length normalization to the at least one embedding set. Spectral normalization may include decomposing the at least one embedding set, determining an average singular value of the at least one embedding set, determining a respective substitute singular value for each respective singular value of a diagonal matrix, and/or replacing the at least one embedding set with a product of the at least one embedding set, a right singular vector, and an inverse of the substitute diagonal matrix. The mean centering, spectral normalization, and/or length normalization may be iteratively repeated for a configurable number of iterations. A system and computer program product are also disclosed.
Public/Granted literature
- US11861324B2 Method, system, and computer program product for normalizing embeddings for cross-embedding alignment Public/Granted day:2024-01-02
Information query