Invention Grant
- Patent Title: Efficient embedding table storage and lookup
-
Application No.: US17147844Application Date: 2021-01-13
-
Publication No.: US11599518B2Publication Date: 2023-03-07
- Inventor: Gaurav Menghani
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- Agency: Dority & Manning, P.A.
- Main IPC: G06F16/00
- IPC: G06F16/00 ; G06F16/22 ; G06F16/33 ; G06F16/215 ; G06F30/27 ; G06N3/04 ; G06N3/08 ; G06F16/174 ; H03M7/30

Abstract:
The present disclosure provides systems, methods, and computer program products for providing efficient embedding table storage and lookup in machine-learning models. A computer-implemented method may include obtaining an embedding table comprising a plurality of embeddings respectively associated with a corresponding index of the embedding table, compressing each particular embedding of the embedding table individually allowing each respective embedding of the embedding table to be decompressed independent of any other embedding in the embedding table, packing the embedding table comprising individually compressed embeddings with a machine-learning model, receiving an input to use for locating an embedding in the embedding table, determining a lookup value based on the input to search indexes of the embedding table, locating the embedding based on searching the indexes of the embedding table for the determined lookup value, and decompressing the located embedding independent of any other embedding in the embedding table.
Public/Granted literature
- US20220222235A1 Efficient Embedding Table Storage and Lookup Public/Granted day:2022-07-14
Information query