Efficient embedding table storage and lookup

    公开(公告)号:US11599518B2

    公开(公告)日:2023-03-07

    申请号:US17147844

    申请日:2021-01-13

    Applicant: Google LLC

    Inventor: Gaurav Menghani

    Abstract: The present disclosure provides systems, methods, and computer program products for providing efficient embedding table storage and lookup in machine-learning models. A computer-implemented method may include obtaining an embedding table comprising a plurality of embeddings respectively associated with a corresponding index of the embedding table, compressing each particular embedding of the embedding table individually allowing each respective embedding of the embedding table to be decompressed independent of any other embedding in the embedding table, packing the embedding table comprising individually compressed embeddings with a machine-learning model, receiving an input to use for locating an embedding in the embedding table, determining a lookup value based on the input to search indexes of the embedding table, locating the embedding based on searching the indexes of the embedding table for the determined lookup value, and decompressing the located embedding independent of any other embedding in the embedding table.

    Efficient Embedding Table Storage and Lookup

    公开(公告)号:US20240211458A1

    公开(公告)日:2024-06-27

    申请号:US18390524

    申请日:2023-12-20

    Applicant: Google LLC

    Inventor: Gaurav Menghani

    Abstract: The present disclosure provides systems, methods, and computer program products for providing efficient embedding table storage and lookup in machine-learning models. A computer-implemented method may include obtaining an embedding table comprising a plurality of embeddings respectively associated with a corresponding index of the embedding table, compressing each particular embedding of the embedding table individually allowing each respective embedding of the embedding table to be decompressed independent of any other embedding in the embedding table, packing the embedding table comprising individually compressed embeddings with a machine-learning model, receiving an input to use for locating an embedding in the embedding table, determining a lookup value based on the input to search indexes of the embedding table, locating the embedding based on searching the indexes of the embedding table for the determined lookup value, and decompressing the located embedding independent of any other embedding in the embedding table.

    Training Firewall for Improved Adversarial Robustness of Machine-Learned Model Systems

    公开(公告)号:US20250063060A1

    公开(公告)日:2025-02-20

    申请号:US18450156

    申请日:2023-08-15

    Applicant: Google LLC

    Abstract: An example method can include obtaining, by a computing system, a first dataset including first reference inputs and first reference outputs. The example method can include training, by the computing system, a first machine-learned model using the first dataset. The example method can include obtaining, by the computing system, a second dataset including a plurality of second reference inputs, the plurality of second reference inputs obtained from a data corpus based on a distribution of second reference inputs in the second dataset. The example method can include processing, by the computing system and using the first machine-learned model, the plurality of second reference inputs to generate a plurality of second reference outputs corresponding to the plurality of second reference inputs. The example method can include training, by the computing system, a second machine-learned model using the plurality of second reference outputs and the plurality of second reference inputs.

    Efficient Embedding Table Storage and Lookup

    公开(公告)号:US20220222235A1

    公开(公告)日:2022-07-14

    申请号:US17147844

    申请日:2021-01-13

    Applicant: Google LLC

    Inventor: Gaurav Menghani

    Abstract: The present disclosure provides systems, methods, and computer program products for providing efficient embedding table storage and lookup in machine-learning models. A computer-implemented method may include obtaining an embedding table comprising a plurality of embeddings respectively associated with a corresponding index of the embedding table, compressing each particular embedding of the embedding table individually allowing each respective embedding of the embedding table to be decompressed independent of any other embedding in the embedding table, packing the embedding table comprising individually compressed embeddings with a machine-learning model, receiving an input to use for locating an embedding in the embedding table, determining a lookup value based on the input to search indexes of the embedding table, locating the embedding based on searching the indexes of the embedding table for the determined lookup value, and decompressing the located embedding independent of any other embedding in the embedding table.

    Efficient embedding table storage and lookup

    公开(公告)号:US12229108B2

    公开(公告)日:2025-02-18

    申请号:US18390524

    申请日:2023-12-20

    Applicant: Google LLC

    Inventor: Gaurav Menghani

    Abstract: The present disclosure provides systems, methods, and computer program products for providing efficient embedding table storage and lookup in machine-learning models. A computer-implemented method may include obtaining an embedding table comprising a plurality of embeddings respectively associated with a corresponding index of the embedding table, compressing each particular embedding of the embedding table individually allowing each respective embedding of the embedding table to be decompressed independent of any other embedding in the embedding table, packing the embedding table comprising individually compressed embeddings with a machine-learning model, receiving an input to use for locating an embedding in the embedding table, determining a lookup value based on the input to search indexes of the embedding table, locating the embedding based on searching the indexes of the embedding table for the determined lookup value, and decompressing the located embedding independent of any other embedding in the embedding table.

    Efficient embedding table storage and lookup

    公开(公告)号:US11892998B2

    公开(公告)日:2024-02-06

    申请号:US18161352

    申请日:2023-01-30

    Applicant: Google LLC

    Inventor: Gaurav Menghani

    Abstract: The present disclosure provides systems, methods, and computer program products for providing efficient embedding table storage and lookup in machine-learning models. A computer-implemented method may include obtaining an embedding table comprising a plurality of embeddings respectively associated with a corresponding index of the embedding table, compressing each particular embedding of the embedding table individually allowing each respective embedding of the embedding table to be decompressed independent of any other embedding in the embedding table, packing the embedding table comprising individually compressed embeddings with a machine-learning model, receiving an input to use for locating an embedding in the embedding table, determining a lookup value based on the input to search indexes of the embedding table, locating the embedding based on searching the indexes of the embedding table for the determined lookup value, and decompressing the located embedding independent of any other embedding in the embedding table.

    Efficient Embedding Table Storage and Lookup

    公开(公告)号:US20230169058A1

    公开(公告)日:2023-06-01

    申请号:US18161352

    申请日:2023-01-30

    Applicant: Google LLC

    Inventor: Gaurav Menghani

    Abstract: The present disclosure provides systems, methods, and computer program products for providing efficient embedding table storage and lookup in machine-learning models. A computer-implemented method may include obtaining an embedding table comprising a plurality of embeddings respectively associated with a corresponding index of the embedding table, compressing each particular embedding of the embedding table individually allowing each respective embedding of the embedding table to be decompressed independent of any other embedding in the embedding table, packing the embedding table comprising individually compressed embeddings with a machine-learning model, receiving an input to use for locating an embedding in the embedding table, determining a lookup value based on the input to search indexes of the embedding table, locating the embedding based on searching the indexes of the embedding table for the determined lookup value, and decompressing the located embedding independent of any other embedding in the embedding table.

Patent Agency Ranking