DISTRIBUTED LOADING AND TRAINING FOR MACHINE LEARNING MODELS

    公开(公告)号:US20240265295A1

    公开(公告)日:2024-08-08

    申请号:US18164230

    申请日:2023-02-03

    Applicant: Snap Inc.

    CPC classification number: G06N20/00 H04L67/563

    Abstract: One or more data loaders in a distributed computer system access input data from a storage component. A trainer in the distributed computer system transmits a training data request. The trainer and the one or more data loaders are executed on separate processors. In response to receiving, by a data loader of the one or more data loaders, the training data request, the data loader executes a data loading task to generate a training batch. The data loader transmits the training batch to the trainer. The trainer executes a training task which includes using the training batch to execute a machine learning algorithm.

Patent Agency Ranking