公开(公告)号：WO2022121756A1

公开(公告)日：2022-06-16

申请号：PCT/CN2021/134924

申请日：2021-12-02

Applicant: HUAWEI TECHNOLOGIES CO.,LTD. [CN]/[CN]

Inventor： NISBET, James Trevor ,  LEE, Jesse Ka-Leung ,  XUE, Xun ,  GROSMAN, Robin Dawn ,  SUTYANYONG, Nattavut

IPC: G06N20/00

Abstract: The disclosed systems and methods are directed to generating cache IDs for each of a plurality of AI training pipelines, accessing training data elements included in a training data set, generating IDs corresponding to the training data elements, receiving the data IDs and an associated cache ID, randomizing the data IDs, selecting a subset of the randomized data IDs, fetching the training data elements previously cached by a cache node, receiving a portion of the training data elements present in the caching server corresponding to the subset of randomized data IDs, forwarding the portion of the training data elements present in the caching server to at least one consumer node, fetching the remaining training data elements associated with the subset of randomized data IDs from the training data set, and forwarding the remaining training data elements to at least one transformation node for training the neural network.