COMMUNICATION OPTIMIZATIONS FOR DISTRIBUTED MACHINE LEARNING

    公开(公告)号:US20190205745A1

    公开(公告)日:2019-07-04

    申请号:US15859180

    申请日:2017-12-29

    CPC classification number: G06F9/5061 G06F9/5077

    Abstract: Embodiments described herein provide a system to configure distributed training of a neural network, the system comprising memory to store a library to facilitate data transmission during distributed training of the neural network; a network interface to enable transmission and receipt of configuration data associated with a set of worker nodes, the worker nodes configured to perform distributed training of the neural network; and a processor to execute instructions provided by the library, the instructions to cause the processor to create one or more groups of the worker nodes, the one or more groups of worker nodes to be created based on a communication pattern for messages to be transmitted between the worker nodes during distributed training of the neural network.

Patent Agency Ranking