Processing Element-Centric All-to-All Communication

    公开(公告)号:US20240220336A1

    公开(公告)日:2024-07-04

    申请号:US18147081

    申请日:2022-12-28

    CPC classification number: G06F9/54 G06F9/5044 G06F15/17356

    Abstract: In accordance with described techniques for PE-centric all-to-all communication, a distributed computing system includes processing elements, such as graphics processing units, distributed in clusters. An all-to-all communication procedure is performed by the processing elements that are each configured to generate data packets in parallel for all-to-all data communication between the clusters. The all-to-all communication procedure includes a first stage of intra-cluster parallel data communication between respective processing elements of each of the clusters; a second stage of inter-cluster data exchange for all-to-all data communication between the clusters; and a third stage of intra-cluster data distribution to the respective processing elements of each of the clusters.

Patent Agency Ranking