Multi-Tree Reduction with Execution Skew
    1.
    发明公开

    公开(公告)号:US20240311182A1

    公开(公告)日:2024-09-19

    申请号:US18185641

    申请日:2023-03-17

    CPC classification number: G06F9/4881

    Abstract: A device includes a communication scheduler to generate schedule trees for scheduling data communication among a plurality of nodes configured to perform a collective operation using data contributed from the plurality of nodes. The device includes data reduction logic to: identify one or more skewed nodes among the plurality of nodes, perform, according to a first set of schedule trees, a first operation to generate partial results based on data contributed from non-skewed nodes, and perform, according to a second set of schedule trees, a second operation to generate final results based on the partial results and data contributed from the one or more skewed nodes.

Patent Agency Ranking