Systems, methods, and devices for shuffle acceleration

    公开(公告)号:US12118226B2

    公开(公告)日:2024-10-15

    申请号:US17225085

    申请日:2021-04-07

    CPC classification number: G06F3/0647 G06F3/0604 G06F3/0679

    Abstract: A method of shuffling data may include shuffling a first batch of data using a first memory on a first level of a memory hierarchy to generate a first batch of shuffled data, shuffling a second batch of data using the first memory to generate a second batch of shuffled data, and storing the first batch of shuffled data and the second batch of shuffled data in a second memory on a second level of the memory hierarchy. The method may further include merging the first batch of shuffled data and the second batch of shuffled data. A data shuffling device may include a buffer memory configured to stream one or more records to a partitioning circuit and transfer, by random access, one or more records to a grouping circuit.

Patent Agency Ranking