SYSTEMS, METHODS, AND DEVICES FOR STORAGE SHUFFLE ACCELERATION

    公开(公告)号:US20220156287A1

    公开(公告)日:2022-05-19

    申请号:US17112975

    申请日:2020-12-04

    IPC分类号: G06F16/27 G06F3/06 H04L29/08

    摘要: A method of processing data in a system having a host and a storage node may include performing a shuffle operation on data stored at the storage node, wherein the shuffle operation may include performing a shuffle write operation, and performing a shuffle read operation, wherein at least a portion of the shuffle operation is performed by an accelerator at the storage node. A method for partitioning data may include sampling, at a device, data from one or more partitions based on a number of samples, transferring the sampled data from the device to a host, determining, at the host, one or more splitters based on the sampled data, communicating the one or more splitters from the host to the device, and partitioning, at the device, data for the one or more partitions based on the one or more splitters.