Smart network interface controller for caching distributed data

    公开(公告)号:US11012511B1

    公开(公告)日:2021-05-18

    申请号:US16742635

    申请日:2020-01-14

    Applicant: Facebook, Inc.

    Abstract: A request for data from a distributed table is received at a network interface controller system. The request for data from the distributed table is identified as a request to be processed by the network interface controller system instead of a processor of a host computer system. The requested data is requested and received from a memory of the computing host computer system via a computer interface of the network interface controller system. The received requested data is caused to be cached in a cache of the network interface controller system.

    DYNAMIC QUALITY OF SERVICE MANAGEMENT FOR DEEP LEARNING TRAINING COMMUNICATION

    公开(公告)号:US20210304025A1

    公开(公告)日:2021-09-30

    申请号:US16828729

    申请日:2020-03-24

    Applicant: Facebook, Inc.

    Abstract: A processor analyzes a machine learning workload. Corresponding priority levels are assigned to identified data requests in the machine learning workload based on an associated data dependency delay performance impact. The assigned corresponding priority levels are indicated when providing the data requests to a memory controller. The memory controller sorts the received data requests into a plurality of different priority queues based on the indicated corresponding priority levels. The memory controller initiates the data requests from the different priority queues to memory in an order based on different qualities of service of the different priority queues.

Patent Agency Ranking