Cache replacement policy optimization for producer-consumer flows

    公开(公告)号:US12277071B2

    公开(公告)日:2025-04-15

    申请号:US17706044

    申请日:2022-03-28

    Abstract: Embodiments of the present disclosure includes techniques for cache memory replacement in a processing unit. A first data production operation to store first data to a first cache line of the cache memory is detected at a first time. A retention status of the first cache line is updated to a first retention level as a result of the first data production operation. Protection against displacement of the first data in the first cache line is increased based on the first retention level. A first data consumption operation retrieving the first data from the first cache line is detected at a second time after the first time. The retention status of the first cache line is updated to a second retention level as a result of the first data consumption operation, the second retention level being a lower level of retention than the first retention level.

    Load balancing in distributed computing systems

    公开(公告)号:US11218537B2

    公开(公告)日:2022-01-04

    申请号:US15930299

    申请日:2020-05-12

    Abstract: Techniques for facilitating load balancing in distributed computing systems are disclosed herein. In one embodiment, a method includes receiving, at a destination server, a request packet from a load balancer via the computer network requesting a remote direct memory access (“RDMA”) connection between an originating server and one or more other servers selectable by the load balancer. The method can also include configuring, at the destination server, a rule for processing additional packets transmittable to the originating server via the RDMA connection based on the received reply packet. The rule is configured to encapsulate an outgoing packet transmittable to the originating server with an outer header having a destination field containing a network address of the originating server and a source field containing another network address of the destination server.

    GROUP-BASED DATA REPLICATION IN MULTI-TENANT STORAGE SYSTEMS

    公开(公告)号:US20200233833A1

    公开(公告)日:2020-07-23

    申请号:US16838752

    申请日:2020-04-02

    Abstract: Distributed storage systems, devices, and associated methods of data replication are disclosed herein. In one embodiment, a server in a distributed storage system is configured to write, with an RDMA enabled NIC, a block of data from a memory of the server to a memory at another server via an RDMA network. Upon completion of writing the block of data to the another server, the server can also send metadata representing a memory location and a data size of the written block of data in the memory of the another server via the RDMA network. The sent metadata is to be written into a memory location containing data representing a memory descriptor that is a part of a data structure representing a pre-posted work request comgured to write a copy of the block of data from the another server to an additional server via the RDMA network.

    Partial memory updates using preset templates

    公开(公告)号:US12236128B2

    公开(公告)日:2025-02-25

    申请号:US17706088

    申请日:2022-03-28

    Abstract: Embodiments of the present disclosure includes techniques for partial memory updates in a computer system. A data structure template is received. A first write data of a first write operation is received from a first data source, the first write operation performed in connection with provisioning of a first data payload to memory communicatively coupled with a processing unit. A first merge operation is performed involving the first write data and the first data structure template to obtain a first data structure update. The first data structure update is written to the memory, thereby improving efficiency of updating a first data structure associated with the first data payload.

    Time-sensitive data delivery in distributed computing systems

    公开(公告)号:US11863457B2

    公开(公告)日:2024-01-02

    申请号:US17117819

    申请日:2020-12-10

    Inventor: Shachar Raindel

    CPC classification number: H04L47/283 H04L47/32 H04L67/1095 H04L69/22

    Abstract: Techniques of time-sensitive data delivery in distributed computing systems are disclosed herein. In one example, a server can disseminate the same information to multiple endpoints in a distributed computing system by transmitting multiple packets to the multiple endpoints hosted on additional servers in the distributed computing system. The multiple packets individually include a header field containing a delivery time before which the packets are not forwarded to corresponding final destinations and a payload containing data representing copies of information identical to one another destined to the multiple endpoints hosted on the additional servers.

    LOAD BALANCING IN DISTRIBUTED COMPUTING SYSTEMS

    公开(公告)号:US20210126966A1

    公开(公告)日:2021-04-29

    申请号:US15930299

    申请日:2020-05-12

    Abstract: Techniques for facilitating load balancing in distributed computing systems are disclosed herein. In one embodiment, a method includes receiving, at a destination server, a request packet from a load balancer via the computer network requesting a remote direct memory access (“RDMA”) connection between an originating server and one or more other servers selectable by the load balancer. The method can also include configuring, at the destination server, a rule for processing additional packets transmittable to the originating server via the RDMA connection based on the received reply packet. The rule is configured to encapsulate an outgoing packet transmittable to the originating server with an outer header having a destination field containing a network address of the originating server and a source field containing another network address of the destination server.

    Multicast apparatuses and methods for distributing data to multiple receivers in high-performance computing and cloud-based networks

    公开(公告)号:US10891253B2

    公开(公告)日:2021-01-12

    申请号:US15622787

    申请日:2017-06-14

    Abstract: An originating host device in a distribution chain is provided upstream from multiple host devices including intermediary and terminating host devices. The originating host device includes a core with a generation application and a first RDMA NIC. The core: determines a plan for transferring data between the originating host device and the other host devices; and generates WQEs to implement the plan. The first RDMA NIC includes a read application, a descriptor application, and a reception application. The read application is configured such that the first RDMA NIC reads the WQEs from a first memory. The descriptor application is configured such that the first RDMA NIC: writes a portion of the WQEs directly from the first RDMA NIC to a second memory of the intermediary host device; and triggers a second RDMA NIC of the intermediary host device to process the portion of the WQEs stored in the second memory.

Patent Agency Ranking