Methods and systems for efficiently moving data between nodes in a cluster

    公开(公告)号:US10484472B2

    公开(公告)日:2019-11-19

    申请号:US14840512

    申请日:2015-08-31

    Applicant: NETAPP, INC.

    Abstract: Exemplary embodiments provide methods, mediums, and systems for efficiently moving data between cluster nodes. Upon receiving a request to read or write data at a first cluster node that is in communication with a client, the first node effects the transfer to or from a second cluster node. The transfer is carried out using a combination of remote data memory access (“RDMA”), or a similar technique that bypasses a part of the network stack, and transport control protocol (“TCP”), or a similar technique that does not bypass a part of the network stack. The data is transferred using RDMA, while certain control messages are sent using TCP. By combining RDMA content transfers and TCP control messages, data transfers can be carried out faster, more efficiently, and with less processing overhead. Other embodiments are described and claimed.

    CLUSTER SCALE SYNCHRONIZATION OF PRODUCER CONSUMER FILE ACCESS VIA MULTI-PROTOCOL NODES
    2.
    发明申请
    CLUSTER SCALE SYNCHRONIZATION OF PRODUCER CONSUMER FILE ACCESS VIA MULTI-PROTOCOL NODES 有权
    通过多协议节目制作人消费者文件访问的聚类规模同步

    公开(公告)号:US20160328436A1

    公开(公告)日:2016-11-10

    申请号:US14703745

    申请日:2015-05-04

    Applicant: NetApp, Inc.

    Inventor: Subin Govind

    CPC classification number: G06F17/30168 H04L67/1095

    Abstract: In a storage cluster, a producer and a consumer can be remote from each other and have different capabilities. For example, a consumer may be running on a computing node (hereinafter “node”) that operates faster than a node hosting a producer. In addition, network conditions can impact communications to/from the producer and/or the consumer. This environment allows the possibility of a consumer violating sequential access constraints of a file when a producer is writing to the file. This can lead to the consumer reading incorrect data. A file system can ensure compliance with serialization of a concurrently accessed file by obtaining a lock on a subsequent file range before releasing a currently held write lock.

    Abstract translation: 在存储集群中,生产者和消费者可以彼此远离并具有不同的能力。 例如,消费者可以在比承载生产者的节点更快地运行的计算节点(以下称为“节点”)上运行。 此外,网络条件可能会影响到/来自生产者和/或消费者的通信。 这种环境允许消费者在生产者写入文件时违反文件的顺序访问约束的可能性。 这可能导致消费者读取不正确的数据。 文件系统可以通过在释放当前保持的写锁定之前在后续文件范围上获得锁定来确保符合并发访问文件的序列化。

    Systems, methods and devices for RDMA read/write operations

    公开(公告)号:US10257273B2

    公开(公告)日:2019-04-09

    申请号:US14815662

    申请日:2015-07-31

    Applicant: NetApp, Inc.

    Inventor: Subin Govind

    Abstract: Presented herein are Remote Direct Memory Access (RDMA) networks, RDMA protocols, and methods for performing upper layer protocol (ULP) for RDMA network configurations. Methods for performing ULP RDMA include: a client central processing unit (CPU) allocating a buffer in a memory region of a client computing device; a client network interface card (NIC) creating a steering tag for the buffer; the client CPU transmitting to a local server CPU of a local server node an initiate RDMA request, the RDMA request including source and destination (SRC-DEST) information and a requested RDMA operation, the SRC-DEST information including the steering tag and a file path for a data file; a remote server NIC of a remote server node locating the data file with the file path; the remote server NIC performing the requested RDMA operation without utilizing the server's CPU; and the client and remote server NIC's completing the requested RDMA operation.

    SYSTEMS, METHODS AND DEVICES FOR RDMA READ/WRITE OPERATIONS
    4.
    发明申请
    SYSTEMS, METHODS AND DEVICES FOR RDMA READ/WRITE OPERATIONS 审中-公开
    用于RDMA读/写操作的系统,方法和设备

    公开(公告)号:US20170034268A1

    公开(公告)日:2017-02-02

    申请号:US14815662

    申请日:2015-07-31

    Applicant: NetApp, Inc.

    Inventor: Subin Govind

    Abstract: Presented herein are Remote Direct Memory Access (RDMA) networks, RDMA protocols, and methods for performing upper layer protocol (ULP) for RDMA network configurations. Methods for performing ULP RDMA include: a client central processing unit (CPU) allocating a buffer in a memory region of a client computing device; a client network interface card (NIC) creating a steering tag for the buffer; the client CPU transmitting to a local server CPU of a local server node an initiate RDMA request, the RDMA request including source and destination (SRC-DEST) information and a requested RDMA operation, the SRC-DEST information including the steering tag and a file path for a data file; a remote server NIC of a remote server node locating the data file with the file path; the remote server NIC performing the requested RDMA operation without utilizing the server's CPU; and the client and remote server NIC's completing the requested RDMA operation.

    Abstract translation: 这里提出的是用于执行RDMA网络配置的上层协议(ULP)的远程直接存储器访问(RDMA)网络,RDMA协议和方法。 用于执行ULP RDMA的方法包括:在客户端计算设备的存储器区域中分配缓冲器的客户端中央处理单元(CPU) 客户端网络接口卡(NIC)为缓冲器创建转向标签; 客户端CPU向本地服务器节点的本地服务器CPU发送启动RDMA请求,RDMA请求包括源和目的地(SRC-DEST)信息和请求的RDMA操作,包括转向标签和文件的SRC-DEST信息 数据文件的路径; 用文件路径定位数据文件的远程服务器节点的远程服务器NIC; 远程服务器NIC执行请求的RDMA操作而不使用服务器的CPU; 客户端和远程服务器NIC完成请求的RDMA操作。

    METHODS AND SYSTEMS FOR EFFICIENTLY MOVING DATA BETWEEN NODES IN A CLUSTER
    5.
    发明申请
    METHODS AND SYSTEMS FOR EFFICIENTLY MOVING DATA BETWEEN NODES IN A CLUSTER 审中-公开
    有效地移动群集中的节点之间的数据的方法和系统

    公开(公告)号:US20170034269A1

    公开(公告)日:2017-02-02

    申请号:US14840512

    申请日:2015-08-31

    Applicant: NETAPP, INC.

    Abstract: Exemplary embodiments provide methods, mediums, and systems for efficiently moving data between cluster nodes. Upon receiving a request to read or write data at a first cluster node that is in communication with a client, the first node effects the transfer to or from a second cluster node. The transfer is carried out using a combination of remote data memory access (“RDMA”), or a similar technique that bypasses a part of the network stack, and transport control protocol (“TCP”), or a similar technique that does not bypass a part of the network stack. The data is transferred using RDMA, while certain control messages are sent using TCP. By combining RDMA content transfers and TCP control messages, data transfers can be carried out faster, more efficiently, and with less processing overhead. Other embodiments are described and claimed.

    Abstract translation: 示例性实施例提供用于在集群节点之间有效移动数据的方法,介质和系统。 在接收到与客户端通信的第一集群节点读取或写入数据的请求时,第一节点影响到第二集群节点的传输或从第二集群节点传送数据。 使用远程数据存储器访问(“RDMA”)或绕过网络堆栈的一部分的类似技术以及传输控制协议(“TCP”)或不绕过的类似技术来进行传送 网络堆栈的一部分。 使用RDMA传输数据,而使用TCP发送某些控制消息。 通过组合RDMA内容传输和TCP控制消息,可以更快,更有效地执行数据传输,并以较少的处理开销进行数据传输。 描述和要求保护其他实施例。

    Cluster scale synchronization of producer consumer file access via multi-protocol nodes

    公开(公告)号:US09830331B2

    公开(公告)日:2017-11-28

    申请号:US14703745

    申请日:2015-05-04

    Applicant: NetApp, Inc.

    Inventor: Subin Govind

    CPC classification number: G06F17/30168 H04L67/1095

    Abstract: In a storage cluster, a producer and a consumer can be remote from each other and have different capabilities. For example, a consumer may be running on a computing node (hereinafter “node”) that operates faster than a node hosting a producer. In addition, network conditions can impact communications to/from the producer and/or the consumer. This environment allows the possibility of a consumer violating sequential access constraints of a file when a producer is writing to the file. This can lead to the consumer reading incorrect data. A file system can ensure compliance with serialization of a concurrently accessed file by obtaining a lock on a subsequent file range before releasing a currently held write lock.

    Method for selecting between multiple RPC frameworks during a TCP/IP session
    7.
    发明申请
    Method for selecting between multiple RPC frameworks during a TCP/IP session 审中-公开
    在TCP / IP会话期间在多个RPC框架之间进行选择的方法

    公开(公告)号:US20170034311A1

    公开(公告)日:2017-02-02

    申请号:US14814450

    申请日:2015-07-30

    Applicant: NetApp, Inc.

    Abstract: Systems, devices, methods and computer program products are provided for selecting between multiple remote procedure call (RPC) frameworks in a client/server Transmission Control Protocol/Internet Protocol (TCP/IP) session. A server device can be configured with multiple RPC frameworks for processing and decoding RPC related communication from a client device. Each RPC framework can be designed to process RPC messages associated with a particular RPC suite. The appropriate RPC framework to decode and process incoming RPC messages can be selected based on a variety of factors. For example, the appropriate RPC framework can be selected based on the RPC suite identified by the client device during an RPC bind operation. The appropriate RPC framework can also be selected based on a server message block (SMB) pipe opened by the client device. The appropriate RPC framework can be further selected based on a client identifier.

    Abstract translation: 提供了系统,设备,方法和计算机程序产品,用于在客户机/服务器传输控制协议/因特网协议(TCP / IP)会话中的多个远程过程调用(RPC)框架之间进行选择。 服务器设备可以配置多个RPC框架,用于处理和解码来自客户端设备的RPC相关通信。 每个RPC框架都可以设计为处理与特定RPC套件相关联的RPC消息。 可以根据各种因素选择适当的RPC框架来解码和处理传入的RPC消息。 例如,可以在RPC绑定操作期间基于由客户端设备识别的RPC套件来选择适当的RPC框架。 也可以根据由客户端设备打开的服务器消息块(SMB)管道来选择适当的RPC框架。 可以基于客户端标识符进一步选择适当的RPC框架。

    METHODS AND SYSTEMS FOR EFFICIENTLY MOVING DATA BETWEEN NODES IN A CLUSTER

    公开(公告)号:US20170034270A1

    公开(公告)日:2017-02-02

    申请号:US14976562

    申请日:2015-12-21

    Applicant: NETAPP, INC.

    Abstract: Exemplary embodiments provide methods, mediums, and systems for efficiently moving data between cluster nodes. Upon receiving a request to read or write data at a first cluster node that is in communication with a client, the first node effects the transfer to or from a second cluster node. The transfer is carried out using a combination of remote data memory access (“RDMA”), or a similar technique that bypasses a part of the network stack, and transport control protocol (“TCP”), or a similar technique that does not bypass a part of the network stack. The data is transferred using RDMA, while certain control messages are sent using TCP. By combining RDMA content transfers and TCP control messages, data transfers can be carried out faster, more efficiently, and with less processing overhead. Other embodiments are described and claimed.

Patent Agency Ranking