Dynamically scaling application and storage system functions based on a heterogeneous resource pool available for use by a distributed storage management system

    公开(公告)号:US12079242B2

    公开(公告)日:2024-09-03

    申请号:US18047774

    申请日:2022-10-19

    Applicant: NetApp, Inc.

    CPC classification number: G06F16/27

    Abstract: Systems and methods for scaling application and/or storage system functions of a distributed storage system based on a heterogeneous resource pool are provided. According to one embodiment, the distributed storage system has a composable, service-based architecture that provides scalability, resiliency, and load balancing. The distributed storage system includes a cluster of nodes each potentially having differing capabilities in terms of processing, memory, and/or storage. The distributed storage system takes advantage of different types of nodes by selectively instating appropriate services (e.g., file and volume services and/or block and storage management services) on the nodes based on their respective capabilities. Furthermore, disaggregation of these services, facilitated by interposing a frictionless layer (e.g., in the form of one or more globally accessible logical disks) therebetween, enables independent and on-demand scaling of either or both of application and storage system functions within the cluster while making use of the heterogeneous resource pool.

    Distributed File System with Disaggregated Data Management and Storage Management Layers

    公开(公告)号:US20230367517A1

    公开(公告)日:2023-11-16

    申请号:US18359188

    申请日:2023-07-26

    Applicant: NetApp, Inc.

    Abstract: Systems and methods for managing data storage using a distributed file system are provided. In one example, a relocation event is detected that indicates a relocation is to be initialized. The relocation is initialized by identifying a destination node of a distributed storage system for the relocation of a set of objects in a cluster database, including a logical block device, a corresponding logical aggregate, and a corresponding file system volume. A state of each of the set of objects is changed to offline. The set of objects are then relocated from an originating node of the distributed storage system to the destination node in which the corresponding logical aggregate is relocated after the logical block device and the corresponding file system volume is relocated after the logical aggregate. Finally, the state of each of the set of objects is changed to online.

    KEY VALUE STORE WITH DISTRIBUTED SHARED ACCESS BY CLIENTS

    公开(公告)号:US20220413765A1

    公开(公告)日:2022-12-29

    申请号:US17721144

    申请日:2022-04-14

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for hosting a key value store. A persistent storage backend is used to centrally host a key value store as disaggregated storage shared with a plurality of clients over a network fabric. A network storage appliance is connected to the plurality of clients over the network fabric, and is configured with a key value store interface. The key value store interface is configured to receive a key value command from a client. The key value store interface parses the key value command to identify a translation layer binding for a key value store targeted by the key value command. The key value store interface translates the key value command into a key value operation using the translation layer binding, and executes the key value operation upon the key value store.

    Migration between CPU cores
    14.
    发明授权

    公开(公告)号:US11182202B2

    公开(公告)日:2021-11-23

    申请号:US16653079

    申请日:2019-10-15

    Applicant: NetApp, Inc.

    Abstract: Methods, non-transitory machine-readable media, and computing devices for transitioning tasks and interrupt service routines are provided. An example method includes processing, by a plurality of processor cores of a storage controller, tasks and interrupt service routines. A performance statistic is determined corresponding to the plurality of processor cores. Based on detecting that the performance statistic passes a threshold, a number of the plurality of processor cores that are assigned to the tasks and the interrupt service routines are reduced.

    Balanced, opportunistic multicore I/O scheduling from non-SMP applications

    公开(公告)号:US10826848B2

    公开(公告)日:2020-11-03

    申请号:US15497744

    申请日:2017-04-26

    Applicant: NETAPP, INC.

    Abstract: A system for dynamically configuring and scheduling input/output (I/O) workloads among processing cores is disclosed. Resources for an application that are related to each other and/or not multicore safe are grouped together into work nodes. When these need to be executed, the work nodes are added to a global queue that is accessible by all of the processing cores. Any processing core that becomes available can pull and process the next available work node through to completion, so that the work associated with that work node software object is all completed by the same core, without requiring additional protections for resources that are not multicore safe. Indexes track the location of both the next work node in the global queue for processing and the next location in the global queue for new work nodes to be added for subsequent processing.

    Raid data migration through stripe swapping

    公开(公告)号:US10579540B2

    公开(公告)日:2020-03-03

    申请号:US15010160

    申请日:2016-01-29

    Applicant: NetApp, Inc.

    Abstract: A system and method for improving storage system operation is disclosed. A storage system includes a first tier with high-performance redundancy and a second tier with capacity efficient redundancy. The first tier and the second tier are built from the same storage devices in a storage pool so each storage device includes both the first and second tiers. The storage system stores write data initially to the first tier. When demand for the data falls below a threshold, the storage system migrates the write data to the second tier. This is done by changing the mapping of underlying physical locations on the storage devices where the write data is stored so that the underlying physical locations are logically associated with the second tier instead of the first tier. After remapping, the storage system also computes parity information for the migrated write data and stores it in the second tier.

    Migration Between CPU Cores
    17.
    发明申请

    公开(公告)号:US20200042347A1

    公开(公告)日:2020-02-06

    申请号:US16653079

    申请日:2019-10-15

    Applicant: NetApp, Inc.

    Abstract: Methods, non-transitory machine-readable media, and computing devices for transitioning tasks and interrupt service routines are provided. An example method includes processing, by a plurality of processor cores of a storage controller, tasks and interrupt service routines. A performance statistic is determined corresponding to the plurality of processor cores. Based on detecting that the performance statistic passes a threshold, a number of the plurality of processor cores that are assigned to the tasks and the interrupt service routines are reduced.

    Methods and systems for dynamic hashing in caching sub-systems

    公开(公告)号:US10481835B2

    公开(公告)日:2019-11-19

    申请号:US14510829

    申请日:2014-10-09

    Applicant: NETAPP, INC.

    Abstract: Methods and systems for dynamic hashing in cache sub-systems are provided. The method includes analyzing a plurality of input/output (I/O) requests for determining a pattern indicating if the I/O requests are random or sequential; and using the pattern for dynamically changing a first input to a second input for computing a hash index value by a hashing function that is used to index into a hashing data structure to look up a cache block to cache an I/O request to read or write data, where for random I/O requests, a segment size is the first input to a hashing function to compute a first hash index value and for sequential I/O requests, a stripe size is used as the second input for computing a second hash index value.

    Migration between CPU cores
    19.
    发明授权

    公开(公告)号:US10459759B2

    公开(公告)日:2019-10-29

    申请号:US15890481

    申请日:2018-02-07

    Applicant: NetApp, Inc.

    Abstract: Methods, non-transitory machine-readable media, and computing devices for transitioning tasks and interrupt service routines are provided. An example method includes processing, by a plurality of processor cores of a storage controller, tasks and interrupt service routines. A performance statistic is determined corresponding to the plurality of processor cores. Based on detecting that the performance statistic passes a threshold, a number of the plurality of processor cores that are assigned to the tasks and the interrupt service routines are reduced.

Patent Agency Ranking