-
公开(公告)号:US11175989B1
公开(公告)日:2021-11-16
申请号:US16858376
申请日:2020-04-24
申请人: NetApp, Inc.
发明人: Sneheet Kumar Mishra , Daniel David McCarthy , Christopher Clark Corey , Austino Nicholas Longo , Christopher Cason
摘要: A technique provides efficient data protection, such as erasure coding, for data blocks of volumes served by storage nodes of a cluster. Data blocks associated with write requests of unpredictable client workload patterns may be compressed. A set of the compressed data blocks may be selected to form a write group and an erasure code may be applied to the group to algorithmically generate one or more encoded blocks in addition to the data blocks. Due to the unpredictability of the data workload patterns, the compressed data blocks may have varying sizes. A pool of the various-sized compressed data blocks may be established and maintained from which the data blocks of the write group are selected. Establishment and maintenance of the pool enables selection of compressed data blocks that are substantially close to the same size and, thus, that require minimal padding.
-
公开(公告)号:US12067256B2
公开(公告)日:2024-08-20
申请号:US17932753
申请日:2022-09-16
申请人: NetApp, Inc.
发明人: Christopher Clark Corey , Daniel David McCarthy , Sneheet Kumar Mishra , Austino Nicholas Longo
CPC分类号: G06F3/0619 , G06F3/064 , G06F3/0653 , G06F3/067 , G06F9/5083 , G06F11/10 , G06F11/1489 , G06F11/3006 , G06F11/3034
摘要: A technique is configured to provide various data protection schemes, such as replication and erasure coding, for data blocks of volumes served by storage nodes of a cluster configured to perform deduplication of the data blocks. Additionally, the technique is configured to ensure that each deduplicated data block complies with data redundancy guarantees of the data protection schemes, while improving storage space of the storage nodes. In order to satisfy the data integrity guarantees while improving available storage space, the storage nodes perform periodic garbage collection for data blocks to optimize storage in accordance with currently applicable data protection schemes.
-
公开(公告)号:US20230013281A1
公开(公告)日:2023-01-19
申请号:US17932753
申请日:2022-09-16
申请人: NetApp, Inc.
发明人: Christopher Clark Corey , Daniel David McCarthy , Sneheet Kumar Mishra , Austino Nicholas Longo
摘要: A technique is configured to provide various data protection schemes, such as replication and erasure coding, for data blocks of volumes served by storage nodes of a cluster configured to perform deduplication of the data blocks. Additionally, the technique is configured to ensure that each deduplicated data block complies with data redundancy guarantees of the data protection schemes, while improving storage space of the storage nodes. In order to satisfy the data integrity guarantees while improving available storage space, the storage nodes perform periodic garbage collection for data blocks to optimize storage in accordance with currently applicable data protection schemes.
-
公开(公告)号:US20210248254A1
公开(公告)日:2021-08-12
申请号:US16788979
申请日:2020-02-12
申请人: NetApp, Inc.
摘要: A bin syncing technique ensures continuous data protection, such as replication and erasure coding, for content driven distribution of data served by storage nodes of a cluster in the event of failure to one or more block services configured to process the data. The cluster maintains information about the block services assigned to host a bin with a copy of the data in a bin assignment table associated with a state. The copies of the data are named, e.g., replica 0 (R0), replica 1 (R1) or replica 2 (R2). In response to failure of one or more block services assigned to host a bin with a replica of the data, an alternate or replacement block service may access the assignments maintained in the bin assignment table, which specify names of the replicas associated with the state.
-
公开(公告)号:US20240118981A1
公开(公告)日:2024-04-11
申请号:US18089192
申请日:2022-12-27
申请人: NetApp Inc.
发明人: Yash Hetal Trivedi , Daniel McCarthy , Ananthan Subramanian , William Arthur Gutknecht , Kevin Daniel Varghese , Swaroop Vikram Choudhari , Abdul Basit , Christopher Clark Corey , Chad Edmund Schneider
CPC分类号: G06F11/2025 , G06F11/1662
摘要: Techniques are provided for failing over an aggregate from one file system instance to a different file system instance of a distributed scale-out storage system. The aggregate may be stored within distributed storage that is accessible to a plurality of file system instances of the distributed scale-out storage system. When the aggregate is failed over from a first file system instance to a second file system instance, the first file system instance may still have a valid read lease that allows the first file system instance to serve client I/O, directed to the aggregate, using a cache. In order to prevent the first file system instance from serving stale data from the cache before the read lease expires, state machines and a set of control data are used to ensure that the second file system instance attaches to the aggregate only after the read lease has expired.
-
公开(公告)号:US11514181B2
公开(公告)日:2022-11-29
申请号:US16788979
申请日:2020-02-12
申请人: NetApp, Inc.
摘要: A bin syncing technique ensures continuous data protection, such as replication and erasure coding, for content driven distribution of data served by storage nodes of a cluster in the event of failure to one or more block services configured to process the data. The cluster maintains information about the block services assigned to host a bin with a copy of the data in a bin assignment table associated with a state. The copies of the data are named, e.g., replica 0 (R0), replica 1 (R1) or replica 2 (R2). In response to failure of one or more block services assigned to host a bin with a replica of the data, an alternate or replacement block service may access the assignments maintained in the bin assignment table, which specify names of the replicas associated with the state.
-
公开(公告)号:US11693737B2
公开(公告)日:2023-07-04
申请号:US17527852
申请日:2021-11-16
申请人: NetApp, Inc.
发明人: Sneheet Kumar Mishra , Daniel David McCarthy , Christopher Clark Corey , Austino Nicholas Longo , Christopher Cason
CPC分类号: G06F11/1076 , H03M13/154 , H03M7/3084
摘要: A technique provides efficient data protection, such as erasure coding, for data blocks of volumes served by storage nodes of a cluster. Data blocks associated with write requests of unpredictable client workload patterns may be compressed. A set of the compressed data blocks may be selected to form a write group and an erasure code may be applied to the group to algorithmically generate one or more encoded blocks in addition to the data blocks. Due to the unpredictability of the data workload patterns, the compressed data blocks may have varying sizes. A pool of the various-sized compressed data blocks may be established and maintained from which the data blocks of the write group are selected. Establishment and maintenance of the pool enables selection of compressed data blocks that are substantially close to the same size and, thus, that require minimal padding.
-
公开(公告)号:US11461015B2
公开(公告)日:2022-10-04
申请号:US16601978
申请日:2019-10-15
申请人: NetApp, Inc.
发明人: Christopher Clark Corey , Daniel David McCarthy , Sneheet Kumar Mishra , Austino Nicholas Longo
摘要: A technique is configured to provide various data protection schemes, such as replication and erasure coding, for data blocks of volumes served by storage nodes of a cluster configured to perform deduplication of the data blocks. Additionally, the technique is configured to ensure that each deduplicated data block complies with data redundancy guarantees of the data protection schemes, while improving storage space of the storage nodes. In order to satisfy the data integrity guarantees while improving available storage space, the storage nodes perform periodic garbage collection for data blocks to optimize storage in accordance with currently applicable data protection schemes.
-
公开(公告)号:US20220075691A1
公开(公告)日:2022-03-10
申请号:US17527852
申请日:2021-11-16
申请人: NetApp, Inc.
发明人: Sneheet Kumar Mishra , Daniel David McCarthy , Christopher Clark Corey , Austino Nicholas Longo , Christopher Cason
摘要: A technique provides efficient data protection, such as erasure coding, for data blocks of volumes served by storage nodes of a cluster. Data blocks associated with write requests of unpredictable client workload patterns may be compressed. A set of the compressed data blocks may be selected to form a write group and an erasure code may be applied to the group to algorithmically generate one or more encoded blocks in addition to the data blocks. Due to the unpredictability of the data workload patterns, the compressed data blocks may have varying sizes. A pool of the various-sized compressed data blocks may be established and maintained from which the data blocks of the write group are selected. Establishment and maintenance of the pool enables selection of compressed data blocks that are substantially close to the same size and, thus, that require minimal padding.
-
公开(公告)号:US20210334241A1
公开(公告)日:2021-10-28
申请号:US16858294
申请日:2020-04-24
申请人: NetApp, Inc.
发明人: Daniel David McCarthy , Austino Nicholas Longo , Christopher Clark Corey , Sneheet Kumar Mishra
IPC分类号: G06F16/182 , G06F16/16 , G06F12/02
摘要: A technique transitions data blocks of volumes served by storage nodes of a storage cluster from an old data protection scheme (DPS) to a new DPS in a non-disruptive manner. Slice services of the storage nodes forward the data blocks associated with write requests to the block services for storage on storage devices of the nodes. Mapping of volume logical block addresses to block identifiers are contained in slice files, wherein there is a single slice file for each volume. To transition a volume between the old and new DPSs, the slice service tags the data blocks with the new DPS when forwarding new write requests to the block services. In accordance with a background transitioning process, the slice service also retrieves every data block referenced by the to slice file and then resends the data to the block service with the new DPS.
-
-
-
-
-
-
-
-
-