-
公开(公告)号:US10817393B2
公开(公告)日:2020-10-27
申请号:US16391842
申请日:2019-04-23
Applicant: NetApp, Inc.
Inventor: Dheeraj Raghavender Sangamkar , Song Guen Yoon , Emalayan Vairavanathan , Yi Zhang
IPC: G06F11/20 , G06F11/10 , H04L29/08 , G06F3/06 , G06F11/14 , G06F3/12 , H04L29/14 , H03M13/15 , G06F9/50
Abstract: To ensure that there is an elected manager among storage nodes of an erasure coding group (“ECG”), an ECG manager (“ECGM”) election process is periodically performed among available storage nodes that are configured with the software to perform the services of an ECGM. When a storage node is activated, an ECGM process of the storage node begins executing and is assigned a process identifier (“PID”). A storage node can utilize a service query framework to identify other available storage nodes and retrieve their ECGM PIDs. The storage node then selects a PID according to a criterion and elects the storage node corresponding to the selected PID to be the acting ECGM. This process is performed periodically, so even if the acting ECGM storage node fails, a new ECGM is eventually selected from the available storage nodes.
-
公开(公告)号:US10353740B2
公开(公告)日:2019-07-16
申请号:US15589909
申请日:2017-05-08
Applicant: NetApp, Inc.
Inventor: Emalayan Vairavanathan , Dheeraj Raghavender Sangamkar , Song Guen Yoon , Yi Zhang
Abstract: To efficiently recover from a multiple storage node failure, a storage node concurrently restores data fragments to the multiple failed storage nodes, as opposed to restoring each node individually. In the VCS based storage technique, storage nodes are restored as part of an ECG repair process. For each ECG being repaired, a storage node performing the restoration process reads data fragments from active nodes in the ECG and generates new data fragments to replace any lost data fragments. The node then stores one of the new data fragments across each of the failed storage nodes. By concurrently restoring data fragments to each failed storage node, the data fragments needed to repair each ECG are only read once, thereby preserving disk operations and network bandwidth.
-
公开(公告)号:US20170242732A1
公开(公告)日:2017-08-24
申请号:US15589909
申请日:2017-05-08
Applicant: NetApp, Inc.
Inventor: Emalayan Vairavanathan , Dheeraj Raghavender Sangamkar , Song Guen Yoon , Yi Zhang
CPC classification number: G06F11/1076 , G06F3/0619 , G06F3/064 , G06F3/067 , G06F3/1234 , G06F9/5038 , G06F11/1402 , G06F11/1471 , G06F11/1489 , G06F11/20 , G06F11/2069 , G06F11/2092 , G06F2201/805 , G06F2201/85 , G06F2211/1028 , H03M13/154 , H04L67/1097 , H04L69/40
Abstract: To efficiently recover from a multiple storage node failure, a storage node concurrently restores data fragments to the multiple failed storage nodes, as opposed to restoring each node individually. In the VCS based storage technique, storage nodes are restored as part of an ECG repair process. For each ECG being repaired, a storage node performing the restoration process reads data fragments from active nodes in the ECG and generates new data fragments to replace any lost data fragments. The node then stores one of the new data fragments across each of the failed storage nodes. By concurrently restoring data fragments to each failed storage node, the data fragments needed to repair each ECG are only read once, thereby preserving disk operations and network bandwidth.
-
公开(公告)号:US10365848B2
公开(公告)日:2019-07-30
申请号:US15338077
申请日:2016-10-28
Applicant: NetApp, Inc.
Inventor: Tymoteusz Altman , Yi Zhang , Dheeraj Raghavender Sangamkar , Emalayan Vairavanathan
IPC: G06F3/06
Abstract: Techniques are described for reserving space on a destination node or volume for increasing the likelihood of a successful data transfer in a distributed storage environment. A reservation may be retried at one or more destinations if the reservation fails at a first destination. In some embodiments, the data-transfer process can be paused or terminated prior to data being transferred to one or more destinations if a reservation fails. Reserving space on a destination node or volume can increase the likelihood of a successful data transfer, which can increase the likelihood of efficient resources usage in a storage system.
-
公开(公告)号:US10929043B2
公开(公告)日:2021-02-23
申请号:US16505339
申请日:2019-07-08
Applicant: NETAPP, INC.
Inventor: Tymoteusz Altman , Yi Zhang , Dheeraj Raghavender Sangamkar , Emalayan Vairavanathan
IPC: G06F3/06
Abstract: Techniques are described for reserving space on a destination node or volume for increasing the likelihood of a successful data transfer in a distributed storage environment. A reservation may be retried at one or more destinations if the reservation fails at a first destination. In some embodiments, the data-transfer process can be paused or terminated prior to data being transferred to one or more destinations if a reservation fails. Reserving space on a destination node or volume can increase the likelihood of a successful data transfer, which can increase the likelihood of efficient resources usage in a storage system.
-
公开(公告)号:US20200034256A1
公开(公告)日:2020-01-30
申请号:US16460404
申请日:2019-07-02
Applicant: NetApp, Inc.
Inventor: Emalayan Vairavanathan , Dheeraj Raghavender Sangamkar , Song Guen Yoon , Yi Zhang
IPC: G06F11/20 , G06F11/10 , H04L29/08 , G06F3/06 , G06F11/14 , G06F3/12 , H04L29/14 , H03M13/15 , G06F9/50
Abstract: To efficiently recover from a multiple storage node failure, a storage node concurrently restores data fragments to the multiple failed storage nodes, as opposed to restoring each node individually. In the VCS based storage technique, storage nodes are restored as part of an ECG repair process. For each ECG being repaired, a storage node performing the restoration process reads data fragments from active nodes in the ECG and generates new data fragments to replace any lost data fragments. The node then stores one of the new data fragments across each of the failed storage nodes. By concurrently restoring data fragments to each failed storage node, the data fragments needed to repair each ECG are only read once, thereby preserving disk operations and network bandwidth.
-
公开(公告)号:US20170160982A1
公开(公告)日:2017-06-08
申请号:US15338077
申请日:2016-10-28
Applicant: NetApp, Inc.
Inventor: Tymoteusz Altman , Yi Zhang , Dheeraj Raghavender Sangamkar , Emalayan Vairavanathan
IPC: G06F3/06
CPC classification number: G06F3/0644 , G06F3/061 , G06F3/0631 , G06F3/067
Abstract: Techniques are described for reserving space on a destination node or volume for increasing the likelihood of a successful data transfer in a distributed storage environment. A reservation may be retried at one or more destinations if the reservation fails at a first destination. In some embodiments, the data-transfer process can be paused or terminated prior to data being transferred to one or more destinations if a reservation fails. Reserving space on a destination node or volume can increase the likelihood of a successful data transfer, which can increase the likelihood of efficient resources usage in a storage system.
-
公开(公告)号:US10795789B2
公开(公告)日:2020-10-06
申请号:US16460404
申请日:2019-07-02
Applicant: NetApp, Inc.
Inventor: Emalayan Vairavanathan , Dheeraj Raghavender Sangamkar , Song Guen Yoon , Yi Zhang
IPC: G06F11/20 , G06F11/10 , H04L29/08 , G06F3/06 , G06F11/14 , G06F3/12 , H04L29/14 , H03M13/15 , G06F9/50
Abstract: To efficiently recover from a multiple storage node failure, a storage node concurrently restores data fragments to the multiple failed storage nodes, as opposed to restoring each node individually. In the VCS based storage technique, storage nodes are restored as part of an ECG repair process. For each ECG being repaired, a storage node performing the restoration process reads data fragments from active nodes in the ECG and generates new data fragments to replace any lost data fragments. The node then stores one of the new data fragments across each of the failed storage nodes. By concurrently restoring data fragments to each failed storage node, the data fragments needed to repair each ECG are only read once, thereby preserving disk operations and network bandwidth.
-
公开(公告)号:US20170242770A1
公开(公告)日:2017-08-24
申请号:US15589872
申请日:2017-05-08
Applicant: NetApp, Inc.
Inventor: Dheeraj Raghavender Sangamkar , Song Guen Yoon , Emalayan Vairavanathan , Yi Zhang
CPC classification number: G06F11/2092 , G06F3/0619 , G06F3/064 , G06F3/067 , G06F3/1234 , G06F9/5038 , G06F11/1076 , G06F11/1402 , G06F11/1471 , G06F11/1489 , G06F11/20 , G06F11/2069 , G06F2201/805 , G06F2201/85 , G06F2211/1028 , H03M13/154 , H04L67/1097 , H04L69/40
Abstract: To ensure that there is an elected manager among storage nodes of an erasure coding group (“ECG”), an ECG manager (“ECGM”) election process is periodically performed among available storage nodes that are configured with the software to perform the services of an ECGM. When a storage node is activated, an ECGM process of the storage node begins executing and is assigned a process identifier (“PID”). A storage node can utilize a service query framework to identify other available storage nodes and retrieve their ECGM PIDs. The storage node then selects a PID according to a criterion and elects the storage node corresponding to the selected PID to be the acting ECGM. This process is performed periodically, so even if the acting ECGM storage node fails, a new ECGM is eventually selected from the available storage nodes.
-
公开(公告)号:US20190332304A1
公开(公告)日:2019-10-31
申请号:US16505339
申请日:2019-07-08
Applicant: NETAPP, INC.
Inventor: Tymoteusz Altman , Yi Zhang , Dheeraj Raghavender Sangamkar , Emalayan Vairavanathan
IPC: G06F3/06
Abstract: Techniques are described for reserving space on a destination node or volume for increasing the likelihood of a successful data transfer in a distributed storage environment. A reservation may be retried at one or more destinations if the reservation fails at a first destination. In some embodiments, the data-transfer process can be paused or terminated prior to data being transferred to one or more destinations if a reservation fails. Reserving space on a destination node or volume can increase the likelihood of a successful data transfer, which can increase the likelihood of efficient resources usage in a storage system.
-
-
-
-
-
-
-
-
-