-
公开(公告)号:US20180293018A1
公开(公告)日:2018-10-11
申请号:US16004340
申请日:2018-06-08
Applicant: NetApp, Inc.
Inventor: Ajay Bakre , Vishnu Vardhan Chandra Kumaran , Alvin Lam , Emalayan Vairavanathan , Viswanath Chandrasekara Bharathi , Vladimir Avram , Dheeraj Raghavender Sangamkar , Oliver Seiler , Carmen Lum
CPC classification number: G06F3/0649 , G06F3/0616 , G06F3/065 , G06F3/067 , G06F11/1076 , G06F11/1092
Abstract: A storage management computing device obtains an information lifecycle management (ILM) policy based on a query from a storage node ingesting an object into a distributed storage system. A hierarchical data protection plan comprising protection schemes at different layers of the distributed storage system is determined. A data protection scheme to be applied at a storage node computing device level is determined and a plurality of storage node computing devices are identified based on the hierarchical data protection plan. The storage management computing device instructs the ingesting storage node to store the object into the distributed storage system according to the hierarchical data protection plan.
-
公开(公告)号:US10019192B2
公开(公告)日:2018-07-10
申请号:US15412821
申请日:2017-01-23
Applicant: NetApp, Inc.
Inventor: Ajay Bakre , Vishnu Vardhan Chandra Kumaran , Alvin Lam , Emalayan Vairavanathan , Viswanath Chandrasekara Bharathi , Vladimir Avram , Dheeraj Raghavender Sangamkar , Oliver Seiler , Carmen Lum
CPC classification number: G06F3/0649 , G06F3/0616 , G06F3/065 , G06F3/067 , G06F11/1076 , G06F11/1092
Abstract: A storage management computing device obtains an information lifecycle management (ILM) policy. A data protection scheme to be applied at a storage node computing device level is determined and a plurality of storage node computing devices are identified based on an application of the ILM policy to metadata received from one of the storage node computing devices and associated with an object ingested by the one of the storage node computing devices. The one of the storage node computing devices is instructed to generate one or more copies of the object or fragments of the object according to the data protection scheme and to distribute the object copies or one of the object fragments to one or more other of the storage node computing devices to be stored by at least the one or more other storage node computing devices on one or more disk storage devices.
-
公开(公告)号:US20170139640A1
公开(公告)日:2017-05-18
申请号:US15412821
申请日:2017-01-23
Applicant: NetApp, Inc.
Inventor: Ajay Bakre , Vishnu Vardhan Chandra Kumaran , Alvin Lam , Emalayan Vairavanathan , Viswanath Chandrasekara Bharathi , Vladimir Avram , Dheeraj Raghavender Sangamkar , Oliver Seiler , Carmen Lum
CPC classification number: G06F3/0649 , G06F3/0616 , G06F3/0619 , G06F3/064 , G06F3/065 , G06F3/067 , G06F3/0689 , G06F11/1076 , G06F11/1092
Abstract: A storage management computing device obtains an information lifecycle management (ILM) policy. A data protection scheme to be applied at a storage node computing device level is determined and a plurality of storage node computing devices are identified based on an application of the ILM policy to metadata received from one of the storage node computing devices and associated with an object ingested by the one of the storage node computing devices. The one of the storage node computing devices is instructed to generate one or more copies of the object or fragments of the object according to the data protection scheme and to distribute the object copies or one of the object fragments to one or more other of the storage node computing devices to be stored by at least the one or more other storage node computing devices on one or more disk storage devices.
-
公开(公告)号:US09626245B2
公开(公告)日:2017-04-18
申请号:US14627769
申请日:2015-02-20
Applicant: NetApp, Inc.
Inventor: Ajay Bakre , Vishnu Vardhan Chandra Kumaran , Alvin Lam , Emalayan Vairavanathan , Viswanath Chandrasekara Bharathi , Vladimir Avram , Dheeraj Raghavender Sangamkar , Oliver Seiler , Carmen Lum
CPC classification number: G06F3/0649 , G06F3/0616 , G06F3/0619 , G06F3/064 , G06F3/065 , G06F3/067 , G06F3/0689 , G06F11/1076 , G06F11/1092
Abstract: A method, non-transitory computer readable medium, and storage management computing device that obtains an information lifecycle management (ILM) policy. A data protection scheme to be applied at a storage node computing device level is determined and a plurality of storage node computing devices are identified based on an application of the ILM policy to metadata received from one of the storage node computing devices and associated with an object ingested by the one of the storage node computing devices. The one of the storage node computing devices is instructed to generate one or more copies of the object or fragments of the object according to the data protection scheme and to distribute the object copies or one of the object fragments to one or more other of the storage node computing devices to be stored by at least the one or more other storage node computing devices on one or more disk storage devices.
-
公开(公告)号:US11740826B2
公开(公告)日:2023-08-29
申请号:US17657449
申请日:2022-03-31
Applicant: NetApp, Inc.
Inventor: Ajay Bakre , Vishnu Vardhan Chandra Kumaran , Alvin Lam , Emalayan Vairavanathan , Viswanath Chandrasekara Bharathi , Vladimir Avram , Dheeraj Raghavender Sangamkar , Oliver Seiler , Carmen Lum
CPC classification number: G06F3/0649 , G06F3/065 , G06F3/067 , G06F3/0616 , G06F11/1076 , G06F11/1088 , G06F11/1092 , G06F11/2094 , H03M13/154 , H03M13/373 , H03M13/3761 , G06F2201/805 , G06F2201/82
Abstract: A storage management computing device obtains an information lifecycle management (ILM) policy. A data protection scheme to be applied at a storage node computing device level is determined and a plurality of storage node computing devices are identified based on an application of the ILM policy to metadata received from one of the storage node computing devices and associated with an object ingested by the one of the storage node computing devices. The one of the storage node computing devices is instructed to generate one or more copies of the object or fragments of the object according to the data protection scheme and to distribute the object copies or one of the object fragments to one or more other of the storage node computing devices to be stored by at least the one or more other storage node computing devices on one or more disk storage devices.
-
公开(公告)号:US20220229749A1
公开(公告)日:2022-07-21
申请号:US17657786
申请日:2022-04-04
Applicant: NetApp, Inc.
Abstract: Distributed storage systems frequently use a centralized metadata repository that stores metadata in an eventually consistent distributed database. However, a metadata repository cannot be relied upon for determining which erasure coded fragments are lost because of a storage node(s) failures. Instead, when recovering a failed storage node, a list of missing fragments is generated based on fragments stored in storage devices of available storage nodes. A storage node performing the recovery sends a request to one or more of the available storage nodes for a fragment list. The fragment list is generated, not based on a metadata database, but on scanning storage devices for fragments related to the failed storage node. The storage node performing the recovery merges retrieved lists to create a master list indicating fragments that should be regenerated for recovery of the failed storage node(s).
-
公开(公告)号:US11372738B2
公开(公告)日:2022-06-28
申请号:US16711513
申请日:2019-12-12
Applicant: NetApp, Inc.
Abstract: Distributed storage systems frequently use a centralized metadata repository that stores metadata in an eventually consistent distributed database. However, a metadata repository cannot be relied upon for determining which erasure coded fragments are lost because of a storage node(s) failures. Instead, when recovering a failed storage node, a list of missing fragments is generated based on fragments stored in storage devices of available storage nodes. A storage node performing the recovery sends a request to one or more of the available storage nodes for a fragment list. The fragment list is generated, not based on a metadata database, but on scanning storage devices for fragments related to the failed storage node. The storage node performing the recovery merges retrieved lists to create a master list indicating fragments that should be regenerated for recovery of the failed storage node(s).
-
公开(公告)号:US11023340B2
公开(公告)日:2021-06-01
申请号:US16665164
申请日:2019-10-28
Applicant: NetApp, Inc.
Inventor: Dheeraj Raghavender Sangamkar , Ajay Bakre , Vladimir Radu Avram , Emalayan Vairavanathan , Viswanath Chandrasekara Bharathi
IPC: G06F11/20 , G06F11/10 , H04L29/08 , G06F3/06 , G06F11/14 , G06F3/12 , H04L29/14 , H03M13/15 , G06F9/50
Abstract: Technology is disclosed for storing data in a distributed storage system using a virtual chunk service (VCS). In the VCS based storage technique, a storage node (“node”) is split into multiple VCSs and each of the VCSs can be assigned a unique ID in the distributed storage. A set of VCSs from a set of nodes form a storage group, which also can be assigned a unique ID in the distributed storage. When a data object is received for storage, a storage group is identified for the data object, the data object is encoded to generate multiple fragments and each fragment is stored in a VCS of the identified storage group. The data recovery process is made more efficient by using metadata, e.g., VCS to storage node mapping, storage group to VCS mapping, VCS to objects mapping, which eliminates resource intensive read and write operations during recovery.
-
公开(公告)号:US10795789B2
公开(公告)日:2020-10-06
申请号:US16460404
申请日:2019-07-02
Applicant: NetApp, Inc.
Inventor: Emalayan Vairavanathan , Dheeraj Raghavender Sangamkar , Song Guen Yoon , Yi Zhang
IPC: G06F11/20 , G06F11/10 , H04L29/08 , G06F3/06 , G06F11/14 , G06F3/12 , H04L29/14 , H03M13/15 , G06F9/50
Abstract: To efficiently recover from a multiple storage node failure, a storage node concurrently restores data fragments to the multiple failed storage nodes, as opposed to restoring each node individually. In the VCS based storage technique, storage nodes are restored as part of an ECG repair process. For each ECG being repaired, a storage node performing the restoration process reads data fragments from active nodes in the ECG and generates new data fragments to replace any lost data fragments. The node then stores one of the new data fragments across each of the failed storage nodes. By concurrently restoring data fragments to each failed storage node, the data fragments needed to repair each ECG are only read once, thereby preserving disk operations and network bandwidth.
-
公开(公告)号:US10691366B2
公开(公告)日:2020-06-23
申请号:US16004340
申请日:2018-06-08
Applicant: NetApp, Inc.
Inventor: Ajay Bakre , Vishnu Vardhan Chandra Kumaran , Alvin Lam , Emalayan Vairavanathan , Viswanath Chandrasekara Bharathi , Vladimir Avram , Dheeraj Raghavender Sangamkar , Oliver Seiler , Carmen Lum
Abstract: A storage management computing device obtains an information lifecycle management (ILM) policy based on a query from a storage node ingesting an object into a distributed storage system. A hierarchical data protection plan comprising protection schemes at different layers of the distributed storage system is determined. A data protection scheme to be applied at a storage node computing device level is determined and a plurality of storage node computing devices are identified based on the hierarchical data protection plan. The storage management computing device instructs the ingesting storage node to store the object into the distributed storage system according to the hierarchical data protection plan.
-
-
-
-
-
-
-
-
-