公开(公告)号：US20200057701A1

公开(公告)日：2020-02-20

申请号：US16665164

申请日：2019-10-28

Applicant: NetApp, Inc.

Inventor： Dheeraj Raghavender Sangamkar ,  Ajay Bakre ,  Vladimir Radu Avram ,  Emalayan Vairavanathan ,  Viswanath Chandrasekara Bharathi

IPC: G06F11/20 ,  G06F9/50 ,  H03M13/15 ,  H04L29/14 ,  G06F11/14 ,  G06F3/12 ,  G06F3/06 ,  H04L29/08 ,  G06F11/10

Abstract: Technology is disclosed for storing data in a distributed storage system using a virtual chunk service (VCS). In the VCS based storage technique, a storage node (“node”) is split into multiple VCSs and each of the VCSs can be assigned a unique ID in the distributed storage. A set of VCSs from a set of nodes form a storage group, which also can be assigned a unique ID in the distributed storage. When a data object is received for storage, a storage group is identified for the data object, the data object is encoded to generate multiple fragments and each fragment is stored in a VCS of the identified storage group. The data recovery process is made more efficient by using metadata, e.g., VCS to storage node mapping, storage group to VCS mapping, VCS to objects mapping, which eliminates resource intensive read and write operations during recovery.

公开(公告)号：US20160246677A1

公开(公告)日：2016-08-25

申请号：US14696001

申请日：2015-04-24

Applicant: NetApp, Inc.

Inventor： Dheeraj Raghavender Sangamkar ,  Ajay Bakre ,  Vladimir Radu Avram ,  Emalayan Vairavanathan ,  Viswanath Chandrasekara Bharathi

IPC: G06F11/10 ,  G06F3/06 ,  H04L29/08

CPC classification number: G06F11/1076 ,  G06F3/0619 ,  G06F3/064 ,  G06F3/067 ,  G06F3/1234 ,  G06F11/1402 ,  G06F11/1471 ,  G06F11/1489 ,  G06F2211/1028 ,  H04L67/1097

Abstract: Technology is disclosed for storing data in a distributed storage system using a virtual chunk service (VCS). In the VCS based storage technique, a storage node (“node”) is split into multiple VCSs and each of the VCSs can be assigned a unique ID in the distributed storage. A set of VCSs from a set of nodes form a storage group, which also can be assigned a unique ID in the distributed storage. When a data object is received for storage, a storage group is identified for the data object, the data object is encoded to generate multiple fragments and each fragment is stored in a VCS of the identified storage group. The data recovery process is made more efficient by using metadata, e.g., VCS to storage node mapping, storage group to VCS mapping, VCS to objects mapping, which eliminates resource intensive read and write operations during recovery.

Abstract translation: 公开了用于使用虚拟块服务（VCS）在分布式存储系统中存储数据的技术。 在基于VCS的存储技术中，存储节点（“节点”）被分成多个VCS，并且可以在分布式存储器中为每个VCS分配唯一的ID。 来自一组节点的一组VCS形成存储组，也可以在分布式存储器中分配唯一的ID。 当接收到数据对象进行存储时，为数据对象识别存储组，对数据对象进行编码以生成多个片段，并将每个片段存储在所识别的存储组的VCS中。 通过使用元数据（例如VCS到存储节点映射，存储组到VCS映射，VCS到对象映射），可以使数据恢复过程更加高效，从而消除了恢复期间的资源密集型读写操作。

公开(公告)号：US20190205209A1

公开(公告)日：2019-07-04

申请号：US16210718

申请日：2018-12-05

Applicant: NetApp, Inc.

Inventor： Dheeraj Raghavender Sangamkar ,  Ajay Bakre ,  Vladimir Radu Avram ,  Emalayan Vairavanathan ,  Viswanath Chandrasekara Bharathi

IPC: G06F11/10 ,  G06F3/12 ,  G06F11/14 ,  H04L29/08 ,  G06F3/06

CPC classification number: G06F11/1076 ,  G06F3/0619 ,  G06F3/064 ,  G06F3/067 ,  G06F3/1234 ,  G06F9/5038 ,  G06F11/1402 ,  G06F11/1471 ,  G06F11/1489 ,  G06F11/20 ,  G06F11/2069 ,  G06F11/2092 ,  G06F2201/805 ,  G06F2201/85 ,  G06F2211/1028 ,  H03M13/154 ,  H04L67/1097 ,  H04L69/40

Abstract: Technology is disclosed for storing data in a distributed storage system using a virtual chunk service (VCS). In the VCS based storage technique, a storage node (“node”) is split into multiple VCSs and each of the VCSs can be assigned a unique ID in the distributed storage. A set of VCSs from a set of nodes form a storage group, which also can be assigned a unique ID in the distributed storage. When a data object is received for storage, a storage group is identified for the data object, the data object is encoded to generate multiple fragments and each fragment is stored in a VCS of the identified storage group. The data recovery process is made more efficient by using metadata, e.g., VCS to storage node mapping, storage group to VCS mapping, VCS to objects mapping, which eliminates resource intensive read and write operations during recovery.

公开(公告)号：US20180165155A1

公开(公告)日：2018-06-14

申请号：US15890913

申请日：2018-02-07

Applicant: NetApp, Inc.

Inventor： Dheeraj Raghavender Sangamkar ,  Ajay Bakre ,  Vladimir Radu Avram ,  Emalayan Vairavanathan ,  Viswanath Chandrasekara Bharathi

IPC: G06F11/10 ,  G06F11/14 ,  G06F3/12 ,  G06F3/06 ,  H04L29/08

CPC classification number: G06F11/1076 ,  G06F3/0619 ,  G06F3/064 ,  G06F3/067 ,  G06F3/1234 ,  G06F11/1402 ,  G06F11/1471 ,  G06F11/1489 ,  G06F2211/1028 ,  H04L67/1097

Abstract: Technology is disclosed for storing data in a distributed storage system using a virtual chunk service (VCS). In the VCS based storage technique, a storage node (“node”) is split into multiple VCSs and each of the VCSs can be assigned a unique ID in the distributed storage. A set of VCSs from a set of nodes form a storage group, which also can be assigned a unique ID in the distributed storage. When a data object is received for storage, a storage group is identified for the data object, the data object is encoded to generate multiple fragments and each fragment is stored in a VCS of the identified storage group. The data recovery process is made more efficient by using metadata, e.g., VCS to storage node mapping, storage group to VCS mapping, VCS to objects mapping, which eliminates resource intensive read and write operations during recovery.

公开(公告)号：US09665428B2

公开(公告)日：2017-05-30

申请号：US14614856

申请日：2015-02-05

Applicant: NetApp, Inc

Inventor： Emalayan Vairavanathan ,  Dheeraj Sangamkar ,  Ajay Bakre ,  Vladimir Avram ,  Viswanath Chandrasekara Bharathi

IPC: H03M13/00 ,  G06F11/10 ,  H03M13/15 ,  H04L29/08 ,  G06F3/06

CPC classification number: G06F11/1076 ,  G06F3/06 ,  G06F11/00 ,  H03M13/154 ,  H03M13/353 ,  H03M13/373 ,  H03M13/3761 ,  H04L67/108 ,  H04L67/1097 ,  H04L67/18

Abstract: A method, non-transitory computer readable medium, and storage management computing device that assists with distributing erasure coded fragments in geo-distributed storage nodes includes receiving an object and a storage reliability requirement from a client computing device. Erasure coding is performed on the received object using an erasure coding scheme. An erasure coding group from a plurality of erasure coding groups present in a plurality of geographically distributed storage nodes is determined based on the received storage reliability requirement and the erasure coding scheme. The erasure coded object is distributed to the determined erasure coding group from the plurality of erasure coding groups in the plurality of geographically distributed storage nodes.

公开(公告)号：US11740826B2

公开(公告)日：2023-08-29

申请号：US17657449

申请日：2022-03-31

Applicant: NetApp, Inc.

Inventor： Ajay Bakre ,  Vishnu Vardhan Chandra Kumaran ,  Alvin Lam ,  Emalayan Vairavanathan ,  Viswanath Chandrasekara Bharathi ,  Vladimir Avram ,  Dheeraj Raghavender Sangamkar ,  Oliver Seiler ,  Carmen Lum

IPC: G06F3/06 ,  G06F11/10 ,  G06F11/20 ,  H03M13/15 ,  H03M13/37

CPC classification number: G06F3/0649 ,  G06F3/065 ,  G06F3/067 ,  G06F3/0616 ,  G06F11/1076 ,  G06F11/1088 ,  G06F11/1092 ,  G06F11/2094 ,  H03M13/154 ,  H03M13/373 ,  H03M13/3761 ,  G06F2201/805 ,  G06F2201/82

Abstract: A storage management computing device obtains an information lifecycle management (ILM) policy. A data protection scheme to be applied at a storage node computing device level is determined and a plurality of storage node computing devices are identified based on an application of the ILM policy to metadata received from one of the storage node computing devices and associated with an object ingested by the one of the storage node computing devices. The one of the storage node computing devices is instructed to generate one or more copies of the object or fragments of the object according to the data protection scheme and to distribute the object copies or one of the object fragments to one or more other of the storage node computing devices to be stored by at least the one or more other storage node computing devices on one or more disk storage devices.

公开(公告)号：US11023340B2

公开(公告)日：2021-06-01

申请号：US16665164

申请日：2019-10-28

Applicant: NetApp, Inc.

Inventor： Dheeraj Raghavender Sangamkar ,  Ajay Bakre ,  Vladimir Radu Avram ,  Emalayan Vairavanathan ,  Viswanath Chandrasekara Bharathi

IPC: G06F11/20 ,  G06F11/10 ,  H04L29/08 ,  G06F3/06 ,  G06F11/14 ,  G06F3/12 ,  H04L29/14 ,  H03M13/15 ,  G06F9/50

Abstract: Technology is disclosed for storing data in a distributed storage system using a virtual chunk service (VCS). In the VCS based storage technique, a storage node (“node”) is split into multiple VCSs and each of the VCSs can be assigned a unique ID in the distributed storage. A set of VCSs from a set of nodes form a storage group, which also can be assigned a unique ID in the distributed storage. When a data object is received for storage, a storage group is identified for the data object, the data object is encoded to generate multiple fragments and each fragment is stored in a VCS of the identified storage group. The data recovery process is made more efficient by using metadata, e.g., VCS to storage node mapping, storage group to VCS mapping, VCS to objects mapping, which eliminates resource intensive read and write operations during recovery.

公开(公告)号：US10691366B2

公开(公告)日：2020-06-23

申请号：US16004340

申请日：2018-06-08

Applicant: NetApp, Inc.

Inventor： Ajay Bakre ,  Vishnu Vardhan Chandra Kumaran ,  Alvin Lam ,  Emalayan Vairavanathan ,  Viswanath Chandrasekara Bharathi ,  Vladimir Avram ,  Dheeraj Raghavender Sangamkar ,  Oliver Seiler ,  Carmen Lum

IPC: G11C29/00 ,  G06F3/06 ,  G06F11/10

Abstract: A storage management computing device obtains an information lifecycle management (ILM) policy based on a query from a storage node ingesting an object into a distributed storage system. A hierarchical data protection plan comprising protection schemes at different layers of the distributed storage system is determined. A data protection scheme to be applied at a storage node computing device level is determined and a plurality of storage node computing devices are identified based on the hierarchical data protection plan. The storage management computing device instructs the ingesting storage node to store the object into the distributed storage system according to the hierarchical data protection plan.

公开(公告)号：US20200278913A1

公开(公告)日：2020-09-03

申请号：US16878220

申请日：2020-05-19

Applicant: NetApp, Inc.

Inventor： Ajay Bakre ,  Vishnu Vardhan Chandra Kumaran ,  Alvin Lam ,  Emalayan Vairavanathan ,  Viswanath Chandrasekara Bharathi ,  Vladimir Avram ,  Dheeraj Raghavender Sangamkar ,  Oliver Seiler ,  Carmen Lum

IPC: G06F11/20 ,  G06F11/10 ,  H03M13/15 ,  H03M13/37

Abstract: A storage management computing device obtains an information lifecycle management (ILM) policy. A data protection scheme to be applied at a storage node computing device level is determined and a plurality of storage node computing devices are identified based on an application of the ILM policy to metadata received from one of the storage node computing devices and associated with an object ingested by the one of the storage node computing devices. The one of the storage node computing devices is instructed to generate one or more copies of the object or fragments of the object according to the data protection scheme and to distribute the object copies or one of the object fragments to one or more other of the storage node computing devices to be stored by at least the one or more other storage node computing devices on one or more disk storage devices.

公开(公告)号：US10152377B2

公开(公告)日：2018-12-11

申请号：US15890913

申请日：2018-02-07

Applicant: NetApp, Inc.

Inventor： Dheeraj Raghavender Sangamkar ,  Ajay Bakre ,  Vladimir Radu Avram ,  Emalayan Vairavanathan ,  Viswanath Chandrasekara Bharathi

IPC: G06F11/10 ,  G06F11/14 ,  G06F3/12 ,  G06F3/06 ,  H04L29/08

Abstract: Technology is disclosed for storing data in a distributed storage system using a virtual chunk service (VCS). In the VCS based storage technique, a storage node (“node”) is split into multiple VCSs and each of the VCSs can be assigned a unique ID in the distributed storage. A set of VCSs from a set of nodes form a storage group, which also can be assigned a unique ID in the distributed storage. When a data object is received for storage, a storage group is identified for the data object, the data object is encoded to generate multiple fragments and each fragment is stored in a VCS of the identified storage group. The data recovery process is made more efficient by using metadata, e.g., VCS to storage node mapping, storage group to VCS mapping, VCS to objects mapping, which eliminates resource intensive read and write operations during recovery.