公开(公告)号：US11934262B2

公开(公告)日：2024-03-19

申请号：US18165077

申请日：2023-02-06

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F3/06 ,  G06F12/08 ,  G06F16/178

CPC classification number: G06F11/1004 ,  G06F3/0619 ,  G06F12/08 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US11835990B2

公开(公告)日：2023-12-05

申请号：US17680653

申请日：2022-02-25

Applicant: NetApp, Inc.

Inventor： Wei Sun ,  Anil Paul Thoppil ,  Anne Maria Vasu

IPC: G06F11/07 ,  G06F11/16 ,  G06F16/27 ,  G06F11/10 ,  G06F11/30 ,  G06F3/06

CPC classification number: G06F11/1662 ,  G06F3/064 ,  G06F3/0622 ,  G06F3/0679 ,  G06F11/1088 ,  G06F11/3034 ,  G06F16/27

Abstract: Systems and methods that make use of cluster-level redundancy within a distributed storage management system to address various node-level error scenarios are provided. According to one embodiment, a KV store of a node of a cluster of a distributed storage management system manages storage of data blocks as values and corresponding block IDs as keys. Data integrity errors are reported to the first node in the form of a list of missing block IDs that are in use but missing from the KV store. A metadata resynchronization process may then be caused to be performed, including for each block ID in the list of missing block IDs: (i) reading a data block corresponding to the block ID from another node of the cluster that maintains redundant information relating to the block ID; and (ii) restoring the block ID within the KV store by writing the data block to the node.

公开(公告)号：US20230350810A1

公开(公告)日：2023-11-02

申请号：US17732098

申请日：2022-04-28

Applicant: NetApp Inc.

Inventor： Anil Paul Thoppil ,  Wei Sun ,  Meera Odugoudar ,  Szu-Wen Kuo ,  Santhosh Selvaraj

IPC: G06F12/1018

CPC classification number: G06F12/1018

Abstract: Techniques are provided for implementing a hash building process and an append hash building process. The hash building process builds in-memory hash entries for bins of keys stored within sorted logs of a log structured merge tree used to store keys of a key-value store. The in-memory hash entries can be used to identify the starting locations of bins of keys within the log structured merge tree so that a key within a bin can be searched for from the starting location of the bin as opposed to having to search the entire log structured merge tree. The append hash building process builds two hashes that can be used to more efficiently locate keys and/or ranges of keys within an unsorted append log that would otherwise require a time consuming binary search of the entire append log.

公开(公告)号：US20230289258A1

公开(公告)日：2023-09-14

申请号：US18165077

申请日：2023-02-06

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Danil Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F12/08 ,  G06F3/06 ,  G06F16/178

CPC classification number: G06F11/1004 ,  G06F3/0619 ,  G06F12/08 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US11573855B2

公开(公告)日：2023-02-07

申请号：US17582221

申请日：2022-01-24

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F12/08 ,  G06F3/06 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US11354049B2

公开(公告)日：2022-06-07

申请号：US16679914

申请日：2019-11-11

Applicant: NetApp Inc.

Inventor： Ganga Bhavani Kondapalli ,  Kevin Daniel Varghese ,  Ananthan Subramanian ,  Cheryl Marie Thompson ,  Anil Paul Thoppil

IPC: G06F3/06

Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

公开(公告)号：US11048430B2

公开(公告)日：2021-06-29

申请号：US16382344

申请日：2019-04-12

Applicant: NetApp Inc.

Inventor： Anil Paul Thoppil ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Jeevan Hunsur Eswara ,  Nicholas Gerald Zehender ,  Ronak Girishbhai Ghadiya ,  Sridevi Jantli

IPC: G06F3/06

Abstract: Techniques are provided for object store mirroring. Data within a storage tier of a node may be determined as being data to tier out to a primary object store based upon a property of the data. A first object is generated to comprise the data. A second object is generated to comprise the data. The first object is transmitted to the primary data store for storage in parallel with the second object being transmitted to a mirror object store for storage. Tiering of the data is designated as successful once acknowledgements are received from both the primary object that the first object was stored and the mirror object store that the second object was stored.

公开(公告)号：US20210089387A1

公开(公告)日：2021-03-25

申请号：US17100905

申请日：2020-11-22

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F12/08 ,  G06F3/06 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US20180314449A1

公开(公告)日：2018-11-01

申请号：US15581369

申请日：2017-04-28

Applicant: NetApp Inc.

Inventor： Ganga Bhavani Kondapalli ,  Kevin Daniel Varghese ,  Ananthan Subramanian ,  Cheryl Marie Thompson ,  Anil Paul Thoppil

IPC: G06F3/06

Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

公开(公告)号：US20250005003A1

公开(公告)日：2025-01-02

申请号：US18828077

申请日：2024-09-09

Applicant: NetApp, Inc.

Inventor： Ananthan Subramanian ,  Sridevi Jantli ,  Anil Paul Thoppil ,  Cheryl Marie Thompson ,  Qinghua Zheng

IPC: G06F16/215 ,  G06F16/22 ,  G06F16/23

Abstract: Techniques are provided for orphan object detection, invalid sequence number detection, and asynchronous object cleanup. A storage system may store data within one or more tiers of storage, such as a storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Orphan objects, within the remote object store, that are no longer used by the storage system may be detected and/or deleted. When an aggregate of volumes is deleted, corresponding objects, within the remote object store, may be identified and/or deleted. Invalid sequence numbers (e.g., lost or corrupt sequence numbers locally maintained in a metafile) assigned to objects within the remote object store may be identified, deleted, and/or fixed.