公开(公告)号：US12124716B2

公开(公告)日：2024-10-22

申请号：US18357206

申请日：2023-07-24

Applicant: NetApp Inc.

Inventor： Ganga Bhavani Kondapalli ,  Kevin Daniel Varghese ,  Ananthan Subramanian ,  Cheryl Marie Thompson ,  Anil Paul Thoppil

IPC: G06F3/06

CPC classification number: G06F3/0631 ,  G06F3/061 ,  G06F3/0665 ,  G06F3/067

Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

公开(公告)号：US11934262B2

公开(公告)日：2024-03-19

申请号：US18165077

申请日：2023-02-06

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F3/06 ,  G06F12/08 ,  G06F16/178

CPC classification number: G06F11/1004 ,  G06F3/0619 ,  G06F12/08 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US20240061603A1

公开(公告)日：2024-02-22

申请号：US18497925

申请日：2023-10-30

Applicant: NetApp, Inc.

Inventor： Kevin Daniel Varghese ,  Ananthan Subramanian ,  Parag Sarfare ,  Sandeep Yadav ,  Suhas Urkude ,  Rajesh Khandelwal

IPC: G06F3/06

CPC classification number: G06F3/0644 ,  G06F3/064 ,  G06F3/067 ,  G06F3/0613 ,  G06F3/0623 ,  G06F3/0659

Abstract: Methods and systems for co-locating journaling and data storage are provided. Separate journal and volume partitions may be maintained within each logical storage unit (e.g., Logical Unit Number (LUN)) of a distributed storage system. Journaling of metadata associated with write requests received from one or more clients may be distributed by identifying a destination logical storage unit to which data associated with a given write request is to be stored and causing the data and metadata to be persisted to disk by journaling the metadata and the data to respective portions of an active log within the journal partition of the destination logical storage unit. By using the same logical storage unit for both journaling of write requests and writing the data associated with such write requests, the bottleneck due to there being only a single device or storage unit handling all metadata for all write requests can be avoided.

公开(公告)号：US11861198B2

公开(公告)日：2024-01-02

申请号：US17728441

申请日：2022-04-25

Applicant: NetApp Inc.

Inventor： Kevin Daniel Varghese ,  Ananthan Subramanian ,  Asif Imtiyaz Pathan

IPC: G06F3/06

CPC classification number: G06F3/064 ,  G06F3/067 ,  G06F3/0619 ,  G06F3/0656 ,  G06F3/0659

Abstract: Techniques are provided for journal replay optimization. A distributed storage architecture can implement a journal within memory for logging write operations into log records. Latency of executing the write operations is improved because the write operations can be responded back to clients as complete once logged within the journal without having to store the data to higher latency disk storage. If there is a failure, then a replay process is performed to replay the write operations logged within the journal in order to bring a file system up-to-date. The time to complete the replay of the write operations is significantly reduced by caching metadata (e.g., indirect blocks, checksums, buftree identifiers, file block numbers, and consistency point counts) directly into log records. Replay can quickly access this metadata for replaying the write operations because the metadata does not need to be retrieved from the higher latency disk storage into memory.

公开(公告)号：US11816093B2

公开(公告)日：2023-11-14

申请号：US17536363

申请日：2021-11-29

Applicant: NetApp Inc.

Inventor： Kayuri Hasmukh Patel ,  Qinghua Zheng ,  Sumith Makam ,  Kevin Daniel Varghese ,  Yuvraj Ajaykumar Patel ,  Sateesh Kumar Pola ,  Sharmi Suresh Kumar Nair ,  Mihir Gorecha

IPC: G06F16/23 ,  G06F16/13 ,  G06F16/14

CPC classification number: G06F16/2365 ,  G06F16/13 ,  G06F16/148

Abstract: Techniques are provided for storage tier verification checks. A determination is made that a mount operation of an aggregate of a set of volumes stored within a multi-tier storage environment has completed. A first metafile and a second metafile are maintained to track information related to the storage of objects of a volume of the aggregate within a remote object store that is a tier of the multi-tier storage environment. A distributed verification is performed between the first metafile and the second metafile to identify an inconsistency. Accordingly, the first metafile and the second metafile are reconciled to address the inconsistency so that storage information within the first metafile and the second metafile are consistent.

公开(公告)号：US11573855B2

公开(公告)日：2023-02-07

申请号：US17582221

申请日：2022-01-24

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F12/08 ,  G06F3/06 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US11354049B2

公开(公告)日：2022-06-07

申请号：US16679914

申请日：2019-11-11

Applicant: NetApp Inc.

Inventor： Ganga Bhavani Kondapalli ,  Kevin Daniel Varghese ,  Ananthan Subramanian ,  Cheryl Marie Thompson ,  Anil Paul Thoppil

IPC: G06F3/06

Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

公开(公告)号：US20220083535A1

公开(公告)日：2022-03-17

申请号：US17536363

申请日：2021-11-29

Applicant: NetApp Inc.

Inventor： Kayuri Hasmukh Patel ,  Qinghua Zheng ,  Sumith Makam ,  Kevin Daniel Varghese ,  Yuvraj Ajaykumar Patel ,  Sateesh Kumar Pola ,  Sharmi Suresh Kumar Nair ,  Mihir Gorecha

IPC: G06F16/23 ,  G06F16/13 ,  G06F16/14

Abstract: Techniques are provided for storage tier verification checks. A determination is made that a mount operation of an aggregate of a set of volumes stored within a multi-tier storage environment has completed. A first metafile and a second metafile are maintained to track information related to the storage of objects of a volume of the aggregate within a remote object store that is a tier of the multi-tier storage environment. A distributed verification is performed between the first metafile and the second metafile to identify an inconsistency. Accordingly, the first metafile and the second metafile are reconciled to address the inconsistency so that storage information within the first metafile and the second metafile are consistent.

公开(公告)号：US20210089387A1

公开(公告)日：2021-03-25

申请号：US17100905

申请日：2020-11-22

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F12/08 ,  G06F3/06 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US20180314449A1

公开(公告)日：2018-11-01

申请号：US15581369

申请日：2017-04-28

Applicant: NetApp Inc.

Inventor： Ganga Bhavani Kondapalli ,  Kevin Daniel Varghese ,  Ananthan Subramanian ,  Cheryl Marie Thompson ,  Anil Paul Thoppil

IPC: G06F3/06

Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.