公开(公告)号：US20230289258A1

公开(公告)日：2023-09-14

申请号：US18165077

申请日：2023-02-06

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Danil Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F12/08 ,  G06F3/06 ,  G06F16/178

CPC classification number: G06F11/1004 ,  G06F3/0619 ,  G06F12/08 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US11573855B2

公开(公告)日：2023-02-07

申请号：US17582221

申请日：2022-01-24

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F12/08 ,  G06F3/06 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US11354049B2

公开(公告)日：2022-06-07

申请号：US16679914

申请日：2019-11-11

Applicant: NetApp Inc.

Inventor： Ganga Bhavani Kondapalli ,  Kevin Daniel Varghese ,  Ananthan Subramanian ,  Cheryl Marie Thompson ,  Anil Paul Thoppil

IPC: G06F3/06

Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

公开(公告)号：US11048430B2

公开(公告)日：2021-06-29

申请号：US16382344

申请日：2019-04-12

Applicant: NetApp Inc.

Inventor： Anil Paul Thoppil ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Jeevan Hunsur Eswara ,  Nicholas Gerald Zehender ,  Ronak Girishbhai Ghadiya ,  Sridevi Jantli

IPC: G06F3/06

Abstract: Techniques are provided for object store mirroring. Data within a storage tier of a node may be determined as being data to tier out to a primary object store based upon a property of the data. A first object is generated to comprise the data. A second object is generated to comprise the data. The first object is transmitted to the primary data store for storage in parallel with the second object being transmitted to a mirror object store for storage. Tiering of the data is designated as successful once acknowledgements are received from both the primary object that the first object was stored and the mirror object store that the second object was stored.

公开(公告)号：US20210089387A1

公开(公告)日：2021-03-25

申请号：US17100905

申请日：2020-11-22

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F12/08 ,  G06F3/06 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US20180314449A1

公开(公告)日：2018-11-01

申请号：US15581369

申请日：2017-04-28

Applicant: NetApp Inc.

Inventor： Ganga Bhavani Kondapalli ,  Kevin Daniel Varghese ,  Ananthan Subramanian ,  Cheryl Marie Thompson ,  Anil Paul Thoppil

IPC: G06F3/06

Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

公开(公告)号：US20240362124A1

公开(公告)日：2024-10-31

申请号：US18308337

申请日：2023-04-27

Applicant: NetApp Inc.

Inventor： Palak Sharma ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Venkateswarlu Tella

IPC: G06F11/14 ,  G06F16/215 ,  G06F16/25

CPC classification number: G06F11/1464 ,  G06F16/1744 ,  G06F16/184 ,  G06F16/215 ,  G06F16/258 ,  G06F2201/84

Abstract: Techniques are provided for mirroring objects between object stores hosted by cloud providers that have different data layout requirements. An object may be stored within a first object store that supports a fix offset format where uncompressed data is stored according to fixed offsets and boundaries within fixed size objects. A mirroring operation may be used to mirror the object to a second object store that supports a unified object format where compressed data can be stored at non-fixed offsets and boundaries within variable sized objects. The mirroring operation selects a compression algorithm and compresses the object on the fly to create a mirrored object having the unified object format. The mirrored object, populated with the compressed data and slot header metadata comprising compression information for how to locate and decompress the data in the mirrored object, is stored into the second object store.

公开(公告)号：US20240361944A1

公开(公告)日：2024-10-31

申请号：US18308704

申请日：2023-04-28

Applicant: NetApp Inc.

Inventor： Cheryl Marie Thompson ,  Garima Choudhary ,  Rajesh Sudarsan

IPC: G06F3/06

CPC classification number: G06F3/065 ,  G06F3/0619 ,  G06F3/0659 ,  G06F3/0673

Abstract: Techniques are provided for processing read operations while splitting a clone volume from a parent volume whose data is stored within objects of an object store. A transfer map is created to track mappings of child object identifiers to parent object identifiers of the parent objects to copy as child objects having the child object identifiers. The transfer map for the object store is traversed to copy the parent objects as the child objects for the split clone operation. The child objects are verified as being successfully created with valid data. In response to determining that the parent object has been copied as the child object, a context check is performed using the reverse map to verify a block within the child object. In response a successful context check, the read operation is processed using the block of the child object.

公开(公告)号：US20240012571A1

公开(公告)日：2024-01-11

申请号：US18357206

申请日：2023-07-24

Applicant: NetApp Inc.

Inventor： Ganga Bhavani Kondapalli ,  Kevin Daniel Varghese ,  Ananthan Subramanian ,  Cheryl Marie Thompson ,  Anil Paul Thoppil

IPC: G06F11/10 ,  G06F11/14 ,  G06F21/60

CPC classification number: G06F11/1076 ,  G06F11/1004 ,  G06F11/1435 ,  G06F21/602

Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

公开(公告)号：US20230333768A1

公开(公告)日：2023-10-19

申请号：US18186685

申请日：2023-03-20

Applicant: NetApp Inc.

Inventor： Anil Paul Thoppil ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Jeevan Hunsur Eswara ,  Nicholas Gerald Zehender ,  Ronak Girishbhai Ghadiya ,  Sridevi Jantli

IPC: G06F3/06

CPC classification number: G06F3/065 ,  G06F3/0685 ,  G06F3/0619 ,  G06F3/0644 ,  G06F3/0647 ,  G06F3/0652 ,  G06F3/0683 ,  G06F3/0617

Abstract: Techniques are provided for object store mirroring. Data within a storage tier of a node may be determined as being data to tier out to a primary object store based upon a property of the data. A first object is generated to comprise the data. A second object is generated to comprise the data. The first object is transmitted to the primary data store for storage in parallel with the second object being transmitted to a mirror object store for storage. Tiering of the data is designated as successful once acknowledgements are received from both the primary object that the first object was stored and the mirror object store that the second object was stored.