公开(公告)号：US20230135954A1

公开(公告)日：2023-05-04

申请号：US17731900

申请日：2022-04-28

Applicant: NetApp Inc.

Inventor： Palak Sharma ,  Dibyasri Nandi ,  Sindhushree K N ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Venkateswarlu Tella ,  Debanjan Paul ,  Dinakaran Narayanan

IPC: G06F3/06

Abstract: Techniques are provided for implementing a unified object format. The unified object format is used to format data in a performance tier (e.g., infrequently accessed data, snapshot data, etc.) into objects that are stored into an object store for low cost, scalable, long term storage compared to storage of the performance tier. With the unified object format, compression of the data may be retained when the data is stored as the objects into the object store. Additional compression may also be provided for the data in the objects. The unified object format includes slot header metadata used to track the location of the data within the object notwithstanding the data being compressed and/or stored at non-fixed boundaries. The slot header metadata may be cached at the performance tier for improved read performance and may be repaired by a repair subsystem (a slot header repair subsystem).

公开(公告)号：US20230135151A1

公开(公告)日：2023-05-04

申请号：US17731881

申请日：2022-04-28

Applicant: NetApp Inc.

Inventor： Palak Sharma ,  Dibyasri Nandi ,  K N Sindhushree ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Venkateswarlu Tella ,  Debanjan Paul ,  Dinakaran Narayanan

IPC: G06F3/06

Abstract: Techniques are provided for implementing a unified object format. The unified object format is used to format data in a performance tier (e.g., infrequently accessed data, snapshot data, etc.) into objects that are stored into an object store for low cost, scalable, long term storage compared to storage of the performance tier. With the unified object format, compression of the data may be retained when the data is stored as the objects into the object store. Additional compression may also be provided for the data in the objects. The unified object format includes slot header metadata used to track the location of the data within the object notwithstanding the data being compressed and/or stored at non-fixed boundaries. The slot header metadata may be cached at the performance tier for improved read performance and may be repaired by a repair subsystem (a slot header repair subsystem).

公开(公告)号：US20230133433A1

公开(公告)日：2023-05-04

申请号：US17731858

申请日：2022-04-28

Applicant: NetApp Inc.

Inventor： Palak Sharma ,  Dibyasri Nandi ,  Sindhushree K N ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Venkateswarlu Tella ,  Debanjan Paul ,  Dinakaran Narayanan

IPC: G06F16/174 ,  G06F11/14 ,  G06F16/11

Abstract: Techniques are provided for implementing a unified object format. The unified object format is used to format data in a performance tier (e.g., infrequently accessed data, snapshot data, etc.) into objects that are stored into an object store for low cost, scalable, long term storage compared to storage of the performance tier. With the unified object format, compression of the data may be retained when the data is stored as the objects into the object store. Additional compression may also be provided for the data in the objects. The unified object format includes slot header metadata used to track the location of the data within the object notwithstanding the data being compressed and/or stored at non-fixed boundaries. The slot header metadata may be cached at the performance tier for improved read performance and may be repaired by a repair subsystem (a slot header repair subsystem).

公开(公告)号：US11620071B2

公开(公告)日：2023-04-04

申请号：US17346316

申请日：2021-06-14

Applicant: NetApp Inc.

Inventor： Anil Paul Thoppil ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Jeevan Hunsur Eswara ,  Nicholas Gerald Zehender ,  Ronak Girishbhai Ghadiya ,  Sridevi Jantli

IPC: G06F3/06

Abstract: Techniques are provided for object store mirroring. Data within a storage tier of a node may be determined as being data to tier out to a primary object store based upon a property of the data. A first object is generated to comprise the data. A second object is generated to comprise the data. The first object is transmitted to the primary data store for storage in parallel with the second object being transmitted to a mirror object store for storage. Tiering of the data is designated as successful once acknowledgements are received from both the primary object that the first object was stored and the mirror object store that the second object was stored.

公开(公告)号：US20220147418A1

公开(公告)日：2022-05-12

申请号：US17582221

申请日：2022-01-24

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F12/08 ,  G06F3/06 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US11231989B2

公开(公告)日：2022-01-25

申请号：US17100905

申请日：2020-11-22

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F12/08 ,  G06F3/06 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US20200327141A1

公开(公告)日：2020-10-15

申请号：US16389019

申请日：2019-04-19

Applicant: NetApp Inc.

Inventor： Anil Paul Thoppil ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Jeevan Hunsur Eswara ,  Nicholas Gerald Zehender ,  Ronak Girishbhai Ghadiya ,  Sridevi Jantli

IPC: G06F16/27 ,  G06F16/215

Abstract: Techniques are provided for object store mirroring. Data within a storage tier of a node may be determined as being data to tier out to a primary object store based upon a property of the data. A first object is generated to comprise the data. A second object is generated to comprise the data. The first object is transmitted to the primary data store for storage in parallel with the second object being transmitted to a mirror object store for storage. Tiering of the data is designated as successful once acknowledgements are received from both the primary object that the first object was stored and the mirror object store that the second object was stored.

公开(公告)号：US20180365281A1

公开(公告)日：2018-12-20

申请号：US15624891

申请日：2017-06-16

Applicant: NetApp Inc.

Inventor： Kayuri Hasmukh Patel ,  Qinghua Zheng ,  Sumith Makam ,  Kevin Daniel Varghese ,  Yuvraj Ajaykumar Patel ,  Sateesh Kumar Pola ,  Sharmi Suresh Kumar Nair ,  Mihir Gorecha

IPC: G06F17/30

Abstract: Techniques are provided for storage tier verification checks. A determination is made that a mount operation of an aggregate of a set of volumes stored within a multi-tier storage environment has completed. A first metafile and a second metafile are maintained to track information related to the storage of objects of a volume of the aggregate within a remote object store that is a tier of the multi-tier storage environment. A distributed verification is performed between the first metafile and the second metafile to identify an inconsistency. Accordingly, the first metafile and the second metafile are reconciled to address the inconsistency so that storage information within the first metafile and the second metafile are consistent.