-
公开(公告)号:US20220300178A1
公开(公告)日:2022-09-22
申请号:US17833046
申请日:2022-06-06
申请人: NetApp Inc.
发明人: Ganga Bhavani Kondapalli , Kevin Daniel Varghese , Ananthan Subramanian , Cheryl Marie Thompson , Anil Paul Thoppil
IPC分类号: G06F3/06
摘要: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.
-
公开(公告)号:US20240232168A1
公开(公告)日:2024-07-11
申请号:US18507959
申请日:2023-11-13
申请人: NetApp Inc.
发明人: Kayuri Hasmukh Patel , Qinghua Zheng , Sumith Makam , Kevin Daniel Varghese , Yuvraj Ajaykumar Patel , Sateesh Kumar Pola , Sharmi Suresh Kumar Nair , Mihir Gorecha
CPC分类号: G06F16/2365 , G06F16/13 , G06F16/148
摘要: Techniques are provided for storage tier verification checks. A determination is made that a mount operation of an aggregate of a set of volumes stored within a multi-tier storage environment has completed. A first metafile and a second metafile are maintained to track information related to the storage of objects of a volume of the aggregate within a remote object store that is a tier of the multi-tier storage environment. A distributed verification is performed between the first metafile and the second metafile to identify an inconsistency. Accordingly, the first metafile and the second metafile are reconciled to address the inconsistency so that storage information within the first metafile and the second metafile are consistent.
-
公开(公告)号:US11409457B1
公开(公告)日:2022-08-09
申请号:US17239189
申请日:2021-04-23
申请人: NetApp, Inc.
发明人: Kevin Daniel Varghese , Ananthan Subramanian , Parag Sarfare , Sandeep Yadav , Suhas Urkude , Rajesh Khandelwal
IPC分类号: G06F3/06
摘要: A method and system for co-locating journaling and data storage based on write requests. A write request that includes metadata and data is received from a client. A logical storage unit for storing the metadata and the data is identified. The logical storage unit is divided into a journal partition and a volume partition. The journal partition includes a first log and a second log. Which of the first log and the second log is an active log and which of the first log and the second log is an inactive log are identified. The metadata is recorded in a first location in the active log and the data is recorded in a second location in the active log during a single I/O operation. A reply is sent to the client after the metadata and the data are recorded in the journal partition.
-
公开(公告)号:US11188520B2
公开(公告)日:2021-11-30
申请号:US16806379
申请日:2020-03-02
申请人: NetApp Inc.
发明人: Kayuri Hasmukh Patel , Qinghua Zheng , Sumith Makam , Kevin Daniel Varghese , Yuvraj Ajaykumar Patel , Sateesh Kumar Pola , Sharmi Suresh Kumar Nair , Mihir Gorecha
摘要: Techniques are provided for storage tier verification checks. A determination is made that a mount operation of an aggregate of a set of volumes stored within a multi-tier storage environment has completed. A first metafile and a second metafile are maintained to track information related to the storage of objects of a volume of the aggregate within a remote object store that is a tier of the multi-tier storage environment. A distributed verification is performed between the first metafile and the second metafile to identify an inconsistency. Accordingly, the first metafile and the second metafile are reconciled to address the inconsistency so that storage information within the first metafile and the second metafile are consistent.
-
公开(公告)号:US10360099B2
公开(公告)日:2019-07-23
申请号:US15581531
申请日:2017-04-28
申请人: NetApp Inc.
发明人: Ananthan Subramanian , Ganga Bhavani Kondapalli , Cheryl Marie Thompson , Kevin Daniel Varghese , Anil Paul Thoppil , Qinghua Zheng
IPC分类号: G06F11/10 , G06F12/08 , G06F3/06 , G06F16/178
摘要: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.
-
公开(公告)号:US20180314725A1
公开(公告)日:2018-11-01
申请号:US15581531
申请日:2017-04-28
申请人: NetApp Inc.
发明人: Ananthan Subramanian , Ganga Bhavani Kondapalli , Cheryl Marie Thompson , Kevin Daniel Varghese , Anil Paul Thoppil , Qinghua Zheng
CPC分类号: G06F11/1004 , G06F3/0619 , G06F12/08 , G06F16/178
摘要: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.
-
公开(公告)号:US09798496B2
公开(公告)日:2017-10-24
申请号:US14995001
申请日:2016-01-13
申请人: NETAPP, INC.
CPC分类号: G06F3/0661 , G06F3/0608 , G06F3/0611 , G06F3/0659 , G06F3/067 , G06F3/0688 , G06F3/0689 , H04L67/1097
摘要: Methods and systems for a networked system are provided. One method includes generating an object by a processor for storing a plurality of data chunks at a storage device, where the object includes a header segment and a data segment, the header segment providing a first offset address where an uncompressed data chunk is stored within the object and a second offset address of the object indicating a beginning of a compressed group having compressed data chunks and providing an indicator of a compression group size; reading the header segment by the processor to retrieve the second offset and the compressed group size in response to a first request for a data chunk within the compressed group; and decompressing the data chunk of the compressed group by the processor and providing the uncompressed data chunk for completing the first read request.
-
公开(公告)号:US12124716B2
公开(公告)日:2024-10-22
申请号:US18357206
申请日:2023-07-24
申请人: NetApp Inc.
发明人: Ganga Bhavani Kondapalli , Kevin Daniel Varghese , Ananthan Subramanian , Cheryl Marie Thompson , Anil Paul Thoppil
IPC分类号: G06F3/06
CPC分类号: G06F3/0631 , G06F3/061 , G06F3/0665 , G06F3/067
摘要: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.
-
公开(公告)号:US11934262B2
公开(公告)日:2024-03-19
申请号:US18165077
申请日:2023-02-06
申请人: NetApp Inc.
发明人: Ananthan Subramanian , Ganga Bhavani Kondapalli , Cheryl Marie Thompson , Kevin Daniel Varghese , Anil Paul Thoppil , Qinghua Zheng
IPC分类号: G06F11/10 , G06F3/06 , G06F12/08 , G06F16/178
CPC分类号: G06F11/1004 , G06F3/0619 , G06F12/08 , G06F16/178
摘要: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.
-
公开(公告)号:US20240061603A1
公开(公告)日:2024-02-22
申请号:US18497925
申请日:2023-10-30
申请人: NetApp, Inc.
发明人: Kevin Daniel Varghese , Ananthan Subramanian , Parag Sarfare , Sandeep Yadav , Suhas Urkude , Rajesh Khandelwal
IPC分类号: G06F3/06
CPC分类号: G06F3/0644 , G06F3/064 , G06F3/067 , G06F3/0613 , G06F3/0623 , G06F3/0659
摘要: Methods and systems for co-locating journaling and data storage are provided. Separate journal and volume partitions may be maintained within each logical storage unit (e.g., Logical Unit Number (LUN)) of a distributed storage system. Journaling of metadata associated with write requests received from one or more clients may be distributed by identifying a destination logical storage unit to which data associated with a given write request is to be stored and causing the data and metadata to be persisted to disk by journaling the metadata and the data to respective portions of an active log within the journal partition of the destination logical storage unit. By using the same logical storage unit for both journaling of write requests and writing the data associated with such write requests, the bottleneck due to there being only a single device or storage unit handling all metadata for all write requests can be avoided.
-
-
-
-
-
-
-
-
-