公开(公告)号：US11740820B1

公开(公告)日：2023-08-29

申请号：US17742111

申请日：2022-05-11

Applicant: NETAPP, INC.

Inventor： Mathankumar Devarajan ,  Girish Hebbale Venkatasubbaiah ,  Venkateswarlu Tella ,  Dnyaneshwar Nagorao Pawar ,  Harsh Tiwari

IPC: G06F3/06

CPC classification number: G06F3/064 ,  G06F3/065 ,  G06F3/0607 ,  G06F3/067 ,  G06F3/0656

Abstract: Methods and systems for a storage environment are provided. One method includes identifying, by a processor, a plurality of block numbers of a fragmented address space for re-allocation, each block number associated with data stored by a file system in a storage device of a storage system; determining, by the processor, compressed data associated with a block number from among the plurality of block numbers; verifying, by the processor, that an indirect block of a hierarchical structure maintained by the file system references the block number associated with the compressed data; and copying, by the processor, the compressed data to a new block, without decompressing the data.

公开(公告)号：US20200081643A1

公开(公告)日：2020-03-12

申请号：US16683466

申请日：2019-11-14

Applicant: NetApp Inc.

Inventor： Alok Sharma ,  Girish Hebbale Venkata Subbaiah ,  Kartik Rathnakar ,  Venkateswarlu Tella ,  Mukul Sharma

IPC: G06F3/06

Abstract: Techniques are provided for asynchronous semi-inline deduplication. A multi-tiered storage arrangement comprises a first storage tier, a second storage tier, etc. An in-memory change log of data recently written to the first storage tier is evaluate to identify a fingerprint of a data block recently written to the first storage tier. A donor data store, comprising fingerprints of data blocks already stored within the first storage tier, is queried using the fingerprint. If the fingerprint is found, then deduplication is performed for the data block to create deduplicated data based upon a potential donor data block within the first storage tier. The deduplicated data is moved from the first storage tier to the second storage tier, such as in response to a determination that the deduplicated data has not been recently accessed. The deduplication is performed before cold data is moved from first storage tier to second storage tier.

公开(公告)号：US10585611B2

公开(公告)日：2020-03-10

申请号：US15138435

申请日：2016-04-26

Applicant: NetApp Inc.

Inventor： Mukul Sharma ,  Kartik Rathnakar ,  Dnyaneshwar Nagorao Pawar ,  Venkateswarlu Tella ,  Kiran Nenmeli Srinivasan ,  Rajesh Khandelwal ,  Alok Sharma

IPC: G06F3/06

Abstract: One or more techniques and/or computing devices are provided for inline deduplication. For example, a checksum hash table and/or a block number hash table may be maintained within memory (e.g., a storage controller may maintain the hash tables in-core). The checksum hash table may be utilized for inline deduplication to identify potential donor blocks that may comprise the same data as an incoming storage operation. Data within an in-core buffer cache is eligible as potential donor blocks so that inline deduplication may be performed using data from the in-core buffer cache, which may mitigate disk access to underlying storage for which the in-core buffer cache is used for caching. The block number hash table may be used for updating or removing entries from the hash tables, such as for blocks that are no longer eligible as potential donor blocks (e.g., deleted blocks, blocks evicted from the in-core buffer cache, etc.).

公开(公告)号：US10001942B1

公开(公告)日：2018-06-19

申请号：US15386544

申请日：2016-12-21

Applicant: NetApp Inc.

Inventor： Alok Sharma ,  Girish Hebbale Venkata Subbaiah ,  Kartik Rathnakar ,  Venkateswarlu Tella ,  Mukul Sharma

IPC: G06F3/06

Abstract: Techniques are provided for asynchronous semi-inline deduplication. A multi-tiered storage arrangement comprises a first storage tier, a second storage tier, etc. An in-memory change log of data recently written to the first storage tier is evaluate to identify a fingerprint of a data block recently written to the first storage tier. A donor data store, comprising fingerprints of data blocks already stored within the first storage tier, is queried using the fingerprint. If the fingerprint is found, then deduplication is performed for the data block to create deduplicated data based upon a potential donor data block within the first storage tier. The deduplicated data is moved from the first storage tier to the second storage tier, such as in response to a determination that the deduplicated data has not been recently accessed. The deduplication is performed before cold data is moved from first storage tier to second storage tier.

公开(公告)号：US20170308320A1

公开(公告)日：2017-10-26

申请号：US15138435

申请日：2016-04-26

Applicant: NetApp Inc.

Inventor： Mukul Sharma ,  Kartik Rathnakar ,  Dnyaneshwar Nagorao Pawar ,  Venkateswarlu Tella ,  Kiran Nenmeli Srinivasan ,  Rajesh Khandelwal ,  Alok Sharma

IPC: G06F3/06

CPC classification number: G06F3/0641 ,  G06F3/0605 ,  G06F3/0608 ,  G06F3/0659 ,  G06F3/0665 ,  G06F3/067 ,  G06F3/0679

Abstract: One or more techniques and/or computing devices are provided for inline deduplication. For example, a checksum hash table and/or a block number hash table may be maintained within memory (e.g., a storage controller may maintain the hash tables in-core). The checksum hash table may be utilized for inline deduplication to identify potential donor blocks that may comprise the same data as an incoming storage operation. Data within an in-core buffer cache is eligible as potential donor blocks so that inline deduplication may be performed using data from the in-core buffer cache, which may mitigate disk access to underlying storage for which the in-core buffer cache is used for caching. The block number hash table may be used for updating or removing entries from the hash tables, such as for blocks that are no longer eligible as potential donor blocks (e.g., deleted blocks, blocks evicted from the in-core buffer cache, etc.).

公开(公告)号：US12253923B2

公开(公告)日：2025-03-18

申请号：US17731881

申请日：2022-04-28

Applicant: NetApp Inc.

Inventor： Palak Sharma ,  Dibyasri Nandi ,  Sindhushree K N ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Venkateswarlu Tella ,  Debanjan Paul ,  Dinakaran Narayanan

IPC: G06F12/00 ,  G06F3/06 ,  G06F11/07 ,  G06F11/10 ,  G06F11/14 ,  G06F11/20 ,  G06F16/11 ,  G06F16/174

Abstract: Techniques are provided for implementing a unified object format. The unified object format is used to format data in a performance tier (e.g., infrequently accessed data, snapshot data, etc.) into objects that are stored into an object store for low cost, scalable, long term storage compared to storage of the performance tier. With the unified object format, compression of the data may be retained when the data is stored as the objects into the object store. Additional compression may also be provided for the data in the objects. The unified object format includes slot header metadata used to track the location of the data within the object notwithstanding the data being compressed and/or stored at non-fixed boundaries. The slot header metadata may be cached at the performance tier for improved read performance and may be repaired by a repair subsystem (a slot header repair subsystem).

公开(公告)号：US20230135954A1

公开(公告)日：2023-05-04

申请号：US17731900

申请日：2022-04-28

Applicant: NetApp Inc.

Inventor： Palak Sharma ,  Dibyasri Nandi ,  Sindhushree K N ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Venkateswarlu Tella ,  Debanjan Paul ,  Dinakaran Narayanan

IPC: G06F3/06

Abstract: Techniques are provided for implementing a unified object format. The unified object format is used to format data in a performance tier (e.g., infrequently accessed data, snapshot data, etc.) into objects that are stored into an object store for low cost, scalable, long term storage compared to storage of the performance tier. With the unified object format, compression of the data may be retained when the data is stored as the objects into the object store. Additional compression may also be provided for the data in the objects. The unified object format includes slot header metadata used to track the location of the data within the object notwithstanding the data being compressed and/or stored at non-fixed boundaries. The slot header metadata may be cached at the performance tier for improved read performance and may be repaired by a repair subsystem (a slot header repair subsystem).

公开(公告)号：US20230135151A1

公开(公告)日：2023-05-04

申请号：US17731881

申请日：2022-04-28

Applicant: NetApp Inc.

Inventor： Palak Sharma ,  Dibyasri Nandi ,  K N Sindhushree ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Venkateswarlu Tella ,  Debanjan Paul ,  Dinakaran Narayanan

IPC: G06F3/06

Abstract: Techniques are provided for implementing a unified object format. The unified object format is used to format data in a performance tier (e.g., infrequently accessed data, snapshot data, etc.) into objects that are stored into an object store for low cost, scalable, long term storage compared to storage of the performance tier. With the unified object format, compression of the data may be retained when the data is stored as the objects into the object store. Additional compression may also be provided for the data in the objects. The unified object format includes slot header metadata used to track the location of the data within the object notwithstanding the data being compressed and/or stored at non-fixed boundaries. The slot header metadata may be cached at the performance tier for improved read performance and may be repaired by a repair subsystem (a slot header repair subsystem).

公开(公告)号：US20230133433A1

公开(公告)日：2023-05-04

申请号：US17731858

申请日：2022-04-28

Applicant: NetApp Inc.

Inventor： Palak Sharma ,  Dibyasri Nandi ,  Sindhushree K N ,  Cheryl Marie Thompson ,  Qinghua Zheng ,  Venkateswarlu Tella ,  Debanjan Paul ,  Dinakaran Narayanan

IPC: G06F16/174 ,  G06F11/14 ,  G06F16/11

Abstract: Techniques are provided for implementing a unified object format. The unified object format is used to format data in a performance tier (e.g., infrequently accessed data, snapshot data, etc.) into objects that are stored into an object store for low cost, scalable, long term storage compared to storage of the performance tier. With the unified object format, compression of the data may be retained when the data is stored as the objects into the object store. Additional compression may also be provided for the data in the objects. The unified object format includes slot header metadata used to track the location of the data within the object notwithstanding the data being compressed and/or stored at non-fixed boundaries. The slot header metadata may be cached at the performance tier for improved read performance and may be repaired by a repair subsystem (a slot header repair subsystem).

公开(公告)号：US20210405882A1

公开(公告)日：2021-12-30

申请号：US17028020

申请日：2020-09-22

Applicant: NetApp Inc.

Inventor： Girish Hebbale Venkatasubbaiah ,  Rahul Thapliyal ,  Dnyaneshwar Nagorao Pawar ,  Kartik Rathnakar ,  Venkateswarlu Tella ,  Ananthan Subramanian

IPC: G06F3/06 ,  G06F16/215 ,  G06F16/25 ,  G06F16/28 ,  H03M7/30

Abstract: Techniques are provided for a layout format for compressed data. A first set of data blocks are grouped into a first group based upon a first frequency of access to the first set of data blocks. A second set of data blocks are grouped into a second group based upon a second frequency of access to the second set of data blocks. The first set of data blocks are compressed into a first compression group using a first compression algorithm. The second set of data blocks are compressed into a second compression group using a second compression algorithm.