-
1.
公开(公告)号:US20230350810A1
公开(公告)日:2023-11-02
申请号:US17732098
申请日:2022-04-28
Applicant: NetApp Inc.
Inventor: Anil Paul Thoppil , Wei Sun , Meera Odugoudar , Szu-Wen Kuo , Santhosh Selvaraj
IPC: G06F12/1018
CPC classification number: G06F12/1018
Abstract: Techniques are provided for implementing a hash building process and an append hash building process. The hash building process builds in-memory hash entries for bins of keys stored within sorted logs of a log structured merge tree used to store keys of a key-value store. The in-memory hash entries can be used to identify the starting locations of bins of keys within the log structured merge tree so that a key within a bin can be searched for from the starting location of the bin as opposed to having to search the entire log structured merge tree. The append hash building process builds two hashes that can be used to more efficiently locate keys and/or ranges of keys within an unsorted append log that would otherwise require a time consuming binary search of the entire append log.
-
公开(公告)号:US11971859B2
公开(公告)日:2024-04-30
申请号:US17732046
申请日:2022-04-28
Applicant: NetApp Inc.
Inventor: Anil Paul Thoppil , Wei Sun , Meera Odugoudar , Szu-Wen Kuo , Santhosh Selvaraj
IPC: G06F16/17 , G06F16/174 , G06F16/182
CPC classification number: G06F16/1748 , G06F16/182
Abstract: Techniques are provided for implementing a defragmentation process during a merge operation performed by a re-compaction process upon a log structured merge tree. The log structured merge tree is used to store keys of key-value pairs within a key-value store. As the log structured merge tree fills with keys over time, the re-compaction process is performed to merge keys down to lower levels of the log structured merge tree to re-compact the keys. Re-compaction can result in fragmentation because there is a lack of spatial locality of where the re-compaction operations re-writes the keys within storage. Fragmentation increases read and write amplification when accessing the keys stored in different locations within the storage. Accordingly, the defragmentation process is performed during a last merge operation of the re-compaction process in order to store keys together within the storage, thus reducing read and write amplification when accessing the keys.
-
公开(公告)号:US12265473B2
公开(公告)日:2025-04-01
申请号:US17732098
申请日:2022-04-28
Applicant: NetApp Inc.
Inventor: Anil Paul Thoppil , Wei Sun , Meera Odugoudar , Szu-Wen Kuo , Santhosh Selvaraj
IPC: G06F12/1018
Abstract: Techniques are provided for implementing a hash building process and an append hash building process. The hash building process builds in-memory hash entries for bins of keys stored within sorted logs of a log structured merge tree used to store keys of a key-value store. The in-memory hash entries can be used to identify the starting locations of bins of keys within the log structured merge tree so that a key within a bin can be searched for from the starting location of the bin as opposed to having to search the entire log structured merge tree. The append hash building process builds two hashes that can be used to more efficiently locate keys and/or ranges of keys within an unsorted append log that would otherwise require a time consuming binary search of the entire append log.
-
公开(公告)号:US12204800B2
公开(公告)日:2025-01-21
申请号:US17732065
申请日:2022-04-28
Applicant: NetApp Inc.
Inventor: Anil Paul Thoppil , Wei Sun , Meera Odugoudar , Szu-Wen Kuo , Santhosh Selvaraj
Abstract: Techniques are provided for implementing a garbage collection process and a prediction read ahead mechanism to prefetch keys into memory to improve the efficiency and speed of the garbage collection process. A log structured merge tree is used to store keys of key-value pairs within a key-value store. If a key is no longer referenced by any worker nodes of a distributed storage architecture, then the key can be freed to store other data. Accordingly, garbage collection is performed to identify and free unused keys. The speed and efficiency of garbage collection is improved by dynamically adjusting the amount and rate at which keys are prefetched from disk and cached into faster memory for processing by the garbage collection process.
-
公开(公告)号:US20240281411A1
公开(公告)日:2024-08-22
申请号:US18648989
申请日:2024-04-29
Applicant: NetApp, Inc.
Inventor: Anil Paul Thoppil , Wei Sun , Meera Odugoudar , Szu-Wen Kuo , Santhosh Selvaraj
IPC: G06F16/174 , G06F16/182
CPC classification number: G06F16/1748 , G06F16/182
Abstract: Techniques are provided for implementing a defragmentation process during a merge operation performed by a re-compaction process upon a log structured merge tree. The log structured merge tree is used to store keys of key-value pairs within a key-value store. As the log structured merge tree fills with keys over time, the re-compaction process is performed to merge keys down to lower levels of the log structured merge tree to re-compact the keys. Re-compaction can result in fragmentation because there is a lack of spatial locality of where the re-compaction operations re-writes the keys within storage. Fragmentation increases read and write amplification when accessing the keys stored in different locations within the storage. Accordingly, the defragmentation process is performed during a last merge operation of the re-compaction process in order to store keys together within the storage, thus reducing read and write amplification when accessing the keys.
-
公开(公告)号:US20240045848A1
公开(公告)日:2024-02-08
申请号:US18491940
申请日:2023-10-23
Applicant: NetApp Inc.
Inventor: Sanjay Subramanian Seshadri , Arindam Banerjee , Manan Dahyabhai Patel , Raymond Jordan Go , Anil Paul Thoppil , Ananthan Subramanian , Santhosh Selvaraj , Nikul Y. Patel , Vikhyath Rao , Meera Odugoudar , Kevin Daniel Varghese
IPC: G06F16/22 , G06F16/21 , G06F16/248 , G06F16/2457 , G06F16/2455 , G06F16/215
CPC classification number: G06F16/2246 , G06F16/217 , G06F16/248 , G06F16/24573 , G06F16/24553 , G06F16/215
Abstract: Techniques are provided for key-value store and file system integration to optimize key value store operations. A key-value store is integrated within a file system of a node. A log structured merge tree of the key-value store may be populated with a key corresponding to a content hash of a value data item stored separate from the key. A random distribution search may be performed upon a sorted log of the log structured merge tree to identify the key for accessing the value data item. A starting location for the random distribution search is derived from key information, a log size of the sorted log, and/or a keyspace size of a keyspace associated with the key.
-
公开(公告)号:US20230350850A1
公开(公告)日:2023-11-02
申请号:US17732046
申请日:2022-04-28
Applicant: NetApp Inc.
Inventor: Anil Paul Thoppil , Wei Sun , Meera Odugoudar , Szu-Wen Kuo , Santhosh Selvaraj
IPC: G06F3/06
CPC classification number: G06F3/0605 , G06F3/0685 , G06F3/0649
Abstract: Techniques are provided for implementing a defragmentation process during a merge operation performed by a re-compaction process upon a log structured merge tree. The log structured merge tree is used to store keys of key-value pairs within a key-value store. As the log structured merge tree fills with keys over time, the re-compaction process is performed to merge keys down to lower levels of the log structured merge tree to re-compact the keys. Re-compaction can result in fragmentation because there is a lack of spatial locality of where the re-compaction operations re-writes the keys within storage. Fragmentation increases read and write amplification when accessing the keys stored in different locations within the storage. Accordingly, the defragmentation process is performed during a last merge operation of the re-compaction process in order to store keys together within the storage, thus reducing read and write amplification when accessing the keys.
-
公开(公告)号:US20230350610A1
公开(公告)日:2023-11-02
申请号:US17732065
申请日:2022-04-28
Applicant: NetApp Inc.
Inventor: Anil Paul Thoppil , We Sun , Meera Odugoudar , Szu-Wen Kuo , Santhosh Selvaraj
IPC: G06F3/06
CPC classification number: G06F3/0652 , G06F3/0602 , G06F3/068
Abstract: Techniques are provided for implementing a garbage collection process and a prediction read ahead mechanism to prefetch keys into memory to improve the efficiency and speed of the garbage collection process. A log structured merge tree is used to store keys of key-value pairs within a key-value store. If a key is no longer referenced by any worker nodes of a distributed storage architecture, then the key can be freed to store other data. Accordingly, garbage collection is performed to identify and free unused keys. The speed and efficiency of garbage collection is improved by dynamically adjusting the amount and rate at which keys are prefetched from disk and cached into faster memory for processing by the garbage collection process.
-
公开(公告)号:US11797510B2
公开(公告)日:2023-10-24
申请号:US17234894
申请日:2021-04-20
Applicant: NetApp Inc.
Inventor: Sanjay Subramanian Seshadri , Arindam Banerjee , Manan Dahyabhai Patel , Raymond Jordan Go , Anil Paul Thoppil , Ananthan Subramanian , Santhosh Selvaraj , Nikul Y. Patel , Vikhyath Rao , Meera Odugoudar , Kevin Daniel Varghese
IPC: G06F16/22 , G06F16/21 , G06F16/248 , G06F16/2457 , G06F16/2455 , G06F16/215
CPC classification number: G06F16/2246 , G06F16/215 , G06F16/217 , G06F16/248 , G06F16/24553 , G06F16/24573
Abstract: Techniques are provided for key-value store and file system integration to optimize key value store operations. A key-value store is integrated within a file system of a node. A log structured merge tree of the key-value store may be populated with a key corresponding to a content hash of a value data item stored separate from the key. A random distribution search may be performed upon a sorted log of the log structured merge tree to identify the key for accessing the value data item. A starting location for the random distribution search is derived from key information, a log size of the sorted log, and/or a keyspace size of a keyspace associated with the key.
-
公开(公告)号:US20220335027A1
公开(公告)日:2022-10-20
申请号:US17234894
申请日:2021-04-20
Applicant: NetApp Inc.
Inventor: Sanjay Subramanian Seshadri , Arindam Banerjee , Manan Dahyabhai Patel , Raymond Jordan Go , Anil Paul Thoppil , Ananthan Subramanian , Santhosh Selvaraj , Nikul Y. Patel , Vikhyath Rao , Meera Odugoudar , Kevin Daniel Varghese
IPC: G06F16/22 , G06F16/21 , G06F16/215 , G06F16/2457 , G06F16/2455 , G06F16/248
Abstract: Techniques are provided for key-value store and file system integration to optimize key value store operations. A key-value store is integrated within a file system of a node. A log structured merge tree of the key-value store may be populated with a key corresponding to a content hash of a value data item stored separate from the key. A random distribution search may be performed upon a sorted log of the log structured merge tree to identify the key for accessing the value data item. A starting location for the random distribution search is derived from key information, a log size of the sorted log, and/or a keyspace size of a keyspace associated with the key.
-
-
-
-
-
-
-
-
-