公开(公告)号：US20240143210A1

公开(公告)日：2024-05-02

申请号：US18399555

申请日：2023-12-28

Applicant: NetApp Inc.

Inventor： Kevin Daniel Varghese ,  Ananthan Subramanian ,  Asif Imtiyaz Pathan

IPC: G06F3/06

CPC classification number: G06F3/064 ,  G06F3/0619 ,  G06F3/0656 ,  G06F3/0659 ,  G06F3/067

Abstract: Techniques are provided for journal replay optimization. A distributed storage architecture can implement a journal within memory for logging write operations into log records. Latency of executing the write operations is improved because the write operations can be responded back to clients as complete once logged within the journal without having to store the data to higher latency disk storage. If there is a failure, then a replay process is performed to replay the write operations logged within the journal in order to bring a file system up-to-date. The time to complete the replay of the write operations is significantly reduced by caching metadata (e.g., indirect blocks, checksums, buftree identifiers, file block numbers, and consistency point counts) directly into log records. Replay can quickly access this metadata for replaying the write operations because the metadata does not need to be retrieved from the higher latency disk storage into memory.

公开(公告)号：US11971859B2

公开(公告)日：2024-04-30

申请号：US17732046

申请日：2022-04-28

Applicant: NetApp Inc.

Inventor： Anil Paul Thoppil ,  Wei Sun ,  Meera Odugoudar ,  Szu-Wen Kuo ,  Santhosh Selvaraj

IPC: G06F16/17 ,  G06F16/174 ,  G06F16/182

CPC classification number: G06F16/1748 ,  G06F16/182

Abstract: Techniques are provided for implementing a defragmentation process during a merge operation performed by a re-compaction process upon a log structured merge tree. The log structured merge tree is used to store keys of key-value pairs within a key-value store. As the log structured merge tree fills with keys over time, the re-compaction process is performed to merge keys down to lower levels of the log structured merge tree to re-compact the keys. Re-compaction can result in fragmentation because there is a lack of spatial locality of where the re-compaction operations re-writes the keys within storage. Fragmentation increases read and write amplification when accessing the keys stored in different locations within the storage. Accordingly, the defragmentation process is performed during a last merge operation of the re-compaction process in order to store keys together within the storage, thus reducing read and write amplification when accessing the keys.

公开(公告)号：US20240134759A1

公开(公告)日：2024-04-25

申请号：US18540196

申请日：2023-12-14

Applicant: NetApp Inc.

Inventor： Abhishek Naidu ,  Jose Mathew ,  Ling Zheng ,  Ravindra Kuramkote

IPC: G06F11/14 ,  G06F3/06 ,  G06F9/455

CPC classification number: G06F11/1469 ,  G06F3/0619 ,  G06F3/065 ,  G06F3/0664 ,  G06F3/0673 ,  G06F9/45558 ,  G06F11/1451 ,  G06F11/1458 ,  G06F11/1464 ,  G06F11/1484 ,  G06F2009/45562 ,  G06F2009/45575 ,  G06F2201/80 ,  G06F2201/815 ,  G06F2201/84

Abstract: Techniques are provided for backing up virtual machines from a computing environment to a storage environment. A virtual machine agent is utilized to generate a snapshot of the virtual machine. Metadata comprising a snapshot identifier of the snapshot and virtual disk information of virtual disks captured by snapshot is generated at the computing environment. The metadata is retrieved and used to create a metafile that is transferred to the storage environment within which snapshots of the virtual machine are to be stored. The snapshot is retrieved from the computing environment and is packaged into a snapshot package having a protocol format used by the storage environment. The snapshot package is transferred to the storage environment.

公开(公告)号：US11966611B2

公开(公告)日：2024-04-23

申请号：US18332304

申请日：2023-06-09

Applicant: NetApp, Inc.

Inventor： Rohit Shankar Singh ,  Douglas P. Doucette ,  Abhijeet Prakash Gole ,  Sushilkumar Gangadharan

IPC: G06F3/00 ,  G06F3/06

CPC classification number: G06F3/0644 ,  G06F3/0604 ,  G06F3/0659 ,  G06F3/0689

Abstract: The disclosed technology relates determining a first subset of a plurality drives having a first zone size and a second subset of the plurality of drives having a second zone size different from the first zone size, within a redundant array of independent disks (RAID) group. A prevailing zone size between the first zone size and the second zone size is determined. One or more logical zones within the determined first subset of the plurality of drives and the determined second subset of the plurality of drives for a received input-output operation is reserved based on the determined prevailing zone size. The received input-output operation is completed within the reserved one or more logical zones within the determined first subset of the plurality of drives and the determined second subset of the plurality of drives.

公开(公告)号：US11966307B2

公开(公告)日：2024-04-23

申请号：US17751410

申请日：2022-05-23

Applicant: NetApp, Inc.

Inventor： Murali Subramanian ,  Sohan Shetty ,  Akhil Kaushik

IPC: G06F11/20 ,  H04L67/1097

CPC classification number: G06F11/2069 ,  G06F11/2092 ,  G06F2201/85 ,  H04L67/1097

Abstract: Systems and methods for re-aligning data replication configuration of a cross-site storage solution after a failover are provided. According to one embodiment, after a failover, the new primary distributed storage system orchestrates flipping of the data replication configuration of a peered consistency group (CG) to reestablish zero RPO and zero RTO protections for the peered CG. The primary causes the secondary distributed storage system to perform an atomic database operation on its remote configuration database to (i) delete an existing source configuration that identifies the secondary as a source of data replication; and (ii) persist a new destination configuration identifying the secondary as a destination of data replication. Then, the primary performs an atomic database operation on its local configuration database to (i) delete an existing destination configuration identifying the primary as the destination; and (ii) persist a new source configuration identifying the distributed storage system as the source.

公开(公告)号：US20240126766A1

公开(公告)日：2024-04-18

申请号：US18464378

申请日：2023-09-11

Applicant: NetApp Inc.

Inventor： Sharankumar Yelheri ,  Atul Ramesh Pandit ,  Tijin George

IPC: G06F16/2457 ,  G06F11/14 ,  G06F16/21 ,  G06F16/22 ,  G06F16/28

CPC classification number: G06F16/24573 ,  G06F11/1448 ,  G06F16/219 ,  G06F16/2246 ,  G06F16/289

Abstract: Techniques are provided for on-demand creation and/or utilization of containers and/or serverless threads for hosting data connector components. The data connector components can be used to perform integrity checking, anomaly detection, and file system metadata analysis associated with objects stored within an object store. The data connector components may be configured to execute machine learning functionality to perform operations and tasks. The data connector components can perform full scans or incremental scans. The data connector components may be stateless, and thus may be offlined, upgraded, onlined, and/or have tasks transferred between data connector components. Results of operations performed by the data connector components upon base objects may be stored within sibling objects.

公开(公告)号：US20240104061A1

公开(公告)日：2024-03-28

申请号：US18527634

申请日：2023-12-04

Applicant: NetApp Inc.

Inventor： Devang Kundanlal Shah ,  Dipankar Roy ,  Krishnaveni Budati ,  Kai Tan ,  Pranab Patnaik ,  Akhil Kaushik

IPC: G06F16/178 ,  G06F3/06 ,  G06F16/11

CPC classification number: G06F16/178 ,  G06F3/0604 ,  G06F3/0605 ,  G06F3/065 ,  G06F3/0655 ,  G06F3/0665 ,  G06F3/067 ,  G06F3/0679 ,  G06F16/122 ,  G06F16/128

Abstract: One or more techniques and/or computing devices are provided for managing an arbitrary set of storage items using a granset. For example, a storage controller may host a plurality of storage items and/or logical unit numbers (LUNs). A subset of the storage items are grouped into a consistency group. A granset is created for tracking, managing, and/or providing access to the storage items within the consistency group. For example, the granset comprises application programming interfaces (APIs) and/or properties used to provide certain levels of access to the storage items (e.g., read access, write access, no access), redirect operations to access either data of an active file system or to a snapshot, fence certain operations (e.g., rename and delete operations), and/or other properties that apply to each storage item within the consistency group. Thus, the granset provides a persistent on-disk layout used to manage an arbitrary set of storage items.

公开(公告)号：US20240103771A1

公开(公告)日：2024-03-28

申请号：US18522756

申请日：2023-11-29

Applicant: NetApp, Inc.

Inventor： Mrinal K. Bhattacharjee ,  Shivali Gupta ,  Neha Saini

IPC: G06F3/06

CPC classification number: G06F3/0664 ,  G06F3/0613 ,  G06F3/0631 ,  G06F3/064 ,  G06F3/067

Abstract: Systems and methods are provided for sharing ephemeral storage of a virtual machine (VM) for use as victim caches for virtual storage appliances running on the VM. According to one embodiment, a central service may run within the VM and be responsible for managing allocation and reclamation of ephemeral storage space of the VM to/from the virtual storage appliances. Responsive to startup of a new virtual storage appliance on the VM, the new virtual storage appliance may request space from the central service to inform creation of its victim cache. In connection with servicing the request, the central service may take into consideration various factors including one or more of the total aggregate size of multiple local ephemeral drives associated with the VM, remaining available ephemeral storage space, the number of active virtual storage appliances, and the SLO of the virtual storage appliance seeking to establish its victim cache.

公开(公告)号：US11934670B2

公开(公告)日：2024-03-19

申请号：US17219759

申请日：2021-03-31

Applicant: NetApp, Inc.

Inventor： Murali Subramanian ,  Akhil Kaushik ,  Anoop Vijayan ,  Omprakash Khandelwal ,  Arun Kumar Selvam

IPC: G06F3/06

CPC classification number: G06F3/0631 ,  G06F3/0604 ,  G06F3/067

Abstract: Systems and methods are described for efficiently performing various operations at the granularity of a consistency group (CG) within a cross-site storage solution. An example of one of the various operations includes an independent and parallel resynchronization approach that independently brings individual volumes of a CG to a steady state of in-synchronization (InSync), thereby contributing to scalability of CGs by supporting CGs having a large number of member volumes without requiring a change to the resynchronization process. Another example includes preserving dependent write-order consistency when a remote mirror copy goes out-of-synchronization (OOS) for any reason by driving all member volumes OOS responsive to any member volume becoming OOS. Yet another example includes independent creation of snapshots by member volumes to support efficient and on-demand creation by an application of a common snapshots of all or a subset of peered member volumes of a CG with which the application is associated.

公开(公告)号：US11934656B2

公开(公告)日：2024-03-19

申请号：US17717454

申请日：2022-04-11

Applicant: NetApp Inc.

Inventor： Manan Dahyabhai Patel ,  Wei Sun

IPC: G06F3/06

CPC classification number: G06F3/0608 ,  G06F3/0652 ,  G06F3/067

Abstract: Techniques are provided for implementing garbage collection and bin synchronization for a distributed storage architecture of worker nodes managing distributed storage composed of bins of blocks. As the distributed storage architecture scales out to accommodate more storage and worker nodes, garbage collection used to free unused blocks becomes unmanageable and slow. Accordingly garbage collection is improved by utilizing heuristics to dynamically speed up or down garbage collection and set sizes for subsets of a bin to process instead of the entire bin. This ensures that garbage collection does not use stale information about what blocks are in-use, and ensures garbage collection does not unduly impact client I/O processing or conversely falls behind on garbage collection. Garbage collection can be incorporated into a bin sync process to improve the efficiency of the bin sync process so that unused blocks are not needlessly copied by the bin sync process.