Abstract:
A method, non-transitory computer readable medium and storage server computing device that allocates monotonically increasing sequence numbers to storage operations based on an order of the storage operations corresponding entries in a log. The storage operations are sequenced including by identifying a subset of the storage operations that are parallelizable. A file system data structure is allocated and populated with data associated with one of the storage operations. A determination is made when a rollback is detected based on whether a replay ledger index field of the file system data structure comprises one of the sequence numbers that is greater than another one of the sequence number corresponding to the one of the storage operations. The another one of the sequence numbers is inserted into the replay ledger index field, when the determining indicates that a rollback is not detected.
Abstract:
Technology is disclosed for improving performance during playback of logged data storage operations. The technology can monitor a log to which data storage operations are written before data is committed to a volume; determine counts of various types of data storage operations; and when the counts exceed a specified threshold, cause the data storage operations to be committed to the volume. Some data storage operations can be coalesced during playback to further improve performance.
Abstract:
A method, device, and non-transitory computer readable medium for mirroring data, comprising, selecting, based on a plurality of data attributes, a portion of local data in a local storage device for mirroring to a remote storage device and copying the selected portion of the local data to at least one cache memory of the remote storage device. Next a determination of when a failover event has occurred in the local storage device is made, wherein the failover event comprises an event in which the local data in the local storage device is inaccessible to a client computing device when the client computing device attempts to access the local data from the local storage device. A copy of the local data from the cache memory in the remote storage device is retrieved when the failover event is determined to have occurred.
Abstract:
Technology is disclosed for improving performance during playback of logged data storage operations. The technology can monitor a log to which data storage operations are written before data is committed to a data storage device or a volume; determine counts of various types of data storage operations; and when the counts exceed a specified threshold, cause the data storage operations to be committed to the data storage device or the volume. Some data storage operations can be coalesced during playback to further improve performance.
Abstract:
A method, non-transitory computer readable medium, and source storage server computing device that mirrors dirty data to a destination storage server. The dirty data corresponds to storage operations not yet committed to one or more data storage devices of an aggregate to be transitioned. Ownership of the data storage devices is released. Teardown processing for the aggregate is performed subsequent to releasing ownership of the data storage devices. With this technology, the flushing or committing of dirty data to data storage devices is performed by a destination storage server after a data container is transitioned to the destination storage server. Additionally, non-critical teardown processing is also performed after a data container or aggregate is transitioned to the destination storage server. Accordingly, the duration of planned data container transitions can advantageously be reduced and aggregates can be brought online by a destination storage server for data access by applications more quickly.
Abstract:
Techniques for detecting data loss during site switchover are disclosed. An example method includes storing at NVRAM of a first node a plurality of operations of a second node, the first and second nodes being disaster recovery partners. The method also includes during a switchover from the second node to the first node, receiving an indication of a first number of operations yet to be completed. The method further includes comparing the first number to a second number of operations in the plurality of operations stored at the NVRAM of the first node. The method also includes in response to the comparing, determining whether at least one operation is missing from the plurality of operations stored in the NVRAM of the first node. The method further includes in response to determining that at least one operation is missing, failing at least one volume.
Abstract:
Methods, non-transitory computer readable media, and computing devices that execute a storage operation, without journaling the storage operation in a log, and withhold from a file system a list of freed inodes including an indication of an inode freed as a result of the execution of the storage operation. A consistency point operation is then initiated that retrieves storage operations logged as journal entries in the log and commits a result of each of the storage operations to data storage devices. A list of available inodes is updated based on the list of freed inodes, when the consistency point operation is determined to be complete. This technology reduces the number of storage operations that are required to be journaled to maintain consistency of a file system, thereby reducing the runtime resources required to facilitate the journaling and replay resource required to replay the storage operations following a recovery.
Abstract:
Methods, non-transitory computer readable media, and computing devices that execute a storage operation, without journaling the storage operation in a log, and withhold from a file system a list of freed inodes including an indication of an inode freed as a result of the execution of the storage operation. A consistency point operation is then initiated that retrieves storage operations logged as journal entries in the log and commits a result of each of the storage operations to data storage devices. A list of available inodes is updated based on the list of freed inodes, when the consistency point operation is determined to be complete. This technology reduces the number of storage operations that are required to be journaled to maintain consistency of a file system, thereby reducing the runtime resources required to facilitate the journaling and replay resource required to replay the storage operations following a recovery.
Abstract:
Technology is disclosed for improving performance during playback of logged data storage operations. The technology can monitor a log to which data storage operations are written before data is committed to a volume; determine counts of various types of data storage operations; and when the counts exceed a specified threshold, cause the data storage operations to be committed to the volume. Some data storage operations can be coalesced during playback to further improve performance.
Abstract:
A method, non-transitory computer readable medium, and source storage server computing device that mirrors dirty data to a destination storage server. The dirty data corresponds to storage operations not yet committed to one or more data storage devices of an aggregate to be transitioned. Ownership of the data storage devices is released. Teardown processing for the aggregate is performed subsequent to releasing ownership of the data storage devices. With this technology, the flushing or committing of dirty data to data storage devices is performed by a destination storage server after a data container is transitioned to the destination storage server. Additionally, non-critical teardown processing is also performed after a data container or aggregate is transitioned to the destination storage server. Accordingly, the duration of planned data container transitions can advantageously be reduced and aggregates can be brought online by a destination storage server for data access by applications more quickly.