摘要:
This invention is a system and a method for operating a storage server to provide read or write access to a data in a data network using a new architecture. The method of creating virtual block mapping pointer in response to a request by a client of the storage server to de-duplicate the file system data block or to allow compression of one or more file system data blocks into one or more physical data blocks. Further, the method relocates one or more file system data blocks from one part of the file system address space to another by using one or more virtual block mapping pointers that provides the mapping information for the one or more file system data blocks that are being relocated. The virtual block mapping pointer allows relocating of file system data blocks by same number of metadata operations regardless of number of files sharing the block that are being relocated and the state of those blocks (compressed or not).
摘要:
A storage processor having access to published logical unit numbers of a common block file system mounted on another storage processor processes requests for a particular file system object of the common block file system using metadata objects of the common block file system cached in both storage processors to access storage units shared between the two storage processors.
摘要:
A snapshot copy facility responds to a request for writing new data to a block of a production dataset by saving original data of the block, and writing the new data to the block of the production dataset and keeping a record of the blocks of the production dataset have been changed since the point in time when the snapshot copy was created. For detection of corruption of the snapshot metadata and for portability of the snapshot copy software, a sparse file is used for keeping a record of the blocks of the production dataset that have been changed since the snapshot. For “copy on first write” snapshots, the sparse file is a “write once read many” (WORM) file to store old data of blocks. For “remap on write” snapshots, the sparse file is a “read-write” (RW) file to which writes to the production file are stored.
摘要:
A system and method for providing a faster disk recovery is provided by bypassing the file system cache temporarily holding a sub set of metadata objects of the file system and instead using a persistent fast storage that can be accessed at deterministic speeds to hold all the metadata objects of the file system. The system speeds recovery by only writing updated metadata objects to the persistent disk storage when file system recovery is complete.
摘要:
Described are techniques for creating a snapshot of a distributed file system or a file thereof. The distributed file system includes metadata file systems storing metadata about files in the distributed file system and includes data file systems storing file content data. Quiescing is performed for requests affecting the distributed file system, or a file thereof, for which a snapshot is being created. A snapshot of metadata is obtained. For the distributed file system, this includes a snapshot of each metadata file system. For a file, this includes a snapshot of the file's metadata. A snapshot of file data is obtained. For distributed file systems, this includes a snapshot of each data file system. For a file, this includes a snapshot of the file's data. Unquiescing is performed for requests affecting the distributed file system, or the file thereof, upon successful completion of obtaining snapshots of metadata and file data.
摘要:
Embodiments of the invention relate to maintaining reference counts in a file system to track when a block is available to be freed. When a snapshot copy of a file is created, rather than copying all the blocks of the file for the snapshot copy, the snapshot inode is given pointers to the blocks of the file. Rather than updating the reference counts for all these blocks to indicate that they are now in use by more than one file, the update of reference counts for at least some of these blocks may be deferred until a later time.
摘要:
A storage processor isolates and classifies file system faults and inconsistencies to produce a fault tree for inline error recovery. The storage processor isolates the metadata objects or objects that have internal inconsistencies, the storage processor creates a fault tree to map the file system; or portion of the file system with the errors or inconsistencies and the metadata objects dependent upon those objects. Once the fault having been mapped, determine the complexity of recovering the branch of the fault tree with the error. If the error is not too complex, performing recovery of the metadata objects online otherwise taking the system offline for file system recovery.
摘要:
A storage processor includes storage for redundantly storing a log file of a journaling file system on a separate logical device from a primary copy of the log file and further provides for recovery of the file system upon failure of both the primary storage and the redundant storage storing the log file of the journaling file system by storing dirtied metadata objects in the cache of the storage processor to a vault area and then applying the stored dirtied metadata objects against the underlying persistent storage.
摘要:
Large files in a file system are mapped by extents of contiguous indirect blocks in order to reduce the time for read or write access to the large files while allowing allocation of data blocks one at a time. The inode of a file includes an indication of whether file mapping metadata of the file includes either an extent of contiguous indirect blocks or a tree of blocks. In a preferred mapping scheme, an inode contains an array of block pointer entries, and each entry includes a flag indicating whether the block pointer is pointing to either an extent of indirect blocks or a tree of blocks. For sharing of data blocks between files, the block pointer fields of the indirect blocks each contain an ownership flag indicating whether the pointed-to block is shared or not.
摘要:
Described are techniques for performing quota management in a distributed file system. An allocation quota specifies an upper limit of storage for allocation for a quota set of the distributed file system. The distributed file system includes metadata file system(s) and data file system(s). For files in the distributed file system, metadata is stored in one of the metadata file systems and file content data is stored in the data file systems. A quota coordinator partitions the allocation quota among the data file systems. The data file systems are allocators of storage and each receives a portion of the allocation quota specifying an upper limit of storage that the data file system has available for allocation for the quota set. Storage is allocated for client requests. The storage allocation is performed by each of the data file systems in accordance with the portion of the allocation quota assigned.