摘要:
A method for data access in a multinode, shared storage data processing environment is provided by enhancing the file locking mechanism structure so as to permit nodes not normally designated as metadata controller nodes to fulfill that function for limited times thus at least temporarily eliminating the need for continual node-to-node coordination. This is particularly advantageous in the access and transfer of large files such as video files or files containing complex visualization data.
摘要:
A method is provided for limiting access to disks and files in the event of a system partitioning occurring as the result of a node failure in a data distributed processing system in which files are shared amongst a plurality of independently running nodes. The nodes in the system are provided with limited duration leases which permit data access and which have to be periodically renewed. Each partition is also associated with a quorum which is also a necessary element in providing access at proper times. The lease and quorum concepts work together to insure that recovery operations do not occur until recovery is possible. The lease concept thus is also seen as further operating in close cooperation with the quorum concept to prevent long delays in the recovery process that could otherwise occur.
摘要:
The present invention is directed to a method for controlling file access in a multinode, shared storage, data processing system in which a one set of nodes is capable of acting as metadata controllers and a second set of nodes are tuned for running user applications. By providing two kinds of locks operative at the file level of granularity, a mechanism is produced which permits application programs to also run on their set of metadata controller nodes. One of the locks permits read and write access to existing data blocks but precludes operations such as file deletion or file truncation. The other lock is of lower authority and permits metadata controller nodes, which can provide time limited permissions to the application nodes, to withhold locks which authorize access when requests for access are made from application nodes.
摘要:
A computer system having a shared disk file system running on multiple computers each having their own instance of an operating system and being coupled for parallel data sharing access to files residing on network attached shared disks. Methods are provided for use as a parallel file system in a shared disk environment by use of a scaleable directory service for the system with a stable cursor, and a segmented allocation map. Dynamic prefetch and cached balance pools for multiple accesses improve the system. Extended file attributes are used for implementation of Access Control Lists in a parallel file system. A metadata node manages file metadata for parallel read and write actions. For our system, tokens are used for metadata node selection and identification. We have provided recoverable local shares for quota Management. A quota server and a quota client are provided for each file system, and a quotacheck utility allows parallel environments with minimal interference to other applications which require the use of quotas.
摘要:
File system restoration is made more flexible through the use of indicators of individual file restoration status throughout the restoration process. Such indicators are particularly useful in the restoration of large file systems where, for example, the number of files may range upwards of several hundred million. Since file system restoration for large systems takes such a relatively long time, the present invention provides various degrees of individual file access even as the restoration process is being carried out. During file system restoration times, file access may be full or limited to a file's attributes. Most advantageously, the present invention is capable of providing full, dynamically driven (on-demand) file access even during file system restoration operations.
摘要:
File system backups are carried out by first generating a list of inodes including associated inode numbers in inode number order that have changed since the last backup operation. A table which has file names and inode numbers for all of the files currently in the file system is also generated. This list is sorted by inode number and the table and list are merged to provide a structure for determining which files are to be backed up. This means that relevant inodes and file names are now provided in a single entity. It is also noted that the structure that results from the merge operation is particularly suitable for being read in blocks which thus permits the backup operation to be carried out in parallel. The task of backing up files is also preferably partitioned by file size or other criteria as opposed to being partitioned simply by the number of files assigned to be backed up by any one processor in a distributed or parallel data processing system.
摘要:
A computer system having a shared disk file system running on multiple computers each having their own instance of an operating system and being coupled for parallel data sharing access to files residing on network attached shared disks. Locking techniques reduce the overhead of a token manager which is also used in the file system recovery if a computer participating in the management of shared disks becomes unavailable or failed. Synchronous and asynchronous takeover of a metadata node occurs for correction of metadata which was under modification and a new computer node to be a metadata node for that file. Locks are not constantly required to allocate new blocks on behalf of a user.
摘要:
A computer system having a shared disk file system running on multiple computers each having their own instance of an operating system and being coupled for parallel data sharing access to files residing on network attached shared disks. Methods are provided for use as a parallel file system in a shared disk environment by use of a scalable directory service for the system with a stable cursor, a segmented allocation map. Dynamic prefetch and cached balance pools for multiple accesses improve the system. Extended file attributes are used for implementation of Access Control Lists in a parallel file system. Improvements to caching and cache performance developments balance pools for multiple accesses. A metadata node manages file metadata for parallel read and write actions. For our system, tokens are used for metadata node selection and identification, and we have enhanced token modes for controlling file size, as well as smart caching of byte range tokens using file access patterns and a byte range lock algorithm using a byte range token interface. Locking techniques reduce the overhead of a token manager which is also used in the file system recovery if a computer participating in the management of shared disks becomes unavailable or failed.
摘要:
A computer system having a shared disk file system running on on multiple computers each having their own instance of an operating system and being coupled for parallel data sharing access to files residing on network attached shared disks. Methods are provided for use as a parallel file system in a shared disk environment by use of a scalable directory service for the system with a stable cursor, a segmented allocation map. Synchronous and asynchronous takeover of a metadata node occurs for correction of metadata which was under modification and a new computer node to be a metadata node for that file. Locks are not constantly required to allocate new blocks on behalf of a user. We have provided recoverable local shares for Quota Management. A quota server and a quota client are provided for each file system, and a quotacheck utility allows parallel environments with minimal interference to other applications which require the use of quotas.
摘要:
A computer-implemented method enables efficient tracking of fileset IDs and inode utilizing a fileset mask and an internal inode mask. A utility dynamically updates the fileset mask and the internal inode mask to enable mapping of the number of one (1) bits in the fileset mask to a fileset identifier (ID) and mapping of the one bits in the inode mask to an inode number for the fileset, as either the number of filesets or the number of inodes required per filesets increases above a next power of two threshold. The one bits within the fileset mask and the internal inode mask are disjoint relative to each other. An external inode number is mapped to a corresponding fileset and to a corresponding inode number by concatenating individual bits of the external inode number corresponding to each one (1) bit within the fileset mask and the inode mask.