Abstract:
Systems, methods, and computer products for communicating between a client and server by identifying and separating file data streams within a file are provided. The method comprises indicating the type of file data stream to be transmitted and transmitting the indicated file data stream. The transmitted file data stream is compared with a stored data stream. A non-redundant file data stream is stored based upon the outcome of the comparison. The transmitted file data stream and stored data stream may be compared according to a deduplication table based on data stream profiles.
Abstract:
Provided are a method, system, and program for managing storage objects. Storage object information is provided for each storage object, wherein the storage object information indicates at least one of a plurality of groups associated with the storage object, and wherein each storage object is capable of being associated with a plurality of groups and different group types. Group information is provided for each group indicating a group identifier, storage objects associated with the group, and a group type.
Abstract:
Systems, methods, and computer products for separating file data streams for improved progressive incremental processing are provided. The method comprises identifying data in a file, prior to transmission of the data in a data stream to a second system, such that the second system can distinguish first data from second data in the file. The method further comprises processing the first and second data to determine whether the first or second data has changed, and transmitting the first data to the second system in response to determining the first data has changed, so that the first data is stored in a data storage medium in association with third and fourth data previously stored without replacing the third data and fourth data, wherein the third and fourth data comprise older versions of the first and second data, respectively.
Abstract:
A system, apparatus, and process creates a table of contents (TOC), including one or more table of contents (TOC) entries, to manage data in a hierarchical storage management system. Each TOC entry contains metadata describing the contents and attributes of a data object within an image, which is an aggregation of multiple data objects into a single object for storage management purposes. The TOC is stored in a storage hierarchy, such as magnetic disk, for fast access of and efficient operation on the aggregated TOC entries. The system, apparatus, and process also provide for aggregating the TOC entries from one or more TOCs into a TOC set in the storage management server database. The TOC set may be manipulated and queried in order to find a particular data object or image referenced by a TOC entry. The TOC entries, TOCs, and TOC sets may be dynamically managed by the hierarchical data storage management system through implementation of a set of policy management constructs that define appropriate creation, retention, and movement of the objects within the database and storage hierarchy.
Abstract:
Method and system aspects for supporting hierarchical file system management functions across multiple operating system platforms in a data processing system are provided. In these aspects, a code base provides predetermined functionality for each of a plurality of operating system platforms of the data processing system. Further, a common kernel extension is utilized by the code base, with the common kernel extension supporting a hierarchical file system of the data processing system. The common kernel extension supports file system intervention in the hierarchical file system by handling an interface between each operating system platform and a file system. Also, the common kernel extension further handles an interface between each operating system platform and a device driver.
Abstract:
Systems, methods, and computer products for separating file data streams for improved progressive incremental processing are provided. The method comprises identifying data in a file, prior to transmission of the data in a data stream to a second system, such that the second system can distinguish first data from second data in the file. The method further comprises processing the first and second data to determine whether the first or second data has changed, and transmitting the first data to the second system in response to determining the first data has changed, so that the first data is stored in a data storage medium in association with third and fourth data previously stored without replacing the third data and fourth data, wherein the third and fourth data comprise older versions of the first and second data, respectively.
Abstract:
Provided are techniques for accessing information. A partial key index is created, wherein the partial key index includes one or more partial key index (PKI) entries, wherein each PKI entry identifies a portion of a metadata object, wherein the metadata object includes metadata entries, each of which corresponds to an associated data object. The partial key index is used to locate one or more PKI entries, wherein each of the one or more PKI entries corresponds to one or more data objects in one of the one or more composite objects. Each of the one or more PKI entries is used to retrieve location information of metadata in a metadata object for each of the one or more composite objects. The metadata from each metadata object is loaded into a database using the location information.
Abstract:
Disclosed is a system for backing up files in a distributed computing system. A file server maintains files in a shared name space. The file server provides a first backup client program and a second backup client program with access to the files in the shared name space. The first backup client program initiates a backup request to backup a requested file. A determination is made as to whether the requested file is maintained in a shared name space. The backup request is transmitted to the second backup client program upon determining that the requested file is maintained in the shared name space. The second backup client program transmits a message to the file server to provide the requested file. The file server transmits the requested file with the file server to the second backup client program. The second backup client program then transmits the requested file to a backup server program. The backup server program stores the requested file in a storage device.
Abstract:
Disclosed is a system to diagnose and handle errors in an automated hierarchical storage management system. A host system requests an access operation on a first file, such as a logical volume, in a first storage device, such as a magnetic hard disk drive. A server processes the host request to determine whether the first file is resident in the first storage device. The server initiates a recall of a second file, such as a physical volume, in a second storage device, such as tape cartridges, optical disks, etc., corresponding to the first file upon determining that the first file is not resident in the first storage device. The second file is then copied from the second storage device to the first file in the first storage device upon determining that the second file is accessible. The server further determines whether the recall of the second file has failed. Upon determining that the recall has failed, the server checks a table in a memory within the server to determine whether there is error information listed for the second file involved in the failed recall. The server then takes appropriate action based on the error information in the table.
Abstract:
Provided are a system and article of manufacture for merging metadata on files in a backup storage. A query is received for information on files from a file system for a client node. A determination is made of metadata for files in a backup storage for the client node stored external to backup sets. At least one backup set in the backup storage for the client node is processed to determine metadata for files included in at least one backup set. The determined metadata for files in the backup storage and for files included in at least one backup set is merged to form merged metadata. The query is executed against the merged metadata to determine files whose metadata satisfies the query. Results including information from the merged metadata on the determined files are returned.