Abstract:
A distributed file system based on a torus network includes a center node configured to encode data when the data is received from a client and one or more storage nodes configured to receive data blocks or parity blocks generated by the encoding from the center node and store the data blocks or parity blocks.
Abstract:
A distributed file system based on a torus network includes a plurality of metadata servers configured to store metadata of files, a plurality of data servers configured to divide data and store the divided data in a distributed manner, and at least one management server configured to manage the metadata servers and the data servers. The plurality of metadata servers, the plurality of data servers, and the at least one management server are disposed on first to nth planes each of which consists of a plurality of nodes, and the first plane is connected to a plurality of clients through a switch.
Abstract:
A distributed file system includes metadata servers and data servers. The metadata server includes a selecting unit to select a data server from the data servers, a chunk allocation requesting unit to request that the selected data server perform chunk allocation, a chunk list managing unit to insert a list of chunks transmitted from the data server into a chunk list pool and determine an arrangement method of the chunk list pool, and a chunk fetching unit to fetch available chunk information from the chunk list pool. The data server includes a receiving unit to receive request for chunk allocation from the metadata server, a chunk allocating unit to allocate chunks in response to the request for chunk allocation and write a list of chunks based on information about the allocated chunk, and a transmitting unit to transmit the list of chunks to the metadata server.
Abstract:
Provided herein is a shuffle embedded distributed storage system and method supporting virtual merge, the system and method including a distributed shared storage configured to store a virtual merged file; a plurality of map servers connected to the distributed shared storage via a network, and configured to perform a map function and record a map result data computed as a result of the map function in the distributed shared storage by means of a map result file; and a plurality of reduce servers connected to the distributed shared storage and the map servers via the network, wherein the virtual merged file includes a list of the map result files recorded by the plurality of map servers, and an identifier of a reduce server to which the virtual merged file is to be transmitted.
Abstract:
A virtual machine host server includes a virtual machine in which a guest operating system is installed and operated, a cache manager for processing at least one of an open request, a close request, and an input/output request for a disk image file of the virtual machine, which is stored in a storage system, and managing a boot workload map and a boot segment, a cache device for caching the boot segment, and a prefetch manager for prefetching the boot segment from the cache device.
Abstract:
Disclosed are an apparatus and a method for distribution processing of data, and a storage server and the apparatus for distribution processing of data includes: a metadata management unit providing metadata information corresponding to data to a metadata server to verify information of an original storage server and one or more copy storage servers to store the data from the metadata server; and a data management unit creating a message including the information on the storage servers verified by the metadata management unit and the data, and transmitting the message to a storage server having a higher priority according to priorities of the storage servers to store the corresponding data.
Abstract:
A method and system that can completely delete garbage data in a distributed network system are provided. Because it is impossible to initially access a data server, data to delete is not deleted, and thus when a garbage file is generated, a generated garbage file can be completely deleted. In this case, by performing a deletion operation of a garbage file in a distributed data server unit, operation efficiency can be maximized.
Abstract:
A metadata server of a distributed file system calculates an access frequency of a file and changes a maintaining method of chunks of a data server for dividing data of the file into chunk units to store the chunks in a stripe in accordance with access frequency of the file.
Abstract:
A replicated file deduplication apparatus generates a hash key of a requested data block, determines whether the same data block as the requested data block exists in data blocks of a replicated image file that is derived from the same golden image file as the requested data block using the hash key of the requested data block, and records, if the same data block as the requested data block exists, information of a chunk in which the same data block as the requested data block is stored at a layout of the requested data block.
Abstract:
A distributed storage server includes a plurality of data server devices and a plurality of metadata server devices. The metadata server devices store metadata associated with data which is distributively stored in the data server devices. A selected metadata server device checks whether a dangling directory occurs by performing a rename operation, based on information associated with a full path of a parent directory of a source and a full path of a parent directory of a target included in a request of the rename operation. When it is determined that the dangling directory does not occur, the selected metadata server device processes transactions directed to the metadata such that the rename operation is performed. The checking whether the dangling directory occurs is performed before a transaction period for processing the transactions.