摘要:
A dispersed storage (DS) unit includes a processing module and a plurality of hard drives. The processing module is operable to maintain states for at least some of the plurality of hard drives. The processing module is further operable to receive a memory access request regarding an encoded data slice and identify a hard drive of the plurality of hard drives based on the memory access request. The processing module is further operable to determine a state of the hard drive. When the hard drive is in a read state and the memory access request is a write request, the processing module is operable to queue the write request, change from the read state to a write state in accordance with a state transition process, and, when in the write state, perform the write request to store the encoded data slice in the hard drive.
摘要:
Multiple data slices are generated from an original data segment. The data slices are constructed to prevent recovery of the original data segment using a single related data slice, but to allow recovery of the original data segment using fewer than all of the data slices. Each data slice is stored in the same memory stripe as the other data slices. The memory stripe extends across multiple memory devices and multiple different distributed storage units. The memory device in which each data slice is stored can be determined based on a source name associated with each data slice.
摘要:
A process, apparatus, and system stores data check information on an electronic storage medium that uses standard sector data field sizes. The check information may include a cyclic redundancy check (CRC), a logical block address (LBA), a longitudinal redundancy check (LRC), state information, a sequence number, or other information to identify data state, misplacement, or corruption. The check information, instead of being appended to the data within the data sector, may be stored in an independent check sector. The check information corresponding to multiple data sectors may also be aggregated and stored in a single check sector. The process or apparatus may be incorporated in a storage system controller, a RAID controller, a software SCSI stack in a computer, an operating system, a storage device driver, or another appropriate application that interfaces with standard and commodity storage system components.
摘要:
Embodiments of the invention provide a parcel-based, data-mapping scheme that allow for implementation of data integrity methods and variable size logical data blocks while the layout of the physical storage device remains unchanged. For one embodiment, the invention provides a method in which a virtual data storage parcel including a number of extended-size logical data storage blocks is created, and one or more physical data storage parcels, each including a number of standard-size logical data storage blocks, is created. The combined size of the one or more physical data storage parcels equals or exceeds the size of the virtual data storage parcel. The extended-size logical data storage blocks of the virtual data storage parcel are mapped to the standard-size logical data storage blocks of the one or more physical data storage parcels.
摘要:
A system and associated method efficiently complete write commands in an ISF disk drive/RAID system with minimal disk accesses to the underlying disk drives. The system updates data in a parity-based disk array system by receiving a write command to write new data. The present system minimizes the number of disk accesses. The present system completes the same or comparable write commands in a total of four accesses to the disk drives. This is realized by combining the read-modify-write operation of updating one or more sectors in an ISF cluster with the read-modify-write operation associated with updating one or more sectors in a parity-based array system, such as a RAID-5 system.
摘要:
A method and system of replicating data where data is copied from a host server to a storage device in a first group of storage devices. A receipt is sent from the first group of storage devices to the host server when the data has been copied to all storage devices within the first group. The data is copied from the first group to at least one further group of storage devices. A receipt is sent from each further group of storage devices to the first group of storage devices when the data has been copied to all storage devices within each further group.
摘要:
A network storage server implements a method to maintain a parity declustered RAID organization with distributed hot sparing. The parity declustered RAID organization, which provides data redundancy for a network storage system, is configured as a RAID organization with a plurality of logical drives. The RAID organization is then distributed in a parity declustered fashion to a plurality of physical drives in the network storage system. The RAID organization also has a spare space pre-allocating on each of the plurality of physical drives. Upon failure of one of the plurality of physical drives, data stored in the failed physical drives can be reconstructed and stored to spare space of the surviving physical drives. After reconstruction, the plurality of logical drives remains parity-declustered on the plurality of surviving physical drives.
摘要:
A distributed storage processing unit can generate data slices and determine metadata for each of the data slices. The metadata includes information that can be used to determine storage diversity preferences, which can include requirements that data slices generated from a common data segment each be stored in memories of the same (or different) type and model, memories with the same (or different) failure rates, memories having fast read (or write) characteristics, and so on. Decisions about which memory units to use for storing data slices can be made based on how closely the characteristics of the memories match the storage diversity preferences. The decision can be made at a distributed storage processing unit that generates the data slices, at a distributed storage unit receiving the data slices for storage, or elsewhere.
摘要:
A method for distributing data over a set of N storage devices. The method includes apportioning the data into groups of (N−2) or fewer blocks, and adding to each group a parity block so as to form a parity set. The method further includes distributing the blocks of each parity set to the N storage devices so that each of the blocks is stored on a different storage device.
摘要:
A process, apparatus, and system stores data check information on an electronic storage medium that uses standard sector data field sizes. The check information may include a cyclic redundancy check (CRC), a logical block address (LBA), a longitudinal redundancy check (LRC), state information, a sequence number, or other information to identify data state, misplacement, or corruption. The check information, instead of being appended to the data within the data sector, may be stored in an independent check sector. The check information corresponding to multiple data sectors may also be aggregated and stored in a single check sector. The process or apparatus may be incorporated in a storage system controller, a RAID controller, a software SCSI stack in a computer, an operating system, a storage device driver, or another appropriate application that interfaces with standard and commodity storage system components.