Defragmentation utility for a shared disk parallel file system across a storage area network
    1.
    发明授权
    Defragmentation utility for a shared disk parallel file system across a storage area network 有权
    跨存储区域网络的共享磁盘并行文件系统的碎片整理实用程序

    公开(公告)号:US06571261B1

    公开(公告)日:2003-05-27

    申请号:US09616012

    申请日:2000-07-13

    IPC分类号: G06F1730

    摘要: This invention provides a defragmentation utility that works on-line in parallel with other file system activities. Thus, it avoids making the file system unavailable for periods of time which would, if not for this invention, slow down data communication exchange and the execution of other tasks dependent upon the data. In particular, this invention, steps through all of the valid inodes finding each of the fragments. The defragmentation engine decides which fragments must remain in their current location and which fragments should migrate to another disk block sub-block location. Since the data blocks span across multiple disks, for each valid disk of the file system a set of disk blocks are constructed that are chosen to be filled, herein called plates. When the plates become full or reach a certain fullness, they are removed from the set and replaced by other disk blocks. When a disk block is removed from the plate set, it is moved to a “done” list as it is considered “full”. While a disk block is in the done list the fragments that belong to that block are not allowed to migrate. Thus, a defragmentation utility that works on-line, avoids locking data structures for long periods of time, is memory efficient, uses sub-blocks for fragment analysis and migration as well as minimizes data movements has been summarized. This utility thereby provides a transparent defragmentation function that operates in the background seamlessly with other system file operations.

    摘要翻译: 本发明提供了与其他文件系统活动并行工作的碎片整理实用程序。 因此,它避免使文件系统不可用的时间段,如果不是本发明,则减慢数据通信交换和依赖于数据的其他任务的执行。 特别地,本发明通过查找每个片段的所有有效索引节点。 碎片整理引擎决定哪些片段必须保留在其当前位置,哪些片段应迁移到另一个磁盘块子块位置。 由于数据块跨越多个磁盘,对于文件系统的每个有效磁盘,构造一组选择要填充的磁盘块,这里称为“板”。 当板变满或达到一定的丰满度时,将它们从组中移除并被其他磁盘块替换。 当磁盘块从板组中移除时,它被移动到“完成”列表,因为它被认为是“已满”。 当磁盘块位于完成列表中时,不允许迁移属于该块的片段。 因此,在线工作的碎片整理工具避免长时间锁定数据结构,是高效的内存,使用子块进行片段分析和迁移,并最大限度地减少数据移动。 因此,此实用程序提供透明的碎片整理功能,可在后台与其他系统文件操作无缝操作。

    Parallel high speed backup for a storage area network (SAN) file system
    2.
    发明授权
    Parallel high speed backup for a storage area network (SAN) file system 失效
    用于存储区域网络(SAN)文件系统的并行高速备份

    公开(公告)号:US07092976B2

    公开(公告)日:2006-08-15

    申请号:US10602156

    申请日:2003-06-24

    IPC分类号: G06F17/30

    摘要: File system backups are carried out by first generating a list of inodes including associated inode numbers in inode number order that have changed since the last backup operation. A table which has file names and inode numbers for all of the files currently in the file system is also generated. This list is sorted by inode number and the table and list are merged to provide a structure for determining which files are to be backed up. This means that relevant inodes and file names are now provided in a single entity. It is also noted that the structure that results from the merge operation is particularly suitable for being read in blocks which thus permits the backup operation to be carried out in parallel. The task of backing up files is also preferably partitioned by file size or other criteria as opposed to being partitioned simply by the number of files assigned to be backed up by any one processor in a distributed or parallel data processing system.

    摘要翻译: 文件系统备份是通过首先生成包含从上一次备份操作以来改变的inode编号顺序的相关索引节点号的inode列表来执行的。 还会生成一个具有文件系统中当前所有文件的文件名和inode号的表。 该列表按inode编号进行排序,并将表和列表合并,以提供用于确定要备份哪些文件的结构。 这意味着相关的inode和文件名现在在单个实体中提供。 还要注意的是,由合并操作产生的结构特别适用于以块的方式读取,从而允许并行执行备份操作。 备份文件的任务也优选地通过文件大小或其他标准进行分区,而不是简单地由分配或并行数据处理系统中的任何一个处理器分配备份的文件的数量进行分区。

    MONITORING LOST DATA IN A STORAGE SYSTEM
    3.
    发明申请
    MONITORING LOST DATA IN A STORAGE SYSTEM 失效
    监控存储系统中的数据丢失

    公开(公告)号:US20110302446A1

    公开(公告)日:2011-12-08

    申请号:US13196904

    申请日:2011-08-03

    IPC分类号: G06F11/20

    摘要: A data validation method comprises associating a validation chunk with one or more data chunks stored on one or more storage mediums. The validation chunk comprises validation information for verifying whether data recorded in a subdivision of the one or more data chunks is lost. A request is received for an operation to be performed on first data stored in a first subdivision of a first data chunk from among said one or more data chunks. One or more portions of the validation information are examined to determine whether the data recorded in said first subdivision is deemed to be lost.

    摘要翻译: 数据验证方法包括将验证块与存储在一个或多个存储介质上的一个或多个数据块相关联。 验证块包括用于验证记录在一个或多个数据块的细分中的数据是否丢失的验证信息。 接收针对从所述一个或多个数据块中的第一数据块的第一细分中存储的第一数据执行的操作的请求。 检查验证信息的一个或多个部分以确定记录在所述第一细分中的数据是否被认为丢失。

    Data integrity validation in storage systems
    4.
    发明授权
    Data integrity validation in storage systems 失效
    存储系统中的数据完整性验证

    公开(公告)号:US07752489B2

    公开(公告)日:2010-07-06

    申请号:US11747188

    申请日:2007-05-10

    IPC分类号: G06F11/00

    摘要: Data validation systems and methods are provided. Data is recorded in N data chunks on one or more storage mediums. A first validation chunk independently associated with said N data chunks comprises first validation information for verifying accuracy of data recorded in said N data chunks. The first validation chunk is associated with a first validation appendix comprising second validation information, wherein the first validation appendix is stored on a first storage medium independent of said one or more storage mediums.

    摘要翻译: 提供数据验证系统和方法。 数据记录在一个或多个存储介质上的N个数据块中。 独立地与所述N个数据块相关联的第一验证块包括用于验证记录在所述N个数据块中的数据的精度的第一验证信息。 第一验证块与包括第二验证信息的第一验证附录相关联,其中第一验证附录存储在独立于所述一个或多个存储介质的第一存储介质上。

    Dynamically switching between different types of concurrency control techniques to provide an adaptive access strategy for a parallel file system
    5.
    发明授权
    Dynamically switching between different types of concurrency control techniques to provide an adaptive access strategy for a parallel file system 有权
    动态切换不同类型的并发控制技术,为并行文件系统提供自适应访问策略

    公开(公告)号:US06826570B1

    公开(公告)日:2004-11-30

    申请号:US09618371

    申请日:2000-07-18

    IPC分类号: G06F1730

    摘要: Concurrent access to data is managed through concurrency control techniques. Various types of techniques are employed to manage the access, including locking-based techniques and non-locking-based techniques. A dynamic switch from one type of concurrency control technique (e.g., a locking-based technique) to a different type of concurrency control technique (e.g., a non-locking-based technique) is enabled. This switching is based on access patterns and/or application requirements for each file. The switching allows enhanced performance for both coarse-grain sharing and fine-grain sharing of data.

    摘要翻译: 通过并发控制技术来管理对数据的并发访问。 采用各种类型的技术来管理访问,包括基于锁定的技术和基于非锁定的技术。 从一种类型的并发控制技术(例如,基于锁定的技术)到不同类型的并发控制技术(例如,基于非锁定的技术)的动态切换被启用。 此切换基于每个文件的访问模式和/或应用程序需求。 切换允许增加数据的粗粒度共享和细粒度共享的性能。

    Monitoring lost data in a storage system
    6.
    发明授权
    Monitoring lost data in a storage system 失效
    监控存储系统中的丢失数据

    公开(公告)号:US08751859B2

    公开(公告)日:2014-06-10

    申请号:US13196904

    申请日:2011-08-03

    IPC分类号: G06F11/00

    摘要: A data validation method comprises associating a validation chunk with one or more data chunks stored on one or more storage mediums. The validation chunk comprises validation information for verifying whether data recorded in a subdivision of the one or more data chunks is lost. A request is received for an operation to be performed on first data stored in a first subdivision of a first data chunk from among said one or more data chunks. One or more portions of the validation information are examined to determine whether the data recorded in said first subdivision is deemed to be lost.

    摘要翻译: 数据验证方法包括将验证块与存储在一个或多个存储介质上的一个或多个数据块相关联。 验证块包括用于验证记录在一个或多个数据块的细分中的数据是否丢失的验证信息。 接收针对从所述一个或多个数据块中的第一数据块的第一细分中存储的第一数据执行的操作的请求。 检查验证信息的一个或多个部分以确定记录在所述第一细分中的数据是否被认为丢失。

    Detecting when to prefetch data and then prefetching data in parallel
    7.
    发明授权
    Detecting when to prefetch data and then prefetching data in parallel 失效
    检测何时预取数据,然后并行预取数据

    公开(公告)号:US07707360B2

    公开(公告)日:2010-04-27

    申请号:US12013549

    申请日:2008-01-14

    IPC分类号: G06F13/00

    摘要: The decision to prefetch inodes is based upon the detecting of access patterns that would benefit from such a prefetch. Once the decision to prefetch is made, a plurality of inodes are prefetched in parallel. Further, the prefetching of inodes is paced, such that the prefetching substantially matches the speed at which an application requests inodes.

    摘要翻译: 预取inode的决定基于检测将受益于这种预取的访问模式。 一旦做出预取的决定,多个inode就被并行预取。 此外,inode的预取将被起步,使得预取基本上与应用请求索引节点的速度相匹配。

    DATA INTEGRITY VALIDATION IN STORAGE SYSTEMS
    8.
    发明申请
    DATA INTEGRITY VALIDATION IN STORAGE SYSTEMS 失效
    存储系统中的数据一致性验证

    公开(公告)号:US20080282105A1

    公开(公告)日:2008-11-13

    申请号:US11747188

    申请日:2007-05-10

    IPC分类号: G06F11/00

    摘要: Data validation systems and methods are provided. Data is recorded in N data chunks on one or more storage mediums. A first validation chunk independently associated with said N data chunks comprises first validation information for verifying accuracy of data recorded in said N data chunks. The first validation chunk is associated with a first validation appendix comprising second validation information, wherein the first validation appendix is stored on a first storage medium independent of said one or more storage mediums.

    摘要翻译: 提供数据验证系统和方法。 数据记录在一个或多个存储介质上的N个数据块中。 独立地与所述N个数据块相关联的第一验证块包括用于验证记录在所述N个数据块中的数据的精度的第一验证信息。 第一验证块与包括第二验证信息的第一验证附录相关联,其中第一验证附录存储在与所述一个或多个存储介质无关的第一存储介质上。

    Ditto address indicating true disk address for actual data blocks stored in one of an inode of the file system and subsequent snapshot
    9.
    发明授权
    Ditto address indicating true disk address for actual data blocks stored in one of an inode of the file system and subsequent snapshot 失效
    同时显示存储在文件系统的一个inode中的实际数据块的真实磁盘地址和后续快照

    公开(公告)号:US07043503B2

    公开(公告)日:2006-05-09

    申请号:US10077345

    申请日:2002-02-15

    IPC分类号: G06F17/30

    摘要: A system, method and computer readable medium for providing a file system snapshot with ditto address feature is disclosed. The method includes generating a file system snapshot wherein the snapshot is substantially empty. When metadata associated with a source file included in the snapshot is modified, the inode corresponding to the source file is copied to a shadow inode in the snapshot. When information is appended to a data block associated with a source file included in the snapshot, the inode corresponding to the source file is also copied to a shadow inode in the snapshot. When information in a data block associated with a source file included in the snapshot is overwritten or deleted, the inode corresponding to the source file is copied to a shadow inode in the snapshot and the original data block corresponding to the source file is copied to the snapshot.

    摘要翻译: 公开了一种用于提供具有同上地址特征的文件系统快照的系统,方法和计算机可读介质。 该方法包括生成文件系统快照,其中快照基本为空。 当与快照中包含的源文件相关联的元数据被修改时,与源文件相对应的inode将复制到快照中的阴影inode。 当信息附加到与快照中包含的源文件相关联的数据块时,与源文件对应的inode也将复制到快照中的阴影inode。 当与快照中包含的源文件相关联的数据块中的信息被覆盖或删除时,与源文件相对应的inode被复制到快照中的阴影inode,并且与源文件相对应的原始数据块被复制到 快照

    System for determining the order and frequency in which space is allocated on individual storage devices
    10.
    发明授权
    System for determining the order and frequency in which space is allocated on individual storage devices 失效
    用于确定在各个存储设备上分配空间的顺序和频率的系统

    公开(公告)号:US06829678B1

    公开(公告)日:2004-12-07

    申请号:US09618332

    申请日:2000-07-18

    IPC分类号: G06F1202

    摘要: Space is allocated on data storage devices in proportion to weights associated with the storage devices. The weights can be dynamically adjusted at any time in order to accommodate changes in the system and to better utilize the storage devices. The technique used to perform the allocating is independent of the weights used by the allocating. Further, the allocation technique can accommodate general purpose data streams having varying lengths and/or varying access patterns, as well as special purpose data streams, such as video streams.

    摘要翻译: 与存储设备相关联的权重与数据存储设备分配空间。 权重可以随时动态调整,以适应系统的变化并更好地利用存储设备。 用于执行分配的技术与分配所使用的权重无关。 此外,分配技术可以适应具有变化的长度和/或变化的访问模式的通用数据流以及诸如视频流的专用数据流。