Policy based input/output dispatcher
    1.
    发明授权
    Policy based input/output dispatcher 有权
    基于策略的输入/输出调度器

    公开(公告)号:US09304951B1

    公开(公告)日:2016-04-05

    申请号:US13449491

    申请日:2012-04-18

    IPC分类号: G06F13/16

    摘要: Disclosed is a policy-based I/O dispatcher that intercepts I/O requests from several individual volumes made to a shared storage system (such as a RAID array) and manages these I/O requests so that no single volume monopolizes the I/O bandwidth and excludes the other volumes from timely completing their own I/O requests. Also disclosed are a plurality of attributes that may be assigned to each volume sharing a disk array to effectively manage the sharing of the disk array among the volumes. The I/O policy manager may handle I/O requests from several sources including volume-based iSCSI I/O requests as well as the file-share-based XFS I/O requests.

    摘要翻译: 公开了一种基于策略的I / O调度程序,其拦截对共享存储系统(例如RAID阵列)进行的多个单独卷的I / O请求,并管理这些I / O请求,以使单个卷独占I / O 带宽,并排除其他卷及时完成自己的I / O请求。 还公开了可以分配给共享磁盘阵列的每个卷的多个属性,以有效地管理卷中的磁盘阵列的共享。 I / O策略管理器可以处理来自多个来源的I / O请求,包括基于卷的iSCSI I / O请求以及基于文件共享的XFS I / O请求。

    Data migration between multiple tiers in a storage system using pivot tables
    2.
    发明授权
    Data migration between multiple tiers in a storage system using pivot tables 有权
    使用数据透视表在存储系统中的多层数据迁移

    公开(公告)号:US08812811B1

    公开(公告)日:2014-08-19

    申请号:US13571956

    申请日:2012-08-10

    IPC分类号: G06F12/00

    摘要: Technologies are described for implementing a migration mechanism in a data storage system containing multiple tiers of storage with each tier having different cost and performance parameters. Access statistics can be collected for each territory, or storage entity, within the storage system. Data that is accessed more frequently can be migrated toward higher performance storage tiers while data that is accessed less frequently can be migrated towards lower performance storage tiers. Each tier can be associated with a range of ILM statistics referred to as the bucket for that tier. A pivot table may be provided that relates the tiers and the buckets. Operations on the pivot table can provide counts of how many territories may be promoted or demoted between any two pairs of tiers.

    摘要翻译: 描述了用于在包含多层存储的数据存储系统中实现迁移机制的技术,其中每层具有不同的成本和性能参数。 可以为存储系统内的每个区域或存储实体收集访问统计信息。 更频繁访问的数据可以迁移到更高性能的存储层,而访问较少的数据可以迁移到较低性能的存储层。 每个层可以与被称为该层的桶的一系列ILM统计量相关联。 可以提供关于层和桶的枢轴工作台。 枢轴表上的操作可以提供任何两对层次之间可以提升或降级的领土数量。

    Provisioning space in a data storage system
    3.
    发明授权
    Provisioning space in a data storage system 有权
    数据存储系统中的配置空间

    公开(公告)号:US08402209B1

    公开(公告)日:2013-03-19

    申请号:US12425123

    申请日:2009-04-16

    IPC分类号: G06F12/00 G06F13/00

    摘要: Dynamic provisioning of available space in a data storage system without having to configure partitions at system startup is presented. A system table may be maintained with entries corresponding to provisions within the available physical capacity of a data storage system. A volume table may be maintained that includes entries corresponding to territories within a logical data storage volume. When a data write operation is requested, a determination may be made as to whether physical space has been allocated for the territory in the volume that is to be written. If physical space has not yet been allocated, the necessary physical space may be allocated for the territory within the logical volume that is to receive the written data and the requested write operation may be performed. Metadata can be written to disk as to simplify recover from system crashes and unclean shutdowns.

    摘要翻译: 呈现数据存储系统中可用空间的动态配置,而无需在系统启动时配置分区。 可以使用与数据存储系统的可用物理容量内的规定相对应的条目来维护系统表。 可以维护卷表,其包括对应于逻辑数据存储卷内的区域的条目。 当请求数据写入操作时,可以确定是否为要写入的卷中的领域分配了物理空间。 如果尚未分配物理空间,则可以为接收写入数据的逻辑卷内的领域分配必要的物理空间,并且可以执行所请求的写入操作。 元数据可以写入磁盘,以简化从系统崩溃和不清洁的关机恢复。

    Method, system, and apparatus for expanding storage capacity in a data storage system
    4.
    发明授权
    Method, system, and apparatus for expanding storage capacity in a data storage system 有权
    用于在数据存储系统中扩展存储容量的方法,系统和装置

    公开(公告)号:US07747835B1

    公开(公告)日:2010-06-29

    申请号:US11417801

    申请日:2006-05-04

    IPC分类号: G06F12/00 G06F13/00

    摘要: A method, system, and apparatus for expanding the storage capacity of a data storage system are provided. According to one method, the physical storage devices that store the data and metadata for one or more logical disks are organized into a container. A logical disk segment is created within the container for each logical disk. When storage capacity is added through the addition of logical disks, a new logical disk segment is added to the end of the container for the new logical disk. When storage capacity is added through the addition of capacity to an existing logical disk, a new logical disk segment is added to the end of the container for the new logical disk segment within the logical disk. The devices within a container may be migrated between server computers or between CPUs with their associated mass storage controllers.

    摘要翻译: 提供了一种用于扩展数据存储系统的存储容量的方法,系统和装置。 根据一种方法,存储用于一个或多个逻辑磁盘的数据和元数据的物理存储设备被组织成容器。 在每个逻辑磁盘的容器内创建逻辑磁盘段。 当通过添加逻辑磁盘添加存储容量时,新的逻辑磁盘段将添加到新逻辑磁盘的容器的末尾。 当通过向现有逻辑磁盘添加容量来存储容量时,将在逻辑磁盘中的新逻辑磁盘段的容器末端添加新的逻辑磁盘段。 容器中的设备可以在服务器计算机之间或者与其相关的大容量存储控制器之间的CPU之间迁移。

    Efficient backup of multiple versions of a file using data de-duplication
    5.
    发明授权
    Efficient backup of multiple versions of a file using data de-duplication 有权
    使用重复数据删除对文件的多个版本进行高效备份

    公开(公告)号:US08621166B1

    公开(公告)日:2013-12-31

    申请号:US12698308

    申请日:2010-02-02

    IPC分类号: G06F12/00

    摘要: Technologies are described herein for providing efficient backup of multiple versions of a data file using data de-duplication. A CDP module copies blocks of data of a specific block size from a current version of the data file to a master file maintained in a backup location for the data file. Only blocks of data not matching a unique data block already in the master file are copied. The CDP module then creates an anterior file in the backup location for the current version of the data file containing an ordered list of references to the unique data blocks in the master file. The order of the list of references is based on the order of occurrence of each unique data block in the modified version of the data file. Finally, the CDP module creates a posterior file in the backup location for the current version of the data file containing any remaining block of data in the data file that is less than the specific block size.

    摘要翻译: 本文描述了技术,用于使用重复数据删除来提供数据文件的多个版本的有效备份。 CDP模块将特定块大小的数据块从数据文件的当前版本复制到数据文件的备份位置中维护的主文件。 仅复制与主文件中已有的唯一数据块不匹配的数据块。 然后,CDP模块在备份位置为当前版本的数据文件创建一个前端文件,其中包含对主文件中唯一数据块的引用的有序列表。 引用列表的顺序基于数据文件的修改版本中每个唯一数据块的发生顺序。 最后,CDP模块在数据文件的当前版本的数据文件的备份位置中创建一个后端文件,该数据文件包含少于特定块大小的数据文件中剩余的数据块。

    High capacity thin provisioned storage server with advanced snapshot mechanism
    6.
    发明授权
    High capacity thin provisioned storage server with advanced snapshot mechanism 有权
    具有高级快照机制的大容量精简配置存储服务器

    公开(公告)号:US08127096B1

    公开(公告)日:2012-02-28

    申请号:US12173212

    申请日:2008-07-15

    IPC分类号: G06F12/00

    摘要: Technologies for high capacity storage servers with thin provisioning can support an increased storage capacity and an increased number of snapshots within a data storage system while maintaining a reduced memory footprint. Flexible virtual address translation can support both direct, and indirect, translation from a virtual address to an address in physical storage. A data structure, referred to as a volume table, may be provided for supporting the virtual to physical address translation. Multiple volume tables for the various volumes within a data storage system can be stored together in a global volume table. Granularities of storage allocation units, such as territories, provisions, and chunks can be reduced to improve efficiencies in the operation of the storage system. Processes for handling volume and snapshot I/O operations with various data structures can contribute to improved efficiencies while supporting increased storage capacities and an increased number of snapshots.

    摘要翻译: 具有精简配置的高容量存储服务器的技术可以支持数据存储系统中增加的存储容量和更多数量的快照,同时保持减少的内存占用。 灵活的虚拟地址转换可以支持从虚拟地址到物理存储中的地址的直接和间接转换。 可以提供称为卷表的数据结构,用于支持虚拟到物理地址转换。 数据存储系统中各种卷的多个卷表可以一起存储在全局卷表中。 可以减少存储分配单位(如领土,规定和块)的粒度,以提高存储系统运行的效率。 使用各种数据结构处理卷和快照I / O操作的过程可有助于提高效率,同时支持增加的存储容量和更多数量的快照。

    Allocating background workflows in a data storage system using historical data
    7.
    发明授权
    Allocating background workflows in a data storage system using historical data 有权
    在使用历史数据的数据存储系统中分配后台工作流

    公开(公告)号:US08024542B1

    公开(公告)日:2011-09-20

    申请号:US12101251

    申请日:2008-04-11

    IPC分类号: G06F12/00

    摘要: Technologies are described for implementing a system that schedules background workflows in a storage system. The background workflows may be automated maintenance tasks that require data movement, or any other tasks that would otherwise compete with normal input/output operations. Historical load statistics can be analyzed to estimate the preferred times in the future during which to schedule background workflows. After collecting data access statistics and usage patterns for several days or weeks, a number of averages can be calculated from the statistics at various natural periods of system utilization. For example, daily, weekly, or other periods. A weighted average can be established where weighting can place more emphasis on recent data. Such averages can serve as predictors of future loads having similar periodic relationships to the historical load data. Predicting future loads can improve the scheduling of background operations by avoiding conflicts with normal system operations.

    摘要翻译: 描述了用于实现在存储系统中调度后台工作流的系统的技术。 后台工作流可以是需要数据移动的自动化维护任务,否则将与正常输入/输出操作竞争的任何其他任务。 可以分析历史负载统计数据,以估计将来安排后台工作流程的未来的首选时间。 在收集数据访问统计数据和使用模式数天或数周后,可以从系统利用的各种自然时期的统计数据计算出一些平均值。 例如,每天,每周或其他时期。 可以确定加权平均值,其中权重可以更加强调最近的数据。 这样的平均值可以作为与历史负载数据具有类似周期关系的未来负载的预测器。 预测未来负载可以通过避免与正常系统操作的冲突来改善后台操作的调度。

    Systems and methods for active raid
    8.
    发明授权
    Systems and methods for active raid 有权
    主动袭击的系统和方法

    公开(公告)号:US09430367B1

    公开(公告)日:2016-08-30

    申请号:US13450378

    申请日:2012-04-18

    IPC分类号: G06F12/02 G06F11/20

    摘要: A first RAID module is added to a first RAID controller and a second RAID module is added to a second RAID controller. An array of physical disks is partitioned into two partitions across the array of physical disks. The first partition is assigned to the first RAID module and the second partition is exposed to the second RAID module. Each of the RAID modules exposes their respective partitions to their associated RAID controller as a single array. Each RAID module further receives I/O from its respective RAID controller, and translates the I/O to access its associated partition.

    摘要翻译: 将第一个RAID模块添加到第一个RAID控制器,第二个RAID模块被添加到第二个RAID控制器。 物理磁盘阵列在物理磁盘阵列上分为两个分区。 第一个分区被分配给第一个RAID模块,第二个分区暴露给第二个RAID模块。 每个RAID模块将其各自的分区作为单个阵列公开到其关联的RAID控制器。 每个RAID模块还从其相应的RAID控制器接收I / O,并转换I / O以访问其关联的分区。

    Asynchronous replication by tracking recovery point objective
    9.
    发明授权
    Asynchronous replication by tracking recovery point objective 有权
    通过跟踪恢复点目标进行异步复制

    公开(公告)号:US08332354B1

    公开(公告)日:2012-12-11

    申请号:US12638783

    申请日:2009-12-15

    IPC分类号: G06F7/00

    摘要: Technologies are described herein for skipping snapshots during a snapshot replication process in order to maintain an established recovery point objective. A first snapshot is selected after a previously replicated snapshot. A creation time of the first snapshot is retrieved. A difference between a current time and the creation time of the first snapshot is computed. A determination is made as to whether the difference is less than a recovery point objective. If the difference is less than a recovery point objective, then the first snapshot is replicated in the snapshot replicated process. If the difference is not less than a recovery point objective, then the first snapshot is skipped through the snapshot replication process.

    摘要翻译: 本文描述了技术,用于在快照复制过程中跳过快照,以便维护已建立的恢复点目标。 在先前复制的快照之后选择第一个快照。 检索第一个快照的创建时间。 计算当前时间和第一个快照的创建时间之间的差异。 确定差异是否小于恢复点目标。 如果差异小于恢复点目标,则在快照复制过程中复制第一个快照。 如果差异不小于恢复点目标,则通过快照复制过程跳过第一个快照。

    Allocating background workflows in a data storage system using autocorrelation
    10.
    发明授权
    Allocating background workflows in a data storage system using autocorrelation 有权
    使用自相关在后台工作流中分配数据存储系统

    公开(公告)号:US08140775B1

    公开(公告)日:2012-03-20

    申请号:US12101241

    申请日:2008-04-11

    IPC分类号: G06F12/00

    CPC分类号: G06F11/3433 G06F11/3452

    摘要: Technologies are described for implementing a system that schedules background workflows in a storage system. Historical load statistics can be analyzed to estimate the preferred times in the future during which to schedule background workflows. After collecting load statistics related to the storage system, natural cyclical patterns in the load data can be determined as the predominant periodicities of the load data are selected from peaks in an autocorrelation of the collected data. A linear predictor may be formed as a weighted sum of the historical data sampled at the determined periodicities. Error minimization, such as the method of least squares, may be used to determine the values of the weighting in order to minimize an error between the load predictor and the measured load. Predicting future loads can improve the scheduling of background operations by avoiding conflicts with normal system operations.

    摘要翻译: 描述了用于实现在存储系统中调度后台工作流的系统的技术。 可以分析历史负载统计数据,以估计将来安排后台工作流程的未来的首选时间。 在收集与存储系统相关的负载统计信息之后,负载数据中的自然周期性模式可以被确定为从收集的数据的自相关中的峰值中选择负载数据的主要周期。 线性预测器可以形成为在确定的周期性下采样的历史数据的加权和。 可以使用诸如最小二乘法的误差最小化来确定加权的值,以便使负载预测器和测量的负载之间的误差最小化。 预测未来负载可以通过避免与正常系统操作的冲突来改善后台操作的调度。