File system query and method of use
    1.
    发明授权
    File system query and method of use 有权
    文件系统查询和使用方法

    公开(公告)号:US07805416B1

    公开(公告)日:2010-09-28

    申请号:US11241053

    申请日:2005-09-30

    IPC分类号: G06F7/00

    摘要: An improved policy enforcement architecture includes several components that improve the performance of policy enforcement in a hierarchical storage environment. A File System Query instruction permits a richer set of queries to be expressed by a policy engine, thereby permitting more complex policies to be implemented with ease. The File System result is generated at the file server, and only files of interest are forwarded to the policy engine. The file system query advantageously may be applied against a pre-generated index having one more characterizing attributes to further reduce the processing required to retrieve policy data. An Index Build instruction, added to a programming interface, allows a policy engine generate the characterizing indices in advance of use. Index maintenance techniques maintain consistency between the index and the file system to ensure that the policy can be enforced using accurate file information.

    摘要翻译: 改进的策略实施体系结构包括几个可以在分层存储环境中提高策略执行性能的组件。 文件系统查询指令允许由策略引擎表达更丰富的查询集,从而允许更容易实现更复杂的策略。 文件系统结果是在文件服务器生成的,只有感兴趣的文件才转发给策略引擎。 文件系统查询有利地可以应用于具有一个更多特征属性的预先生成的索引,以进一步减少检索策略数据所需的处理。 添加到编程界面中的索引构建指令允许策略引擎在使用之前生成表征索引。 索引维护技术保持索引和文件系统之间的一致性,以确保可以使用准确的文件信息执行策略。

    Apparatus and method for building a file system index
    2.
    发明授权
    Apparatus and method for building a file system index 有权
    用于构建文件系统索引的装置和方法

    公开(公告)号:US07783615B1

    公开(公告)日:2010-08-24

    申请号:US11241132

    申请日:2005-09-30

    IPC分类号: G06F7/00

    CPC分类号: G06F17/30082 G06F17/30091

    摘要: An improved policy enforcement architecture includes several components that improve the performance of policy enforcement in a hierarchical storage environment. A File System Query instruction permits a richer set of queries to be expressed by a policy engine, thereby permitting more complex policies to be implemented with ease. The File System result is generated at the file server, and only files of interest are forwarded to the policy engine. The file system query advantageously may be applied against a pre-generated index having one more characterizing attributes to further reduce the processing required to retrieve policy data. An Index Build instruction, added to a programming interface, allows a policy engine generate the characterizing indices in advance of use. Index maintenance techniques maintain consistency between the index and the file system to ensure that the policy can be enforced using accurate file information.

    摘要翻译: 改进的策略实施体系结构包括几个可以在分层存储环境中提高策略执行性能的组件。 文件系统查询指令允许由策略引擎表达更丰富的查询集,从而允许更容易实现更复杂的策略。 文件系统结果是在文件服务器生成的,只有感兴趣的文件才转发给策略引擎。 文件系统查询有利地可以应用于具有一个更多特征属性的预先生成的索引,以进一步减少检索策略数据所需的处理。 添加到编程界面中的索引构建指令允许策略引擎在使用之前生成表征索引。 索引维护技术保持索引和文件系统之间的一致性,以确保可以使用准确的文件信息执行策略。

    Apparatus and method for maintaining a file system index
    3.
    发明授权
    Apparatus and method for maintaining a file system index 有权
    用于维护文件系统索引的装置和方法

    公开(公告)号:US08135763B1

    公开(公告)日:2012-03-13

    申请号:US11241054

    申请日:2005-09-30

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30082 G06F17/30091

    摘要: An improved policy enforcement architecture includes several components that improve the performance of policy enforcement in a hierarchical storage environment. A File System Query instruction permits a richer set of queries to be expressed by a policy engine, thereby permitting more complex policies to be implemented with ease. The File System result is generated at the file server, and only files of interest are forwarded to the policy engine. The file system query advantageously may be applied against a pre-generated index having one more characterizing attributes to further reduce the processing required to retrieve policy data. An Index Build instruction, added to a programming interface, allows a policy engine generate the characterizing indices in advance of use. Index maintenance techniques maintain consistency between the index and the file system to ensure that the policy can be enforced using accurate file information.

    摘要翻译: 改进的策略实施体系结构包括几个可以在分层存储环境中提高策略执行性能的组件。 文件系统查询指令允许由策略引擎表达更丰富的查询集,从而允许更容易实现更复杂的策略。 文件系统结果是在文件服务器生成的,只有感兴趣的文件才转发给策略引擎。 文件系统查询有利地可以应用于具有一个更多特征属性的预先生成的索引,以进一步减少检索策略数据所需的处理。 添加到编程界面中的索引构建指令允许策略引擎在使用之前生成表征索引。 索引维护技术保持索引和文件系统之间的一致性,以确保可以使用准确的文件信息执行策略。

    Methods systems, and computer program products for managing quality-of-service associated with storage shared by computing grids and clusters with a plurality of nodes
    4.
    发明授权
    Methods systems, and computer program products for managing quality-of-service associated with storage shared by computing grids and clusters with a plurality of nodes 有权
    用于管理与由多个节点计算网格和群集共享的存储相关联的服务质量的方法系统和计算机程序产品

    公开(公告)号:US08473566B1

    公开(公告)日:2013-06-25

    申请号:US11479939

    申请日:2006-06-30

    IPC分类号: G06F15/167 H04L1/00

    摘要: Methods, systems, and computer program products for managing quality of service for shared storage accessed by a plurality of nodes are disclosed. According to one method, at a node of a plurality of nodes sharing access to a first disk array, quality-of-service (QoS) metadata associated with a portion of the disk array are requested from a server, wherein the QoS metadata includes at least one performance criterion for the portion of the disk array. I/O performance is monitored for the portion of the disk array in response to receiving the QoS metadata. The monitored I/O performance is compared with the QoS metadata. Based upon the comparison of the monitored I/O performance with the QoS metadata, it is determined whether a QoS violation has occurred. In response to determining that a QoS violation has occurred, the server is requested to migrate data associated with the portion of the disk array.

    摘要翻译: 公开了用于管理由多个节点访问的共享存储器的服务质量的方法,系统和计算机程序产品。 根据一种方法,在共享对第一磁盘阵列的访问的多个节点的节点处,从服务器请求与所述磁盘阵列的一部分相关联的服务质量(QoS)元数据,其中所述QoS元数据包括在 磁盘阵列部分的至少一个性能标准。 响应于接收到QoS元数据,对磁盘阵列的部分监视I / O性能。 将监视的I / O性能与QoS元数据进行比较。 基于所监视的I / O性能与QoS元数据的比较,确定是否发生QoS冲突。 响应于确定已经发生QoS冲突,请求服务器迁移与磁盘阵列的一部分相关联的数据。

    Metadata pipelining and optimization in a file server
    6.
    发明授权
    Metadata pipelining and optimization in a file server 有权
    文件服务器中的元数据流水线和优化

    公开(公告)号:US07822728B1

    公开(公告)日:2010-10-26

    申请号:US11557941

    申请日:2006-11-08

    IPC分类号: G06F7/00 G06F17/00

    摘要: A read-write access to a file in a file server includes an initial metadata access step, an asynchronous read or write of file data, and a metadata commit step. In order to parallelize access to a range locking database, an inode and indirect file block mapping database, and a pre-allocation data base, operations are pipelined within the metadata access step and also within the metadata commit step. The pipelined operations within the metadata access step include a first stage of range locking, a second stage of reading block mapping metadata, and a third stage of reading and updating a pre-allocation map for write access. The pipelined operations within the metadata commit step include a first stage of releasing range locks, a second stage of accessing old block metadata for write access, and a third stage of updating metadata and flushing the pre-allocation map for write access.

    摘要翻译: 对文件服务器中的文件的读写访问包括初始元数据访问步骤,文件数据的异步读取或写入以及元数据提交步骤。 为了并行访问范围锁定数据库,inode和间接文件块映射数据库以及预分配数据库,操作在元数据访问步骤内以及元数据提交步骤中流水线化。 元数据访问步骤中的流水线操作包括范围锁定的第一阶段,读取块映射元数据的第二阶段以及读取和更新用于写访问的预分配映射的第三阶段。 元数据提交步骤中的流水线操作包括释放范围锁的第一阶段,访问用于写入访问的旧块元数据的第二阶段,以及更新元数据的第三阶段以及刷新用于写访问的预分配映射。

    Distributed maintenance of snapshot copies by a primary processor managing metadata and a secondary processor providing read-write access to a production dataset
    7.
    发明授权
    Distributed maintenance of snapshot copies by a primary processor managing metadata and a secondary processor providing read-write access to a production dataset 有权
    由管理元数据的主处理器分发维护快照副本,以及向生产数据集提供读写访问的辅助处理器

    公开(公告)号:US07676514B2

    公开(公告)日:2010-03-09

    申请号:US11382193

    申请日:2006-05-08

    IPC分类号: G06F7/00 G06F17/00 G06F13/00

    摘要: A primary processor manages metadata of a production dataset and a snapshot copy, while a secondary processor provides concurrent read-write access to the primary dataset. The secondary processor determines when a first write is being made to a data block of the production dataset, and in this case sends a metadata change request to the primary data processor. The primary data processor commits the metadata change to the production dataset and maintains the snapshot copy while the secondary data processor continues to service other read-write requests. The secondary processor logs metadata changes so that the secondary processor may return a “write completed” message before the primary processor commits the metadata change. The primary data processor pre-allocates data storage blocks in such a way that the “write anywhere” method does not result in a gradual degradation in I/O performance.

    摘要翻译: 主处理器管理生产数据集和快照副本的元数据,而辅助处理器提供对主数据集的并发读写访问。 第二处理器确定何时对生产数据集的数据块进行第一次写入,并且在这种情况下向主数据处理器发送元数据改变请求。 主数据处理器将元数据更改提交给生产数据集,并在辅助数据处理器继续服务其他读写请求时维护快照副本。 次要处理器记录元数据更改,以便辅助处理器可能在主处理器提交元数据更改之前返回“写入完成”消息。 主数据处理器预先分配数据存储块,使得“在任何地方写入”方法不会导致I / O性能逐渐降级。

    Storage array virtualization using a storage block mapping protocol client and server
    8.
    发明授权
    Storage array virtualization using a storage block mapping protocol client and server 有权
    存储阵列虚拟化使用存储块映射协议客户端和服务器

    公开(公告)号:US07653832B2

    公开(公告)日:2010-01-26

    申请号:US11382233

    申请日:2006-05-08

    IPC分类号: G06F11/00

    摘要: A cached disk array includes a disk storage array, a global cache memory, disk directors coupling the cache memory to the disk storage array, and front-end directors for linking host computers to the cache memory. The front-end directors service storage access requests from the host computers, and the disk directors stage requested data from the disk storage array to the cache memory and write new data to the disk storage. At least one of the front-end directors or disk directors is programmed for block resolution of virtual logical units of the disk storage, and for obtaining, from a storage allocation server, space allocation and mapping information for pre-allocated blocks of the disk storage, and for returning to the storage allocation server requests to commit the pre-allocated blocks of storage once data is first written to the pre-allocated blocks of storage.

    摘要翻译: 缓存的磁盘阵列包括磁盘存储阵列,全局高速缓冲存储器,将高速缓存存储器耦合到磁盘存储阵列的磁盘引导器以及用于将主计算机连接到高速缓冲存储器的前端引导器。 前端总监从主机服务存储访问请求,并且磁盘控制器将请求的数据从磁盘存储阵列请求到高速缓冲存储器,并将新数据写入磁盘存储器。 前端指导器或磁盘引导器中的至少一个被编程用于磁盘存储器的虚拟逻辑单元的块分辨率,并且用于从存储分配服务器获得用于磁盘存储器的预分配块的空间分配和映射信息 并且一旦数据被首先写入到预先分配的存储块中,则返回到存储分配服务器请求提交预先分配的存储块。

    Pre-allocation and hierarchical mapping of data blocks distributed from a first processor to a second processor for use in a file system
    9.
    发明授权
    Pre-allocation and hierarchical mapping of data blocks distributed from a first processor to a second processor for use in a file system 有权
    从第一处理器分配到第二处理器的数据块的预分配和分层映射,用于文件系统

    公开(公告)号:US07945726B2

    公开(公告)日:2011-05-17

    申请号:US11382075

    申请日:2006-05-08

    IPC分类号: G06F12/00

    摘要: In a data processing system, a first processor pre-allocates data blocks for use in a file system at a later time when a second processor needs data blocks for extending the file system. The second processor selectively maps the logical addresses of the pre-allocated blocks so that when the pre-allocated blocks are used in the file system, the layout of the file system on disk is improved to avoid block scatter and enhance I/O performance. The selected mapping can be done at a program layer between a conventional file system manager and a conventional logical volume layer so that there is no need to modify the data block mapping mechanism of the file system manager or the logical volume layer. The data blocks can be pre-allocated adaptively in accordance with the allocation history of the file system.

    摘要翻译: 在数据处理系统中,当第二处理器需要用于扩展文件系统的数据块时,第一处理器在稍后的时间预分配用于文件系统的数据块。 第二处理器选择性地映射预分配块的逻辑地址,使得当在文件系统中使用预先分配的块时,改进了盘上的文件系统的布局,以避免块散射和增强I / O性能。 所选择的映射可以在常规文件系统管理器和常规逻辑卷层之间的程序层完成,使得不需要修改文件系统管理器或逻辑卷层的数据块映射机制。 数据块可以根据文件系统的分配历史自适应地预分配。

    Method and apparatus for performing bulk file system attribute retrieval
    10.
    发明授权
    Method and apparatus for performing bulk file system attribute retrieval 有权
    用于执行批量文件系统属性检索的方法和装置

    公开(公告)号:US08560569B2

    公开(公告)日:2013-10-15

    申请号:US11341353

    申请日:2006-01-27

    IPC分类号: G06F17/30

    摘要: Accordingly a method and interface allows an attribute data base used by an Information Manager to be quickly populated and accurately maintained. A single Bulk Attribute Retrieval Request triggers the primary storage device to collect object attribute information. The method allows for selective collection of objects and attributes by providing filters and attribute lists in the Requests. The Request may be used to provide an incremental scan with appropriate time stamp filtering. In addition, the size of the results can be controlled by the IM by eliminating attributes that are not of interest to the IM. The Request is advantageously issued over a FileMover interface, which is an HTTP connection, and encoded in XML, allowing the IM to easily customize the Request as desired.

    摘要翻译: 因此,方法和接口允许快速填充并准确地维护信息管理器使用的属性数据库。 单个批量属性检索请求触发主存储设备收集对象属性信息。 该方法允许通过在请求中提供过滤器和属性列表来选择性地收集对象和属性。 请求可用于通过适当的时间戳过滤提供增量扫描。 此外,结果的大小可以通过IM消除IM不感兴趣的属性来控制。 该请求有利地通过FileMover接口发布,该接口是HTTP连接,并以XML编码,允许IM根据需要容易地定制请求。