Metadata pipelining and optimization in a file server
    3.
    发明授权
    Metadata pipelining and optimization in a file server 有权
    文件服务器中的元数据流水线和优化

    公开(公告)号:US07822728B1

    公开(公告)日:2010-10-26

    申请号:US11557941

    申请日:2006-11-08

    IPC分类号: G06F7/00 G06F17/00

    摘要: A read-write access to a file in a file server includes an initial metadata access step, an asynchronous read or write of file data, and a metadata commit step. In order to parallelize access to a range locking database, an inode and indirect file block mapping database, and a pre-allocation data base, operations are pipelined within the metadata access step and also within the metadata commit step. The pipelined operations within the metadata access step include a first stage of range locking, a second stage of reading block mapping metadata, and a third stage of reading and updating a pre-allocation map for write access. The pipelined operations within the metadata commit step include a first stage of releasing range locks, a second stage of accessing old block metadata for write access, and a third stage of updating metadata and flushing the pre-allocation map for write access.

    摘要翻译: 对文件服务器中的文件的读写访问包括初始元数据访问步骤,文件数据的异步读取或写入以及元数据提交步骤。 为了并行访问范围锁定数据库,inode和间接文件块映射数据库以及预分配数据库,操作在元数据访问步骤内以及元数据提交步骤中流水线化。 元数据访问步骤中的流水线操作包括范围锁定的第一阶段,读取块映射元数据的第二阶段以及读取和更新用于写访问的预分配映射的第三阶段。 元数据提交步骤中的流水线操作包括释放范围锁的第一阶段,访问用于写入访问的旧块元数据的第二阶段,以及更新元数据的第三阶段以及刷新用于写访问的预分配映射。

    Distributed maintenance of snapshot copies by a primary processor managing metadata and a secondary processor providing read-write access to a production dataset
    4.
    发明授权
    Distributed maintenance of snapshot copies by a primary processor managing metadata and a secondary processor providing read-write access to a production dataset 有权
    由管理元数据的主处理器分发维护快照副本,以及向生产数据集提供读写访问的辅助处理器

    公开(公告)号:US07676514B2

    公开(公告)日:2010-03-09

    申请号:US11382193

    申请日:2006-05-08

    IPC分类号: G06F7/00 G06F17/00 G06F13/00

    摘要: A primary processor manages metadata of a production dataset and a snapshot copy, while a secondary processor provides concurrent read-write access to the primary dataset. The secondary processor determines when a first write is being made to a data block of the production dataset, and in this case sends a metadata change request to the primary data processor. The primary data processor commits the metadata change to the production dataset and maintains the snapshot copy while the secondary data processor continues to service other read-write requests. The secondary processor logs metadata changes so that the secondary processor may return a “write completed” message before the primary processor commits the metadata change. The primary data processor pre-allocates data storage blocks in such a way that the “write anywhere” method does not result in a gradual degradation in I/O performance.

    摘要翻译: 主处理器管理生产数据集和快照副本的元数据,而辅助处理器提供对主数据集的并发读写访问。 第二处理器确定何时对生产数据集的数据块进行第一次写入,并且在这种情况下向主数据处理器发送元数据改变请求。 主数据处理器将元数据更改提交给生产数据集,并在辅助数据处理器继续服务其他读写请求时维护快照副本。 次要处理器记录元数据更改,以便辅助处理器可能在主处理器提交元数据更改之前返回“写入完成”消息。 主数据处理器预先分配数据存储块,使得“在任何地方写入”方法不会导致I / O性能逐渐降级。

    Storage array virtualization using a storage block mapping protocol client and server
    5.
    发明授权
    Storage array virtualization using a storage block mapping protocol client and server 有权
    存储阵列虚拟化使用存储块映射协议客户端和服务器

    公开(公告)号:US07653832B2

    公开(公告)日:2010-01-26

    申请号:US11382233

    申请日:2006-05-08

    IPC分类号: G06F11/00

    摘要: A cached disk array includes a disk storage array, a global cache memory, disk directors coupling the cache memory to the disk storage array, and front-end directors for linking host computers to the cache memory. The front-end directors service storage access requests from the host computers, and the disk directors stage requested data from the disk storage array to the cache memory and write new data to the disk storage. At least one of the front-end directors or disk directors is programmed for block resolution of virtual logical units of the disk storage, and for obtaining, from a storage allocation server, space allocation and mapping information for pre-allocated blocks of the disk storage, and for returning to the storage allocation server requests to commit the pre-allocated blocks of storage once data is first written to the pre-allocated blocks of storage.

    摘要翻译: 缓存的磁盘阵列包括磁盘存储阵列,全局高速缓冲存储器,将高速缓存存储器耦合到磁盘存储阵列的磁盘引导器以及用于将主计算机连接到高速缓冲存储器的前端引导器。 前端总监从主机服务存储访问请求,并且磁盘控制器将请求的数据从磁盘存储阵列请求到高速缓冲存储器,并将新数据写入磁盘存储器。 前端指导器或磁盘引导器中的至少一个被编程用于磁盘存储器的虚拟逻辑单元的块分辨率,并且用于从存储分配服务器获得用于磁盘存储器的预分配块的空间分配和映射信息 并且一旦数据被首先写入到预先分配的存储块中,则返回到存储分配服务器请求提交预先分配的存储块。

    Pre-allocation and hierarchical mapping of data blocks distributed from a first processor to a second processor for use in a file system
    6.
    发明授权
    Pre-allocation and hierarchical mapping of data blocks distributed from a first processor to a second processor for use in a file system 有权
    从第一处理器分配到第二处理器的数据块的预分配和分层映射,用于文件系统

    公开(公告)号:US07945726B2

    公开(公告)日:2011-05-17

    申请号:US11382075

    申请日:2006-05-08

    IPC分类号: G06F12/00

    摘要: In a data processing system, a first processor pre-allocates data blocks for use in a file system at a later time when a second processor needs data blocks for extending the file system. The second processor selectively maps the logical addresses of the pre-allocated blocks so that when the pre-allocated blocks are used in the file system, the layout of the file system on disk is improved to avoid block scatter and enhance I/O performance. The selected mapping can be done at a program layer between a conventional file system manager and a conventional logical volume layer so that there is no need to modify the data block mapping mechanism of the file system manager or the logical volume layer. The data blocks can be pre-allocated adaptively in accordance with the allocation history of the file system.

    摘要翻译: 在数据处理系统中,当第二处理器需要用于扩展文件系统的数据块时,第一处理器在稍后的时间预分配用于文件系统的数据块。 第二处理器选择性地映射预分配块的逻辑地址,使得当在文件系统中使用预先分配的块时,改进了盘上的文件系统的布局,以避免块散射和增强I / O性能。 所选择的映射可以在常规文件系统管理器和常规逻辑卷层之间的程序层完成,使得不需要修改文件系统管理器或逻辑卷层的数据块映射机制。 数据块可以根据文件系统的分配历史自适应地预分配。

    Lock management for concurrent access to a single file from multiple data mover computers
    7.
    发明授权
    Lock management for concurrent access to a single file from multiple data mover computers 有权
    锁定管理以从多个数据移动器计算机并发访问单个文件

    公开(公告)号:US07315926B2

    公开(公告)日:2008-01-01

    申请号:US10945654

    申请日:2004-09-21

    IPC分类号: G06F13/00 G06F12/00

    摘要: A protocol is provided for allocating file locking tasks between primary and secondary data mover computers in a network file server. When there is frequent read access and infrequent write access to a file, a primary data mover grants read locks to the entire file to secondary data movers, and the secondary data movers grant read locks to clients requesting read access. When write access to the file is needed, the read locks to the entire file are released and the read locks granted to the clients are released or expire or are demoted to non-conflicting byte range locks managed by the primary data mover. Concurrent read and write access to the same file is then managed by the primary data mover.

    摘要翻译: 提供了一种协议,用于在网络文件服务器中的主要和次要数据移动计算机之间分配文件锁定任务。 当对文件进行频繁的读取访问和不频繁的写入访问时,主数据移动器将授予对整个文件的读取锁定到辅助数据移动器,次要数据移动器将向读取访问权限的客户端授予读取锁定。 当需要对文件进行写入访问时,释放对整个文件的读取锁定,授予客户端的读取锁定将被释放或过期或降级到由主数据移动器管理的非冲突字节范围锁定。 然后由主数据移动器管理对同一文件的并发读写访问。

    File system query and method of use
    8.
    发明授权
    File system query and method of use 有权
    文件系统查询和使用方法

    公开(公告)号:US07805416B1

    公开(公告)日:2010-09-28

    申请号:US11241053

    申请日:2005-09-30

    IPC分类号: G06F7/00

    摘要: An improved policy enforcement architecture includes several components that improve the performance of policy enforcement in a hierarchical storage environment. A File System Query instruction permits a richer set of queries to be expressed by a policy engine, thereby permitting more complex policies to be implemented with ease. The File System result is generated at the file server, and only files of interest are forwarded to the policy engine. The file system query advantageously may be applied against a pre-generated index having one more characterizing attributes to further reduce the processing required to retrieve policy data. An Index Build instruction, added to a programming interface, allows a policy engine generate the characterizing indices in advance of use. Index maintenance techniques maintain consistency between the index and the file system to ensure that the policy can be enforced using accurate file information.

    摘要翻译: 改进的策略实施体系结构包括几个可以在分层存储环境中提高策略执行性能的组件。 文件系统查询指令允许由策略引擎表达更丰富的查询集,从而允许更容易实现更复杂的策略。 文件系统结果是在文件服务器生成的,只有感兴趣的文件才转发给策略引擎。 文件系统查询有利地可以应用于具有一个更多特征属性的预先生成的索引,以进一步减少检索策略数据所需的处理。 添加到编程界面中的索引构建指令允许策略引擎在使用之前生成表征索引。 索引维护技术保持索引和文件系统之间的一致性,以确保可以使用准确的文件信息执行策略。

    Apparatus and method for building a file system index
    9.
    发明授权
    Apparatus and method for building a file system index 有权
    用于构建文件系统索引的装置和方法

    公开(公告)号:US07783615B1

    公开(公告)日:2010-08-24

    申请号:US11241132

    申请日:2005-09-30

    IPC分类号: G06F7/00

    CPC分类号: G06F17/30082 G06F17/30091

    摘要: An improved policy enforcement architecture includes several components that improve the performance of policy enforcement in a hierarchical storage environment. A File System Query instruction permits a richer set of queries to be expressed by a policy engine, thereby permitting more complex policies to be implemented with ease. The File System result is generated at the file server, and only files of interest are forwarded to the policy engine. The file system query advantageously may be applied against a pre-generated index having one more characterizing attributes to further reduce the processing required to retrieve policy data. An Index Build instruction, added to a programming interface, allows a policy engine generate the characterizing indices in advance of use. Index maintenance techniques maintain consistency between the index and the file system to ensure that the policy can be enforced using accurate file information.

    摘要翻译: 改进的策略实施体系结构包括几个可以在分层存储环境中提高策略执行性能的组件。 文件系统查询指令允许由策略引擎表达更丰富的查询集,从而允许更容易实现更复杂的策略。 文件系统结果是在文件服务器生成的,只有感兴趣的文件才转发给策略引擎。 文件系统查询有利地可以应用于具有一个更多特征属性的预先生成的索引,以进一步减少检索策略数据所需的处理。 添加到编程界面中的索引构建指令允许策略引擎在使用之前生成表征索引。 索引维护技术保持索引和文件系统之间的一致性,以确保可以使用准确的文件信息执行策略。

    Metadata offload for a file server cluster
    10.
    发明授权
    Metadata offload for a file server cluster 有权
    文件服务器集群的元数据卸载

    公开(公告)号:US07617216B2

    公开(公告)日:2009-11-10

    申请号:US11220780

    申请日:2005-09-07

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30194 G06F17/30082

    摘要: A file server system has a cluster of server computers that share access to a file system in shared storage. One of the server computers has primary responsibility for management of access to the file system. In order to reduce the possibility of primary server overload when a large number of the clients happen to concurrently access the same file system, most metadata processing operations are offloaded to secondary server computers. This also facilitates recovery from failure of a primary server computer since only a fraction of the ongoing metadata operations of a primary server computer is interrupted by a failure of the primary server computer. For example, a secondary data mover may truncate, delete, create, or rename a file in response to a client request.

    摘要翻译: 文件服务器系统具有共享对共享存储器中的文件系统的访问的服务器计算机集群。 其中一台服务器计算机主要负责管理对文件系统的访问。 为了减少当大量客户端并发访问同一文件系统时主服务器过载的可能性,大多数元数据处理操作都被卸载到辅助服务器计算机。 这还有助于从主服务器计算机的故障恢复,因为主服务器计算机的正在进行的元数据操作的一小部分被主服务器计算机的故障中断。 例如,辅助数据移动器可以截断,删除,创建或重命名文件以响应客户端请求。