Distributed file system having separate data and metadata and providing a consistent snapshot thereof
    1.
    发明授权
    Distributed file system having separate data and metadata and providing a consistent snapshot thereof 有权
    分布式文件系统具有单独的数据和元数据,并提供一致的快照

    公开(公告)号:US08818951B1

    公开(公告)日:2014-08-26

    申请号:US13339857

    申请日:2011-12-29

    IPC分类号: G06F17/30

    摘要: Described are techniques for creating a snapshot of a distributed file system or a file thereof. The distributed file system includes metadata file systems storing metadata about files in the distributed file system and includes data file systems storing file content data. Quiescing is performed for requests affecting the distributed file system, or a file thereof, for which a snapshot is being created. A snapshot of metadata is obtained. For the distributed file system, this includes a snapshot of each metadata file system. For a file, this includes a snapshot of the file's metadata. A snapshot of file data is obtained. For distributed file systems, this includes a snapshot of each data file system. For a file, this includes a snapshot of the file's data. Unquiescing is performed for requests affecting the distributed file system, or the file thereof, upon successful completion of obtaining snapshots of metadata and file data.

    摘要翻译: 描述了用于创建分布式文件系统或其文件的快照的技术。 分布式文件系统包括存储关于分布式文件系统中的文件的元数据的元数据文件系统,并且包括存储文件内容数据的数据文件系统。 对影响正在创建快照的分布式文件系统或其文件的请求执行静态。 获得元数据的快照。 对于分布式文件系统,这包括每个元数据文件系统的快照。 对于文件,这包括文件元数据的快照。 获取文件数据的快照。 对于分布式文件系统,这包括每个数据文件系统的快照。 对于文件,这包括文件数据的快照。 在获得元数据和文件数据的快照成功完成后,对影响分布式文件系统或其文件的请求执行不合规。

    Providing file sytem quota support for a file system having separated data and metadata
    2.
    发明授权
    Providing file sytem quota support for a file system having separated data and metadata 有权
    为具有分离的数据和元数据的文件系统提供文件系统配额支持

    公开(公告)号:US08515904B1

    公开(公告)日:2013-08-20

    申请号:US13433602

    申请日:2012-03-29

    IPC分类号: G06F17/00

    摘要: Described are techniques for performing quota management in a distributed file system. An allocation quota specifies an upper limit of storage for allocation for a quota set of the distributed file system. The distributed file system includes metadata file system(s) and data file system(s). For files in the distributed file system, metadata is stored in one of the metadata file systems and file content data is stored in the data file systems. A quota coordinator partitions the allocation quota among the data file systems. The data file systems are allocators of storage and each receives a portion of the allocation quota specifying an upper limit of storage that the data file system has available for allocation for the quota set. Storage is allocated for client requests. The storage allocation is performed by each of the data file systems in accordance with the portion of the allocation quota assigned.

    摘要翻译: 描述了在分布式文件系统中执行配额管理的技术。 分配配额指定分配文件系统配额集合的分配上限。 分布式文件系统包括元数据文件系统和数据文件系统。 对于分布式文件系统中的文件,元数据存储在元数据文件系统之一中,文件内容数据存储在数据文件系统中。 配额协调员分配数据文件系统中的配额配额。 数据文件系统是存储器的分配器,并且每个接收分配配额的一部分,其指定数据文件系统可用于配额集合的分配的上限存储。 存储被分配给客户端请求。 存储分配由每个数据文件系统根据分配的分配配额的部分来执行。

    Implicit container per version set
    3.
    发明授权
    Implicit container per version set 有权
    每个版本集隐式容器

    公开(公告)号:US07818535B1

    公开(公告)日:2010-10-19

    申请号:US11772154

    申请日:2007-06-30

    IPC分类号: G06F12/02

    摘要: When a client requests creation of a production file system or logical unit number (LUN) of storage, a sparse metavolume and a container file system built on the sparse metavolume are implicitly created for containing the production file system or LUN. By implicitly creating one container file system for each production file system or LUN, it is possible to hide the management of the container file system from the client or end user. The creation of snapshot copies in the container file system can also be hidden from the client or end user. Customer service level expectations and thin provisioning can be met automatically by storage policies implemented upon the container file system and the underlying sparse metavolume.

    摘要翻译: 当客户端请求创建存储的生产文件系统或逻辑单元号(LUN)时,会隐式创建一个稀疏Metavolume和构建在稀疏Metavolume上的容器文件系统,用于包含生产文件系统或LUN。 通过为每个生产文件系统或LUN隐式创建一个容器文件系统,可以从客户端或最终用户隐藏容器文件系统的管理。 在容器文件系统中创建快照副本也可以从客户机或最终用户隐藏。 客户服务级别期望和精简配置可以通过在容器文件系统和底层稀疏元数据库上实现的存储策略自动满足。

    Lightweight metadata sharing protocol for location transparent file access
    4.
    发明授权
    Lightweight metadata sharing protocol for location transparent file access 有权
    轻量级元数据共享协议,用于位置透明文件访问

    公开(公告)号:US09223799B1

    公开(公告)日:2015-12-29

    申请号:US13538137

    申请日:2012-06-29

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30233

    摘要: A storage processor having access to published logical unit numbers of a common block file system mounted on another storage processor processes requests for a particular file system object of the common block file system using metadata objects of the common block file system cached in both storage processors to access storage units shared between the two storage processors.

    摘要翻译: 能够访问安装在另一个存储处理器上的公共块文件系统的发布的逻辑单元号的存储处理器使用在两个存储处理器中缓存的公共块文件系统的元数据对象来处理对公共块文件系统的特定文件系统对象的请求 访问两个存储处理器之间共享的存储单元。

    Delegated reference count base file versioning
    5.
    发明授权
    Delegated reference count base file versioning 有权
    委托引用计数基础文件版本控制

    公开(公告)号:US08412688B1

    公开(公告)日:2013-04-02

    申请号:US13225224

    申请日:2011-09-02

    IPC分类号: G06F17/00

    CPC分类号: G06F17/30088

    摘要: A snapshot copy facility maintains information indicating ownership and sharing of child nodes in the hierarchy of a file between successive versions by delegating reference counts to the parent-child relationships between the nodes, as indicated by pointers in the parent nodes. When a child node becomes shared between a parent node of the production file and a parent node of a snapshot copy, the delegated reference count is split among the parent nodes. This method is compatible with a conventional data de-duplication facility, and avoids a need to update reference counts in metadata of child nodes of a shared intermediate node upon splitting the shared intermediate node when writing to a production file.

    摘要翻译: 快照复制工具通过将参考计数委托给父节点之间的父子关系来指示在连续版本之间的文件层次结构中的子节点的所有权和共享信息。 当子节点在生产文件的父节点和快照副本的父节点之间共享时,委托引用计数在父节点之间拆分。 该方法与常规的重复数据删除设备兼容,并且避免在写入生产文件时分割共享中间节点时更新共享中间节点的子节点的元数据中的引用计数。

    System and method for recovering a logical volume during failover or reboot of a file server in a data storage environment
    6.
    发明授权
    System and method for recovering a logical volume during failover or reboot of a file server in a data storage environment 有权
    在数据存储环境中的文件服务器故障切换或重启期间恢复逻辑卷的系统和方法

    公开(公告)号:US07882386B1

    公开(公告)日:2011-02-01

    申请号:US12052907

    申请日:2008-03-21

    IPC分类号: G06F11/00

    CPC分类号: G06F11/1435 G06F11/1008

    摘要: This invention is a system and a method for recovering and repairing a logical volume in a data storage environment using a new architecture. The method of recovering a logical volume enables mounting of a file system by instantiating only a single slice under the sparse volume and instantiating rest of the slices provisioned under the sparse volume in background by a asynchronous recovery process or on-demand by the clients of the file system issuing an I/O on the slice volume. The method of repairing a logical volume provides the ability to regenerate the metadata required to reconstruct the corrupted volume.

    摘要翻译: 本发明是一种使用新架构在数据存储环境中恢复和修复逻辑卷的系统和方法。 恢复逻辑卷的方法允许通过在稀疏卷下仅实例化单个切片并且在后台通过异步恢复过程或根据需要由客户端根据需要实例化在稀疏卷下提供的切片的其余部分来安装文件系统 文件系统在片卷上发出I / O。 修复逻辑卷的方法提供了重新生成重建损坏卷所需的元数据的能力。

    Creation of snapshot copies using a sparse file for keeping a record of changed blocks
    7.
    发明授权
    Creation of snapshot copies using a sparse file for keeping a record of changed blocks 有权
    使用稀疏文件创建快照副本以保存已更改块的记录

    公开(公告)号:US07870356B1

    公开(公告)日:2011-01-11

    申请号:US11678049

    申请日:2007-02-22

    IPC分类号: G06F12/00 G06F13/00

    摘要: A snapshot copy facility responds to a request for writing new data to a block of a production dataset by saving original data of the block, and writing the new data to the block of the production dataset and keeping a record of the blocks of the production dataset have been changed since the point in time when the snapshot copy was created. For detection of corruption of the snapshot metadata and for portability of the snapshot copy software, a sparse file is used for keeping a record of the blocks of the production dataset that have been changed since the snapshot. For “copy on first write” snapshots, the sparse file is a “write once read many” (WORM) file to store old data of blocks. For “remap on write” snapshots, the sparse file is a “read-write” (RW) file to which writes to the production file are stored.

    摘要翻译: 快照复制设备通过保存块的原始数据并将新数据写入生产数据集的块并保存生产数据集的块的记录来响应将新数据写入生产数据集的块的请求 自创建快照副本的时间起已经更改。 为了检测快照元数据的损坏和快照拷贝软件的可移植性,使用稀疏文件来保存自快照以来已经更改的生产数据集的块的记录。 对于“第一次写入”快照,稀疏文件是一个“写入一次读取”(WORM)文件来存储块的旧数据。 对于“重写映像”快照,稀疏文件是存储对生产文件的写入的“读写”(RW)文件。

    Accelerating file system recovery by storing file system metadata on fast persistent storage during file system recovery
    8.
    发明授权
    Accelerating file system recovery by storing file system metadata on fast persistent storage during file system recovery 有权
    通过在文件系统恢复期间将文件系统元数据存储在快速持久存储中来加速文件系统恢复

    公开(公告)号:US09069682B1

    公开(公告)日:2015-06-30

    申请号:US13538104

    申请日:2012-06-29

    申请人: Sairam Veeraswamy

    发明人: Sairam Veeraswamy

    摘要: A system and method for providing a faster disk recovery is provided by bypassing the file system cache temporarily holding a sub set of metadata objects of the file system and instead using a persistent fast storage that can be accessed at deterministic speeds to hold all the metadata objects of the file system. The system speeds recovery by only writing updated metadata objects to the persistent disk storage when file system recovery is complete.

    摘要翻译: 通过绕过文件系统缓存来暂时保存文件系统的元数据对象的子集,而不是使用可以以确定速度访问以保持所有元数据对象的持久快速存储器来提供用于提供更快的磁盘恢复的系统和方法 的文件系统。 当文件系统恢复完成时,只需将更新的元数据对象写入永久磁盘存储,系统就可以加快恢复速度。

    Tiering storage between multiple classes of storage on the same container file system
    9.
    发明授权
    Tiering storage between multiple classes of storage on the same container file system 有权
    在同一容器文件系统上的多类存储之间进行分层存储

    公开(公告)号:US08285758B1

    公开(公告)日:2012-10-09

    申请号:US11772138

    申请日:2007-06-30

    IPC分类号: G06F17/30

    摘要: Storage tiering uses file system awareness of storage class for storage allocation or migration of a storage object from one class of storage to another. For example, the storage object is a production file system, a logical unit number (LUN) of storage, or a snapshot copy of the production file system or LUN. Each storage class may comprise a different back-end disk type, such as Fiber Channel, ATA, etc. Storage allocation or migration is based on storage class to implement a storage policy, such as: (a) move snapshots off the class of storage of the production object and onto a different class of storage; (b) direct new writes to a specified class of storage; or (c) writes targeting a particular storage object are targeted to a particular class of storage.

    摘要翻译: 存储分层使用存储类的文件系统感知来存储分配或将存储对象从一类存储迁移到另一类。 例如,存储对象是生产文件系统,存储的逻辑单元号(LUN)或生产文件系统或LUN的快照副本。 每个存储类可以包括不同的后端盘类型,例如光纤通道,ATA等。存储分配或迁移基于存储类来实现存储策略,例如:(a)将快照从存储类移动 的生产对象和不同类别的存储; (b)直接对指定类别的存储进行新的写入; 或(c)针对特定存储对象的写入针对特定类别的存储。

    Methods and apparatus for creating point in time copies in a file system using reference counts
    10.
    发明授权
    Methods and apparatus for creating point in time copies in a file system using reference counts 有权
    使用引用计数在文件系统中创建时间点副本的方法和设备

    公开(公告)号:US08117160B1

    公开(公告)日:2012-02-14

    申请号:US12241715

    申请日:2008-09-30

    IPC分类号: G06F7/00

    CPC分类号: G06F17/30088

    摘要: Embodiments of the invention relate to maintaining reference counts in a file system to track when a block is available to be freed. When a snapshot copy of a file is created, rather than copying all the blocks of the file for the snapshot copy, the snapshot inode is given pointers to the blocks of the file. Rather than updating the reference counts for all these blocks to indicate that they are now in use by more than one file, the update of reference counts for at least some of these blocks may be deferred until a later time.

    摘要翻译: 本发明的实施例涉及在文件系统中维护引用计数以跟踪块何时可以被释放。 当创建文件的快照副本时,而不是复制快照副本的文件的所有块,快照inode将指向文件块。 不是更新所有这些块的引用计数,以指示它们现在被多个文件使用,所以至少这些块中的一些的引用计数的更新可以推迟到更晚的时间。