Dense file reservation in thinly provisioned file system

    公开(公告)号:US11100050B1

    公开(公告)日:2021-08-24

    申请号:US14501522

    申请日:2014-09-30

    申请人: EMC Corporation

    IPC分类号: G06F3/06 G06F16/17 G06F16/13

    摘要: A data storage system operates a file system as a thinly provisioned file system having a host-visible virtual space and a smaller allocated space of underlying physical storage from a pool. The file system applies formatting to the allocated space and utilizes formatted allocated space for storing host files. The file system receives a file I/O request that requires increasing the allocated space of the file system, and in response (1) obtains an extent of physical storage from the pool and adds it to the file system as added allocated space, and (2) formats an initial portion of the added allocated space and satisfies the file I/O request using the formatted initial portion. Over a subsequent period the file system incrementally formats additional portions of the added allocated space and satisfies subsequent file I/O requests from the added portions.

    Preserving quality of service when replicating data objects

    公开(公告)号:US11023488B1

    公开(公告)日:2021-06-01

    申请号:US14576939

    申请日:2014-12-19

    申请人: EMC Corporation

    IPC分类号: G06F17/00 G06F16/27 H04L29/08

    摘要: A technique for replicating a data object from a source data storage system (source) to a destination data storage system (destination) preserves QoS (Quality of Service) by transmitting QoS information from the source to the destination and applying the QoS information when storing data at the destination that arrive in replication instructions sent from the source. The QoS information indicates desired storage tiering for the data object at the source. In the event of a failure at the source, which results in failover from the source to the destination, the destination is able to provide users with the same quality of service as was desired at the source.

    File system version set infrastructure

    公开(公告)号:US09778996B1

    公开(公告)日:2017-10-03

    申请号:US14319602

    申请日:2014-06-30

    申请人: EMC Corporation

    IPC分类号: G06F17/30 G06F11/14

    摘要: A technique for managing file systems assigns groups of related files in a file system to respective version sets. Each version set includes all files of a file system that are related to one another by one or more snapshot operations. The technique provides a version set database, which stores, in connection with each version set, an identifier of each file that belongs to the respective version set. In an example, file system operations that require information about block sharing can perform lookup operations on the version set database to narrow the scope of files that are candidates for block sharing to those of a particular version set.

    Efficient scavenging of data and metadata file system blocks
    4.
    发明授权
    Efficient scavenging of data and metadata file system blocks 有权
    高效清理数据和元数据文件系统块

    公开(公告)号:US09430492B1

    公开(公告)日:2016-08-30

    申请号:US13929887

    申请日:2013-06-28

    申请人: EMC Corporation

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30221

    摘要: An improved technique involves identifying the location of backed free blocks, i.e., blocks within an upper deck file system that have been provisioned from storage devices of a data storage system to a lower deck file system, allocated from the lower deck file system to the upper deck file system, and later freed from the upper deck file system. A storage processor accesses a set of data structures that identifies backed free blocks as opposed to free blocks that have not been written into and thus do not correspond to any allocated blocks in storage. Once the storage processor identifies the backed free blocks, the storage processor frees each block in the lower deck file system from which the respective backed free block was allocated. The storage processor then updates the set of data structures to indicate that the respective backed free block is now simply a free block.

    摘要翻译: 一种改进的技术涉及识别后备空闲块的位置,即从上层文件系统中已经从数据存储系统的存储设备提供给下甲板文件系统的块,从下甲板文件系统分配给上层文件系统 甲板文件系统,后来从上甲板文件系统中释放出来。 存储处理器访问一组标识后备空闲块的数据结构,而不是尚未写入的空闲块,因此与存储中的任何分配块不对应。 一旦存储处理器识别出后备空闲块,则存储处理器将分配相应的后备空闲块的下层文件系统中的每个块释放。 然后,存储处理器更新数据结构集合,以指示相应的后备空闲块现在仅仅是空闲块。

    System and method for thin provisioning
    5.
    发明授权
    System and method for thin provisioning 有权
    用于精简配置的系统和方法

    公开(公告)号:US09317419B1

    公开(公告)日:2016-04-19

    申请号:US13837063

    申请日:2013-03-15

    申请人: EMC Corporation

    IPC分类号: G06F12/02 G06F17/30 G06F3/06

    摘要: A method, computer program product, and computing system for grouping storage blocks within a file system into a plurality of storage pools including a free-backed storage pool, a free-unbacked storage pool, and an allocated-backed storage pool. The free-backed storage pool identifies unused storage blocks within the file system that are already associated with physical storage space within a backend storage system. The free-unbacked storage pool identifies unused storage blocks within the file system that are not yet associated with physical storage space within the backend storage system. The allocated-backed storage pool identifies used storage blocks within the file system that are already associated with physical storage space within the backend storage system. A request is received for one or more unused storage blocks within the file system. The request is fulfilled by selecting one or more unused storage blocks identified within the storage pools while prioritizing the selection of unused storage blocks identified within the free-backed storage pool.

    摘要翻译: 一种用于将文件系统内的存储块分组成多个存储池的方法,计算机程序产品和计算系统,所述多个存储池包括自由备份存储池,自由未备份的存储池和分配的备份存储池。 自由备份的存储池标识文件系统中已经与后端存储系统中的物理存储空间相关联的未使用的存储块。 自由未回储的存储池标识文件系统中尚未与后端存储系统中的物理存储空间相关联的未使用的存储块。 分配的备份存储池标识文件系统中已经与后端存储系统中的物理存储空间相关联的已使用的存储块。 接收到文件系统内的一个或多个未使用的存储块的请求。 通过选择在存储池中识别的一个或多个未使用的存储块来实现该请求,同时优先考虑在自由备份的存储池内识别的未使用的存储块的选择。

    Managing truncation of files of file systems

    公开(公告)号:US10242011B1

    公开(公告)日:2019-03-26

    申请号:US14870514

    申请日:2015-09-30

    申请人: EMC Corporation

    IPC分类号: G06F17/30 G06F3/06

    摘要: A method is used in managing truncation of files of file systems. A request is received to delete a portion of a file of a file system. A replica of the file is created. The replica represents a state of the file at a particular prior point in time. The replica shares a set of file system blocks of the file with the file. The portion of the file is deleted by updating metadata of the file. The replica of the file is asynchronously deleted in background by de-allocating the set of file system blocks.

    Filesystem storing file data in larger units than used for metadata

    公开(公告)号:US10127236B1

    公开(公告)日:2018-11-13

    申请号:US13928972

    申请日:2013-06-27

    申请人: EMC Corporation

    IPC分类号: G06F12/00 G06F13/30 G06F17/30

    摘要: A method is provided for storing files in a filesystem of a data storage system. The method includes (a) storing data of each file of a set of files of the filesystem in a set of data allocation units (AUs) of the filesystem on the data storage system, each data AU of the set of data AUs having a common data AU size, and (b) storing metadata pertaining to each file of the set of files in a set of metadata AUs of the filesystem on the data storage system, each metadata AU of the set of metadata AUs having a common metadata AU size, the common data AU size being larger than the common metadata AU size. A computerized apparatus and a computer program product are also provided for performing a method similar to that described above.

    Coalescing transactional same-block writes for virtual block maps
    10.
    发明授权
    Coalescing transactional same-block writes for virtual block maps 有权
    为虚拟块映射合并事务相同块写入

    公开(公告)号:US09430503B1

    公开(公告)日:2016-08-30

    申请号:US13929999

    申请日:2013-06-28

    申请人: EMC Corporation

    IPC分类号: G06F17/30

    摘要: A technique for preserving metadata changes in a transaction log involves coalescing metadata changes based on the block of storage in which the metadata to be changed resides. Metadata change information that accompanies a file system command is stored in nodes of a searchable data structure, wherein each node accumulates metadata changes for a respective block of storage. Once all metadata changes are specified in the searchable data structure, or after some threshold number of metadata changes have been stored, the storage processor composes a transaction for each node summarizing the metadata changes and writes the transaction to the transaction log.

    摘要翻译: 用于在事务日志中保存元数据更改的技术涉及根据要更改的元数据所在的存储块来合并元数据更改。 文件系统命令附带的元数据更改信息存储在可搜索数据结构的节点中,其中每个节点累积相应的存储块的元数据改变。 一旦在可搜索数据结构中指定了所有元数据更改,或者在已经存储了一些阈值数量的元数据更改之后,存储处理器将为总结元数据更改的每个节点组合事务,并将事务写入事务日志。