公开(公告)号：US09280578B1

公开(公告)日：2016-03-08

申请号：US13931979

申请日：2013-06-30

申请人： EMC Corporation

发明人： Yingchao Zhou ,  William C. Davenport ,  Jia Zhai

IPC分类号： G06F17/30 ,  G06F17/00

CPC分类号： G06F17/30227 ,  G06F17/30171

摘要： Techniques are provided involving combining several concurrent changes into one consistent condensed transaction within a metadata transaction log using an accumulation list that can be processed to generate a single transaction which may be quickly stored in the metadata transaction log. The improved techniques thus reduce latencies for later concurrent changes and save space within the metadata transaction log.

摘要翻译： 提供了技术，其涉及使用可被处理以生成可以快速存储在元数据事务日志中的单个事务的累积列表将几个并发变更组合成一个一致的精简事务。 因此，改进的技术可以减少稍后并发更改的延迟并节省元数据事务日志中的空间。

公开(公告)号：US09256603B1

公开(公告)日：2016-02-09

申请号：US13931757

申请日：2013-06-28

申请人： EMC Corporation

发明人： Jean-Pierre Bono ,  William C. Davenport ,  Miles A. de Forest ,  Walter C. Forrester ,  Michal Marko ,  Ye Zhang ,  Philippe Armangau

IPC分类号： G06F12/00 ,  G06F17/30

CPC分类号： G06F17/30067 ,  G06F17/30197

摘要： A data storage system includes storage devices and a processing subsystem executing software forming a lower-deck file system and an upper-deck file system. The lower-deck file system presents a volume file from which storage is provided to the upper-deck file system, and units of storage of the storage devices are reserved to the upper-deck file system. The volume file is fully provisioned based on the reserved units of storage so that an out-of-space condition is not presented to the upper-deck file system. Reserved units of storage are dynamically added to the volume file to increase its allocated size in response to demand from the upper-deck file system, and a direct operating mode is used in which a block address in the lower-deck file system is obtained by a predetermined calculation from a corresponding block address in the volume file.

摘要翻译： 数据存储系统包括存储设备和执行形成下层文件系统和上层文件系统的软件的处理子系统。 下层文件系统提供一个卷文件，从该文件向上层文件系统提供存储，存储设备的存储单位保留给上层文件系统。 卷文件基于保留的存储单元完全配置，使得空格不足的条件不会呈现给上层文件系统。 保留的存储单元被动态地添加到卷文件中以根据来自上层文件系统的需求增加其分配的大小，并且使用直接操作模式，其中下层文件系统中的块地址由 来自卷文件中的对应块地址的预定计算。

公开(公告)号：US10387369B1

公开(公告)日：2019-08-20

申请号：US14319128

申请日：2014-06-30

申请人： EMC Corporation

发明人： William C. Davenport ,  Philippe Armangau ,  Junping Frank Zhao

IPC分类号： G06F17/30 ,  G06F16/11

摘要： A method is used in managing file deletions in storage systems. A request to delete a portion of a file of a file system is received. A first indirect block is associated with the portion of the file and includes a set of file system blocks. A second indirect block associated with a replica of the file is identified. The first and second indirect blocks share a subset of the set of file system blocks. The replica of the file represents a state of the file at a particular prior point in time. Metadata of the second indirect block is updated indicating that the subset of the set of file system blocks are no longer shared between the first and second indirect blocks.

公开(公告)号：US10146782B1

公开(公告)日：2018-12-04

申请号：US14755248

申请日：2015-06-30

申请人： EMC Corporation

发明人： Jean-Pierre Bono ,  William C. Davenport ,  George Danforth McNair, Jr.

IPC分类号： G06F17/00 ,  G06F17/30

摘要： In one embodiment, a method is performed by a computing device configured to manage a filesystem stored on persistent storage. The method includes (a) receiving a command to delete a range of a file of the filesystem, (b) removing blocks of the range from being accessible to the filesystem as part of the file, (c) overwriting a block of the range using a secure erasure technique, and (d) subsequent to overwriting the block, freeing the block for re-use by the filesystem. A data storage system, apparatus, and computer program product for performing a similar method are also provided.

公开(公告)号：US09842117B1

公开(公告)日：2017-12-12

申请号：US14584464

申请日：2014-12-29

申请人： EMC Corporation

发明人： Yingchao Zhou ,  Jean-Pierre Bono ,  Changxin Liu ,  William C. Davenport ,  Philippe Armangau ,  Jia Zhai

IPC分类号： G06F17/00 ,  G06F17/30

CPC分类号： G06F17/30174 ,  G06F17/30088

摘要： A method is used in managing replication of file systems. Metadata of a set of slices of a file system is updated upon performing an operation on a slice of the file system. The file system includes the set of slices. The metadata of the set of slices is used for recovering the file system.

公开(公告)号：US09400792B1

公开(公告)日：2016-07-26

申请号：US13928591

申请日：2013-06-27

申请人： EMC Corporation

发明人： Jean-Pierre Bono ,  William C. Davenport ,  Miles A. de Forest ,  Philippe Armangau ,  Michael Scheer ,  Morgan Clark ,  Ahsan Rashid

IPC分类号： G06F17/30 ,  G06F3/06 ,  G06F9/50

CPC分类号： G06F17/30082 ,  G06F3/0604 ,  G06F9/5016

摘要： A technique for managing storage tiering in a data storage apparatus operates at a fine level of granularity in response to write requests as blocks are allocated for writing. As write requests arrive or are otherwise processed by the data storage apparatus, the data storage apparatus identifies a quality of service to be provided for satisfying each write request and allocates a set of blocks from storage devices of storage tiers that provide the identified quality of service. The data storage apparatus may then store the information specified in the write request in the newly allocated blocks.

摘要翻译： 用于管理数据存储装置中的存储分层的技术响应于写入请求以精细的粒度进行操作，因为块被分配用于写入。 当写请求到达或由数据存储装置另外处理时，数据存储装置识别要提供用于满足每个写请求的服务质量，并从提供所识别的服务质量的存储层的存储装置分配一组块 。 然后，数据存储装置可以将新写入请求中指定的信息存储在新分配的块中。

公开(公告)号：US10242012B1

公开(公告)日：2019-03-26

申请号：US14870556

申请日：2015-09-30

申请人： EMC Corporation

发明人： Ivan Basov ,  Philippe Armangau ,  William C. Davenport

IPC分类号： G06F17/30 ,  G06F3/06

摘要： A method is used in managing truncation of files of file systems. A request is received to delete a portion of a file of a file system. A set of extents associated with the portion of the file is determined where the file has been identified for deletion. A replica of the set of extents is created. The replica represents a state of the set of extents at a particular prior point in time. The portion of the file is deleted by updating metadata of the file. The replica is asynchronously deleted in background.

公开(公告)号：US09690837B1

公开(公告)日：2017-06-27

申请号：US13930819

申请日：2013-06-28

申请人： EMC Corporation

发明人： William C. Davenport ,  Marc DeSouter

IPC分类号： G06F13/22 ,  G06F17/30

CPC分类号： G06F17/30575

摘要： A method is provided for preserving redundant copies of metadata in a data storage system employing de-duplication. The method includes (a) creating metadata describing a file of a file system stored on the data storage system, (b) buffering the metadata within a metadata buffer of system memory of the data storage system, (c) sending contents of the metadata buffer from system memory to transmission circuitry of the data storage system, (d) directing the transmission circuitry to store the contents of the metadata buffer to a first location of persistent storage of the data storage system, and (e) directing the transmission circuitry to store a modified version of the contents of the metadata buffer to a second location of persistent storage of the data storage system, the first location being different from the second location. A computerized apparatus and a computer program product are also provided for performing a similar method.

公开(公告)号：US09400741B1

公开(公告)日：2016-07-26

申请号：US14319455

申请日：2014-06-30

申请人： EMC Corporation

发明人： Jean-Pierre Bono ,  William C. Davenport ,  Alexander Mathews ,  Philippe Armangau

IPC分类号： G06F12/00 ,  G06F13/00 ,  G06F13/28 ,  G06F12/02 ,  G06F3/06 ,  G06F11/14

CPC分类号： G06F12/023 ,  G06F3/0611 ,  G06F3/0619 ,  G06F3/0643 ,  G06F3/065 ,  G06F3/0655 ,  G06F3/067 ,  G06F11/1453

摘要： Reclaiming storage from a file system hosting of storage objects includes assigning objects and respective files to version sets, each version set containing a primary object and respective snapshots. Each block of storage is associated with the version set of the file(s) that contain the block. Blocks residing in an extent that is to be reclaimed are identified, and for each block (i) an offset is obtained that specifies a location of the block in a file, (ii) files whose objects are assigned to the version set associated with the block are identified, (iii) a block pointer at the location in each of the identified underlying files is examined, and for each file whose block pointer points to the block, updating the block pointer to point to a new block location outside of the extent, to which the block is moved.

摘要翻译： 从托管存储对象的文件系统回收存储包括将对象和相应文件分配给版本集，每个版本集包含主要对象和相应的快照。 每个存储块与包含该块的文件的版本集相关联。 识别驻留在要回收的范围内的块，并且对于每个块（i），获得指定文件中块的位置的偏移量，（ii）其对象被分配给与该文件相关联的版本集的文件 块被识别，（iii）检查每个识别的底层文件中的位置处的块指针，并且对于块指针指向块的每个文件，更新块指针以指向在该范围之外的新的块位置 ，移动块。

公开(公告)号：US09256629B1

公开(公告)日：2016-02-09

申请号：US13931775

申请日：2013-06-28

申请人： EMC Corporation

发明人： Jean-Pierre Bono ,  William C. Davenport ,  Miles A. de Forest ,  Walter C. Forrester ,  Michal Marko ,  Ye Zhang ,  Philippe Armangau

IPC分类号： G06F17/30

CPC分类号： G06F17/30197 ,  G06F17/30067

摘要： A data storage system includes storage devices and a processing subsystem executing software forming a lower-deck file system and an upper-deck file system. The lower-deck file system presents a volume file from which storage is provided to the upper-deck file system, and units of storage of the storage devices are allocable to the upper-deck file system but not reserved to it. The volume file is thinly provisioned, and additional units of storage are added dynamically to increase its allocated size in response to demand from the upper-deck file system. The lower-deck file system operates in a mapped mode in which a block address in the lower-deck file system is obtained by a generally arbitrary mapping (e.g., an Inode/IB tree) of a block address in the volume file.

摘要翻译： 数据存储系统包括存储设备和执行形成下层文件系统和上层文件系统的软件的处理子系统。 下层文件系统提供一个卷文件，从该文件提供存储到上层文件系统，存储设备的存储单元可分配给上层文件系统，但不保留给它。 卷文件被稀疏地配置，并且动态添加额外的存储单元以增加其分配的大小以响应来自上层文件系统的需求。 下层文件系统以映射模式操作，其中通过卷文件中的块地址的大致任意的映射（例如，Inode / IB树）获得下层文件系统中的块地址。