-
公开(公告)号:US09355121B1
公开(公告)日:2016-05-31
申请号:US13930506
申请日:2013-06-28
申请人: EMC Corporation
发明人: Michael Scheer , Morgan Clark , Ahsan Rashid , Srinivasa R. Vempati , Marc DeSouter , Pranit Sethi , Maher Kachmar
IPC分类号: G06F17/30
CPC分类号: G06F17/30221
摘要: A technique for managing a file system includes dividing the addressable space of a file system into multiple subspaces: a data subspace for user data; an inode subspace for inodes describing the user data; and an MDB (metadata block) subspace for indirect blocks and/or directory structures pertaining to the user data. In response to storage requests to write user files to the file system, the file system stores user data of the files in the data subspace, stores inodes pertaining to the user files in the inode subspace, and stores indirect blocks and/or directories in the MDB subspace.
摘要翻译: 用于管理文件系统的技术包括将文件系统的可寻址空间划分成多个子空间:用于数据的数据子空间; 用于描述用户数据的inode的inode子空间; 和用于与用户数据有关的间接块和/或目录结构的MDB(元数据块)子空间。 响应于将用户文件写入文件系统的存储请求,文件系统将文件的用户数据存储在数据子空间中,将与用户文件有关的inode存储在索引节点子空间中,并将间接块和/或目录存储在 MDB子空间。
-
公开(公告)号:US09916102B1
公开(公告)日:2018-03-13
申请号:US15197064
申请日:2016-06-29
申请人: EMC Corporation
发明人: Ivan Bassov , Walter C. Forrester , Michal Marko , Ahsan Rashid
CPC分类号: G06F3/067 , G06F3/0605 , G06F3/0631 , G06F3/065
摘要: A technique for managing storage space in a data storage system generates liability values on a per-family basis, with each family including files in the file system that are related to one another by snapping. Each family thus groups together files in the file system that share at least some blocks among one another based on snapshot activities. Distinct files that do not share blocks based on snapping are provided in separate families. The file system leverages the snap-based relationships among family members to produce more accurate estimates of liability than would otherwise be feasible.
-
公开(公告)号:US09880743B1
公开(公告)日:2018-01-30
申请号:US15086636
申请日:2016-03-31
申请人: EMC Corporation
CPC分类号: G06F3/0608 , G06F3/0631 , G06F3/0644 , G06F3/0685
摘要: A technique for managing storage space in a file system applies reference weights to compressed storage extents stored in multi-block segments. Each time a reference weight for a compressed storage extent in a segment changes to a value that indicates that the storage extent is no longer in use, a file system manager increments a freed-fragment counter provided for a range of the file system that includes the segment. The file system manager then determines whether to scavenge for free space in that range of the file system based at least in part on a count of the free-fragment counter.
-
公开(公告)号:US09864753B1
公开(公告)日:2018-01-09
申请号:US15085276
申请日:2016-03-30
申请人: EMC Corporation
CPC分类号: G06F17/30138 , G06F3/0608 , G06F3/0631 , G06F3/0652 , G06F3/0653 , G06F3/0665 , G06F3/0689
摘要: A data storage system tracks liability and insurance for an internal file system, liability being a number of slices needed to store file system data, insurance being a number of slices allowed to be consumed. A reserve of un-provisioned insurance is maintained from which slices are provisioned to the file system for use in storing file system data without immediate requirement for increasing the insurance. Slices are provisioned to the file system from the reserve of un-provisioned insurance based on a window criteria and a space criteria, the window criteria being that a number of free windows is less than a free window threshold, the space criteria being that a number of currently provisioned slices is less than a maximum allowed slices, which includes an overprovisioning factor applied to the primary file size to allow for growth of the primary file without immediate requirement for increasing provisioned insurance.
-
公开(公告)号:US09612754B1
公开(公告)日:2017-04-04
申请号:US14753476
申请日:2015-06-29
申请人: EMC Corporation
IPC分类号: G06F3/06 , G06F12/02 , G06F12/06 , G06F12/0802
CPC分类号: G06F3/0611 , G06F3/0643 , G06F3/0656 , G06F3/0673 , G06F12/0868
摘要: A method of operating a data storage system includes writing the file system data as sequential data and non-sequential data to a storage volume, the sequential data being stored in windows each having a predetermined number of consecutive data blocks and being allocated dynamically as the sequential data is written. The method includes maintaining and using a window cache to identify existing windows for storing respective newly written sequential file system data in sequence with respective earlier-written file system data for which the existing windows were previously allocated, the window cache including a set of entries indexed by an identifier of (1) a file of the file system and (2) a window-size region of the file to which sequential data is being written, the entries including respective physical window addresses identifying respective ones of the existing windows and being obtained by lookup operations using respective values of the identifier.
-
公开(公告)号:US09400792B1
公开(公告)日:2016-07-26
申请号:US13928591
申请日:2013-06-27
申请人: EMC Corporation
发明人: Jean-Pierre Bono , William C. Davenport , Miles A. de Forest , Philippe Armangau , Michael Scheer , Morgan Clark , Ahsan Rashid
CPC分类号: G06F17/30082 , G06F3/0604 , G06F9/5016
摘要: A technique for managing storage tiering in a data storage apparatus operates at a fine level of granularity in response to write requests as blocks are allocated for writing. As write requests arrive or are otherwise processed by the data storage apparatus, the data storage apparatus identifies a quality of service to be provided for satisfying each write request and allocates a set of blocks from storage devices of storage tiers that provide the identified quality of service. The data storage apparatus may then store the information specified in the write request in the newly allocated blocks.
摘要翻译: 用于管理数据存储装置中的存储分层的技术响应于写入请求以精细的粒度进行操作,因为块被分配用于写入。 当写请求到达或由数据存储装置另外处理时,数据存储装置识别要提供用于满足每个写请求的服务质量,并从提供所识别的服务质量的存储层的存储装置分配一组块 。 然后,数据存储装置可以将新写入请求中指定的信息存储在新分配的块中。
-
公开(公告)号:US09922039B1
公开(公告)日:2018-03-20
申请号:US15086758
申请日:2016-03-31
申请人: EMC Corporation
CPC分类号: G06F3/0683 , G06F3/0611 , G06F3/064 , G06F3/067
摘要: Embodiments are directed to techniques for allowing write operations to proceed on units smaller than a block. Merely decreasing the block size is not desirable, however, since many files are written in large chunks at once, and larger block sizes can increase speed and decrease the amount of overhead metadata required. Therefore, in order to maintain large block sizes while still obtaining the benefit of being able to make small writes when necessary, blocks may be divided into sub-blocks. Unaligned writes that do not fill up an entire block may be segregated and stored separately from aligned writes, the unaligned writes having finer granularity. These techniques may result in faster operation for unaligned writes. They also especially benefit systems using compression because they allow efficiently partially overwriting compressed blocks.
-
公开(公告)号:US10423581B1
公开(公告)日:2019-09-24
申请号:US15085282
申请日:2016-03-30
申请人: EMC Corporation
发明人: Ahsan Rashid
摘要: A data storage system operates to shrink an intermediate logical volume and lower file system upon deletion of a first upper data unit of an upper file system without moving file data on the physical storage devices. Initially, a second upper data unit of the upper file system is identified that is mapped to an end location of the intermediate logical volume. Within the lower file system, a non-end location of the volume file is re-mapped to a first location on the physical storage devices where the data of the end location of the intermediate logical volume is stored. Within the upper file system, the second upper data unit is re-mapped to the non-end location of the intermediate logical volume. Subsequently, the intermediate volume is truncated by removing the portion at the non-end location.
-
公开(公告)号:US09965201B1
公开(公告)日:2018-05-08
申请号:US14674566
申请日:2015-03-31
申请人: EMC Corporation
IPC分类号: G06F3/06
CPC分类号: G06F3/0619 , G06F3/064 , G06F3/0665 , G06F3/0689
摘要: An improved technique for managing data storage includes relocating allocated blocks within a range of a physical address space of a file system to free the allocated blocks. The range has a length equal to a length of one or more full stripes of a RAID group that stores content of the file system. In response to receiving data to be written to the file system, the file system arranges the data in the range of contiguous blocks and performs one or more full-stripe writes to write the data to the RAID group.
-
公开(公告)号:US09805044B1
公开(公告)日:2017-10-31
申请号:US14674389
申请日:2015-03-31
申请人: EMC Corporation
发明人: Philippe Armangau , Michael Scheer , Ahsan Rashid , Rohit K. Chawla , Feng Zhang
CPC分类号: G06F17/30138 , G06F3/0613 , G06F3/064 , G06F3/067
摘要: A technique for managing block allocation in data storage systems involve providing multiple ranges of contiguous logical addresses (logical windows) in a logical address space of a file and allocating contiguous ranges of physical addresses (physical windows) in a file system to respective logical windows in response to requests to write data to logical addresses within the logical windows. When allocating blocks from one or more streams, each logical window to which writes are directed is mapped to a respective physical window, and each logical address in the logical window is mapped to a physical address in the physical window.
-
-
-
-
-
-
-
-
-