公开(公告)号：EP3191932A1

公开(公告)日：2017-07-19

申请号：EP15771799.2

申请日：2015-09-08

申请人： NetApp, Inc.

发明人： PATEL, Dhaval ,  SWAMINATHAN, Manish ,  MCCLANAHAN, Edward D. ,  MUTH, John

IPC分类号： G06F3/06 ,  G06F12/02

CPC分类号： G06F12/0253 ,  G06F3/0608 ,  G06F3/061 ,  G06F3/0619 ,  G06F3/0641 ,  G06F3/0656 ,  G06F3/0688 ,  G06F12/0246 ,  G06F2212/1016 ,  G06F2212/1024 ,  G06F2212/1044 ,  G06F2212/702 ,  G06F2212/7201 ,  G06F2212/7205

摘要： A rate matching technique may be configured to adjust a rate of cleaning of one or more selected segments of the storage array to accommodate a variable rate of incoming workload processed by a storage input/output (I/O) stack executing on one or more nodes of a cluster. An extent store layer of the storage I/O stack may clean a segment in accordance with segment cleaning which, illustratively, may be embodied as a segment cleaning process. The rate matching technique may be implemented as a feedback control mechanism configured to adjust the segment cleaning process based on the incoming workload. Components of the feedback control mechanism may include one or more weight schedulers and various accounting data structures, e.g., counters, configured to track the progress of segment cleaning and free space usage. The counters may also be used to balance the rates of segment cleaning and incoming I/O workload, which may change depending upon an incoming I/O rate. When the incoming I/O rate changes, the rate of segment cleaning may be adjusted accordingly to ensure that rates are substantially balanced.

摘要翻译： 速率匹配技术可以被配置为调整存储阵列的一个或多个选定分段的清理速率以适应由在一个或多个节点上执行的存储输入/输出（I / O）堆栈处理的输入工作负载的可变速率 的集群。 存储I / O堆栈的扩展存储层可以根据段清理来清理段，其说明性地可以被实现为段清理过程。 速率匹配技术可以被实现为被配置为基于传入工作负载来调整段清理过程的反馈控制机制。 反馈控制机制的组件可以包括一个或多个权重调度器和各种会计数据结构，例如计数器，其被配置为跟踪段清理和空闲空间使用的进度。 这些计数器还可用于平衡段清理和传入I / O工作负载的速率，这些工作负载可能会根据传入的I / O速率而变化。 当传入的I / O速率改变时，可以相应地调整段清理的速率以确保速率基本平衡。

公开(公告)号：EP3191931A1

公开(公告)日：2017-07-19

申请号：EP15766989.6

申请日：2015-09-08

申请人： NetApp, Inc.

发明人： MUTH, John ,  MCCLANAHAN, Edward D. ,  PATEL, Dhaval ,  SWAMINATHAN, Manish

IPC分类号： G06F3/06 ,  G06F12/02

CPC分类号： G06F3/0652 ,  G06F3/0608 ,  G06F3/061 ,  G06F3/0644 ,  G06F3/0673 ,  G06F3/0688 ,  G06F2212/7205

摘要： An optimized segment cleaning technique is configured to efficiently clean one or more selected portions or segments of a storage array coupled to one or more nodes of a cluster. A bottom-up approach of the segment cleaning technique is configured to read all blocks of a segment to be cleaned (i.e., an “old” segment) to locate extents stored on the SSDs of the old segment and examine extent metadata to determine whether the extents are valid and, if so, relocate the valid extents to a segment being written (i.e., a “new” segment). A top-down approach of the segment cleaning technique obviates reading of the blocks of the old segment to locate the extents and, instead, examines the extent metadata to determine the valid extents of the old segment. A hybrid approach may extend the top-down approach to include only full stripe read operations needed for relocation and reconstruction of blocks as well as retrieval of valid extents from the stripes, while also avoiding any unnecessary read operations of the bottom-down approach.

摘要翻译： 优化的片段清理技术被配置为有效地清理耦合到群集的一个或多个节点的存储阵列的一个或多个选定部分或片段。 段清理技术的自下而上的方法被配置为读取要清理的段的所有块（即，“旧”段）以定位存储在旧段的SSD上的区段并检查区段元数据以确定 范围是有效的，如果是，则将有效范围重定位到正在写入的段（即“新”段）。 段清除技术的自顶向下的方法是避免读取旧段的块来定位范围，而是检查范围元数据以确定旧段的有效范围。 混合方法可以扩展自顶向下的方法，只包括块的重定位和重构所需的完整条带读取操作以及从条带中检索有效范围，同时还避免任何不必要的自下而上方法的读取操作。