公开(公告)号：US09043542B2

公开(公告)日：2015-05-26

申请号：US14087557

申请日：2013-11-22

Applicant: NetApp, Inc.

Inventor： Jeffrey S. Kimmel ,  Randy Pafford ,  Rajesh Sundaram

IPC: G06F12/00 ,  G06F12/12 ,  G06F12/02

CPC classification number: G06F12/12 ,  G06F12/0246 ,  G06F2212/222 ,  G06F2212/7211

Abstract: Described is a technique for managing the content of a nonvolatile solid-state memory data cache to improve cache performance while at the same time, and in a complementary manner, providing for automatic wear leveling. A modified circular first-in first-out (FIFO) log/algorithm is generally used to determine cache content replacement. The algorithm is used as the default mechanism for determining cache content to be replaced when the cache is full but is subject to modification in some instances. In particular, data are categorized according to different data classes prior to being written to the cache, based on usage. Once cached, data belonging to certain classes are treated differently than the circular FIFO replacement algorithm would dictate. Further, data belonging to each class are localized to designated regions within the cache.

Abstract translation: 描述了一种用于管理非易失性固态存储器数据高速缓存的内容以提高高速缓存性能的技术，同时以互补的方式提供自动磨损均衡。 修改的循环先进先出（FIFO）日志/算法通常用于确定高速缓存内容替换。 该算法用作在高速缓存已满的情况下确定要替换的缓存内容的默认机制，但在某些情况下可能会进行修改。 特别地，根据使用情况，在写入缓存之前，根据不同的数据类对数据进行分类。 一旦缓存，属于某些类的数据的处理方式与循环FIFO替换算法将会有所不同。 此外，属于每个类的数据被定位到高速缓存内的指定区域。

公开(公告)号：US20140173198A1

公开(公告)日：2014-06-19

申请号：US14137084

申请日：2013-12-20

Applicant: NetApp, Inc.

Inventor： James Leong ,  Rajesh Sundaram ,  Douglas P. Doucette ,  Scott Schoenthal ,  Stephen H. Strange ,  Srinivasan Viswanathan

IPC: G06F3/06

CPC classification number: G06F3/0601 ,  G06F3/061 ,  G06F3/0611 ,  G06F3/0655 ,  G06F3/0659 ,  G06F3/0689 ,  G06F9/4881 ,  G06F11/2087

Abstract: A data access request to a file system is decomposed into a plurality of lower-level I/O tasks. A logical combination of physical storage components is represented as a hierarchical set of objects. A parent I/O task is generated from a first object in response to the data access request. A child I/O task is generated from a second object to implement a portion of the parent I/O task. The parent I/O task is suspended until the child I/O task completes. The child I/O task is executed in response to an occurrence of an event that a resource required by the child I/O task is available. The parent I/O task is resumed upon an event indicating completion of the child I/O task. Scheduling of any child I/O task is not conditional on execution of the parent I/O task, and a state diagram regulates the child I/O tasks.

Abstract translation: 对文件系统的数据访问请求被分解成多个较低级的I / O任务。 物理存储组件的逻辑组合被表示为一组分层对象。 响应于数据访问请求，从第一对象生成父I / O任务。 从第二个对象生成子I / O任务，以实现父I / O任务的一部分。 父I / O任务被暂停，直到子I / O任务完成。 响应于发生子I / O任务所需的资源可用的事件，执行子I / O任务。 在指示完成子I / O任务的事件后，将恢复父I / O任务。 任何子I / O任务的调度不是执行父I / O任务的条件，而状态图则规定了子I / O任务。

公开(公告)号：US20130346810A1

公开(公告)日：2013-12-26

申请号：US13918428

申请日：2013-06-14

Applicant: NetApp. Inc.

Inventor： Jeffrey S. Kimmel ,  Sunitha S. Sankar ,  Rajesh Sundaram ,  Nitin Muppalaneni ,  Emily W. Eng ,  Eric C. Hamilton

IPC: G06F11/07

CPC classification number: G06F11/073 ,  G06F11/1076 ,  G06F2211/1007 ,  G06F2211/104

Abstract: A storage system, such as a file server, receives a request to perform a write operation that affects a data block. In response, the storage system writes to a storage device the data block together with context information which uniquely identifies the write operation with respect to the data block. When the data block is subsequently read from the storage device together with the context information, the context information that was read with the data block is used to determine whether a previous write of the data block was lost.

Abstract translation: 诸如文件服务器的存储系统接收到执行影响数据块的写入操作的请求。 作为响应，存储系统与数据块一起写入存储设备以及唯一地标识关于数据块的写入操作的上下文信息。 当数据块随后与上下文信息一起从存储设备读取时，使用数据块读取的上下文信息用于确定数据块的先前写入是否丢失。

公开(公告)号：US10042853B2

公开(公告)日：2018-08-07

申请号：US15239125

申请日：2016-08-17

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Stephen Daniel ,  Jeffrey S. Kimmel ,  Blake H. Lewis

IPC: G06F12/00 ,  G06F17/30 ,  G06F3/06 ,  G06F12/02

Abstract: A flash-optimized, log-structured layer of a file system of a storage input/output (I/O) stack executes on one or more nodes of a cluster. The log-structured layer of the file system provides sequential storage of data and metadata (i.e., a log-structured layout) on solid state drives (SSDs) of storage arrays in the cluster to reduce write amplification, while leveraging variable compression and variable length data features of the storage I/O stack. The data may be organized as an arbitrary number of variable-length extents of one or more host-visible logical units (LUNs) served by the nodes. The metadata may include mappings from host-visible logical block address ranges (i.e., offset ranges) of a LUN to extent keys, as well as mappings of the extent keys to SSD storage locations of the extents. The storage location of an extent on SSD is effectively “virtualized” by its mapped extent key (i.e., extent store layer mappings) such that relocation of the extent on SSD does require update to volume layer metadata (i.e., the extent key sufficiently identifies the extent).

公开(公告)号：US20160357776A1

公开(公告)日：2016-12-08

申请号：US15239125

申请日：2016-08-17

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Stephen Daniel ,  Jeffrey S. Kimmel ,  Blake H. Lewis

IPC: G06F17/30 ,  G06F3/06 ,  G06F12/02

CPC classification number: G06F17/30138 ,  G06F3/0604 ,  G06F3/0608 ,  G06F3/0616 ,  G06F3/064 ,  G06F3/0643 ,  G06F3/0644 ,  G06F3/0647 ,  G06F3/0659 ,  G06F3/0679 ,  G06F3/0685 ,  G06F3/0688 ,  G06F12/0246 ,  G06F17/30185 ,  G06F17/30218 ,  G06F2003/0697 ,  G06F2212/2022 ,  G06F2212/7208

Abstract: A flash-optimized, log-structured layer of a file system of a storage input/output (I/O) stack executes on one or more nodes of a cluster. The log-structured layer of the file system provides sequential storage of data and metadata (i.e., a log-structured layout) on solid state drives (SSDs) of storage arrays in the cluster to reduce write amplification, while leveraging variable compression and variable length data features of the storage I/O stack. The data may be organized as an arbitrary number of variable-length extents of one or more host-visible logical units (LUNs) served by the nodes. The metadata may include mappings from host-visible logical block address ranges (i.e., offset ranges) of a LUN to extent keys, as well as mappings of the extent keys to SSD storage locations of the extents. The storage location of an extent on SSD is effectively “virtualized” by its mapped extent key (i.e., extent store layer mappings) such that relocation of the extent on SSD does require update to volume layer metadata (i.e., the extent key sufficiently identifies the extent).

Abstract translation: 存储输入/输出（I / O）堆栈的文件系统的闪存优化的日志结构化层在集群的一个或多个节点上执行。 文件系统的日志结构化层在集群中的存储阵列的固态驱动器（SSD）上提供数据和元数据（即，日志结构化布局）的顺序存储，以减少写入放大，同时利用可变压缩和可变长度 存储I / O堆栈的数据特征。 数据可以被组织为由节点服务的一个或多个主机可见逻辑单元（LUN）的可变长度范围的任意数量。 元数据可以包括从LUN到扩展密钥的主机可见逻辑块地址范围（即，偏移范围）的映射，以及扩展密钥到扩展区的SSD存储位置的映射。 SSD上的盘区的存储位置被其映射的盘区密钥（即，盘区存储层映射）有效地“虚拟化”，使得SSD上盘区的重新定位需要更新到卷层元数据（即，扩展密钥足够地识别 程度）。

公开(公告)号：US09454434B2

公开(公告)日：2016-09-27

申请号：US14158448

申请日：2014-01-17

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi ,  Jeffrey S. Kimmel ,  T. Byron Rakitzis

IPC: G06F11/10 ,  G06F3/06

CPC classification number: G06F11/1084 ,  G06F3/0619 ,  G06F3/065 ,  G06F3/0653 ,  G06F3/0688 ,  G06F3/0689 ,  G06F11/1008 ,  G06F11/1068 ,  G06F11/1076 ,  G06F11/108 ,  G06F11/1092 ,  G06F11/1096 ,  G06F17/30218 ,  G06F2211/1057 ,  G11C29/52

Abstract: In one embodiment, one or more storage arrays of solid state drives (SSDs) that include a plurality of segments are organized as one or more redundant array of independent disks (RAID) groups, where the RAID groups provides data redundancy for the segments. A node executing a layered file system of a storage input/output (I/O) stack performs segment cleaning to clean the segments. It further initiates rebuild of a RAID configuration of the SSDs on a segment-by-segment basis in response to the segment cleaning. In such a configuration, each segment includes one or more RAID stripes that provide a level of data redundancy as well as RAID organization for the segment.

Abstract translation: 在一个实施例中，包括多个段的固态驱动器（SSD）的一个或多个存储阵列被组织为独立磁盘（RAID）组的一个或多个冗余阵列，其中RAID组为段提供数据冗余。 执行存储输入/输出（I / O）堆栈的分层文件系统的节点执行段清理来清理段。 它还响应于段清理，逐段启动重新构建SSD的RAID配置。 在这样的配置中，每个段包括一个或多个RAID条带，其提供数据冗余级别以及该段的RAID组织。

公开(公告)号：US09389958B2

公开(公告)日：2016-07-12

申请号：US14161184

申请日：2014-01-22

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi ,  Jeffrey S. Kimmel ,  T. Byron Rakitzis

IPC: G06F11/10

CPC classification number: G06F11/1084 ,  G06F3/0619 ,  G06F3/065 ,  G06F3/0653 ,  G06F3/0688 ,  G06F3/0689 ,  G06F11/1008 ,  G06F11/1068 ,  G06F11/1076 ,  G06F11/108 ,  G06F11/1092 ,  G06F11/1096 ,  G06F17/30218 ,  G06F2211/1057 ,  G11C29/52

Abstract: In one embodiment, a file system driven RAID rebuild technique is provided. A layered file system may organize storage of data as segments spanning one or more sets of storage devices, such as solid state drives (SSDs), of a storage array, wherein each set of SSDs may form a RAID group configured to provide data redundancy for a segment. The file system may then drive (i.e., initiate) rebuild of a RAID configuration of the SSDs on a segment-by-segment basis in response to cleaning of the segment (i.e., segment cleaning). Each segment may include one or more RAID stripes that provide a level of data redundancy (e.g., single parity RAID 5 or double parity RAID 6) as well as RAID organization (i.e., distribution of data and parity) for the segment. Notably, the level of data redundancy and RAID organization may differ among the segments of the array.

Abstract translation: 在一个实施例中，提供了文件系统驱动的RAID重建技术。 分层文件系统可以将数据的存储组织为跨越存储阵列的一组或多组存储设备（例如固态驱动器（SSD））的段，其中每组SSD可以形成RAID组，其被配置为提供数据冗余 一段 然后文件系统可以响应于段的清除（即，段清除）逐个段地驱动（即，启动）重建SSD的RAID配置。 每个段可以包括一个或多个提供数据冗余级别（例如，单个奇偶校验RAID 5或双奇偶校验RAID 6）的RAID条带以及用于该段的RAID组织（即，数据和奇偶校验的分配）。 值得注意的是，数据冗余和RAID组织的级别可能在阵列的各个部分之间不同。

公开(公告)号：US20150205669A1

公开(公告)日：2015-07-23

申请号：US14161184

申请日：2014-01-22

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi ,  Jeffrey S. Kimmel ,  T. Byron Rakitzis

IPC: G06F11/10

CPC classification number: G06F11/1084 ,  G06F3/0619 ,  G06F3/065 ,  G06F3/0653 ,  G06F3/0688 ,  G06F3/0689 ,  G06F11/1008 ,  G06F11/1068 ,  G06F11/1076 ,  G06F11/108 ,  G06F11/1092 ,  G06F11/1096 ,  G06F17/30218 ,  G06F2211/1057 ,  G11C29/52

Abstract: In one embodiment, a file system driven RAID rebuild technique is provided. A layered file system may organize storage of data as segments spanning one or more sets of storage devices, such as solid state drives (SSDs), of a storage array, wherein each set of SSDs may form a RAID group configured to provide data redundancy for a segment. The file system may then drive (i.e., initiate) rebuild of a RAID configuration of the SSDs on a segment-by-segment basis in response to cleaning of the segment (i.e., segment cleaning). Each segment may include one or more RAID stripes that provide a level of data redundancy (e.g., single parity RAID 5 or double parity RAID 6) as well as RAID organization (i.e., distribution of data and parity) for the segment. Notably, the level of data redundancy and RAID organization may differ among the segments of the array.

Abstract translation: 在一个实施例中，提供了文件系统驱动的RAID重建技术。 分层文件系统可以将数据的存储组织为跨越存储阵列的一组或多组存储设备（例如固态驱动器（SSD））的段，其中每组SSD可以形成RAID组，其被配置为提供数据冗余 一段 然后文件系统可以响应于段的清除（即，段清除）逐个段地驱动（即，启动）重建SSD的RAID配置。 每个段可以包括一个或多个提供数据冗余级别（例如，单个奇偶校验RAID 5或双奇偶校验RAID 6）的RAID条带以及用于该段的RAID组织（即，数据和奇偶校验的分配）。 值得注意的是，数据冗余和RAID组织的级别可能在阵列的各个部分之间不同。

公开(公告)号：US20150205668A1

公开(公告)日：2015-07-23

申请号：US14158448

申请日：2014-01-17

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi ,  Jeffrey S. Kimmel ,  T. Byron Rakitzis

IPC: G06F11/10

CPC classification number: G06F11/1084 ,  G06F3/0619 ,  G06F3/065 ,  G06F3/0653 ,  G06F3/0688 ,  G06F3/0689 ,  G06F11/1008 ,  G06F11/1068 ,  G06F11/1076 ,  G06F11/108 ,  G06F11/1092 ,  G06F11/1096 ,  G06F17/30218 ,  G06F2211/1057 ,  G11C29/52

Abstract: In one embodiment, one or more storage arrays of solid state drives (SSDs) that include a plurality of segments are organized as one or more redundant array of independent disks (RAID) groups, where the RAID groups provides data redundancy for the segments. A node executing a layered file system of a storage input/output (I/O) stack performs segment cleaning to clean the segments. It further initiates rebuild of a RAID configuration of the SSDs on a segment-by-segment basis in response to the segment cleaning. In such a configuration, each segment includes one or more RAID stripes that provide a level of data redundancy as well as RAID organization for the segment.

Abstract translation: 在一个实施例中，包括多个段的固态驱动器（SSD）的一个或多个存储阵列被组织为独立磁盘（RAID）组的一个或多个冗余阵列，其中RAID组为段提供数据冗余。 执行存储输入/输出（I / O）堆栈的分层文件系统的节点执行段清理来清理段。 它还响应于段清理，逐段启动重新构建SSD的RAID配置。 在这样的配置中，每个段包括一个或多个RAID条带，其提供数据冗余级别以及该段的RAID组织。

公开(公告)号：US20150193168A1

公开(公告)日：2015-07-09

申请号：US14149488

申请日：2014-01-07

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi

IPC: G06F3/06

CPC classification number: G06F11/2069 ,  G06F3/0604 ,  G06F3/0619 ,  G06F3/0632 ,  G06F3/0634 ,  G06F3/065 ,  G06F3/0659 ,  G06F3/0689 ,  G06F11/2092 ,  G06F2201/805 ,  G06F2201/82

Abstract: In one embodiment, a node is a member of a cluster having a plurality of nodes, where each node is coupled to one or more storage arrays of solid state drives (SSDs) that serve as main storage. The node executed a storage input/output (I/O) stack having a redundant array of independent disks (RAID) layer that organizes the SSDs within the one or more storage arrays as one or more RAID groups. Configuration information is stored as a cluster database. The configuration information identifies (i) one or more RAID groups associated with an extent store, (ii) SSDs within each RAID group, and (iii) an identification of a node that owns the extent store. The cluster database is stored separate and apart from the main storage.

Abstract translation: 在一个实施例中，节点是具有多个节点的集群的成员，其中每个节点耦合到用作主存储器的固态驱动器（SSD）的一个或多个存储阵列。 该节点执行具有将一个或多个存储阵列内的SSD作为一个或多个RAID组组织的独立磁盘（RAID）层的冗余阵列的存储输入/输出（I / O）堆栈。 配置信息存储为集群数据库。 配置信息标识（i）与扩展存储相关联的一个或多个RAID组，（ii）每个RAID组内的SSD，以及（iii）拥有扩展存储区的节点的标识。 集群数据库与主存储分开存储。