公开(公告)号：US09529551B2

公开(公告)日：2016-12-27

申请号：US14334349

申请日：2014-07-17

Applicant: NetApp, Inc.

Inventor： Ram Kesavan ,  Sriram Venketaraman ,  Mohit Gupta ,  Subramaniam Periyagaram

IPC: G06F3/06 ,  G06F17/30

CPC classification number: G06F3/065 ,  G06F3/0617 ,  G06F3/0619 ,  G06F3/0641 ,  G06F3/067 ,  G06F3/0689 ,  G06F17/30091 ,  G06F17/30115 ,  G06F17/30129 ,  G06F17/30203

Abstract: Techniques to clone a writeable data object in non-persistent memory are disclosed. The writeable data object is stored in a storage structure in non-persistent memory that corresponds to a portion of a persistent storage. The techniques enable cloning of the writeable data object without having to wait until the writeable data object is saved to the persistent storage and without needing to quiesce incoming operations (e.g., reads and writes) to the writeable data object.

Abstract translation: 公开了在非持久存储器中克隆可写数据对象的技术。 可写数据对象被存储在对应于持久存储器的一部分的非永久存储器中的存储结构中。 该技术能够克隆可写数据对象，而不必等到可写数据对象被保存到永久存储器中，而不需要暂停对可写数据对象的传入操作（例如，读和写）。

公开(公告)号：US09529546B2

公开(公告)日：2016-12-27

申请号：US14150689

申请日：2014-01-08

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Jeffrey S. Kimmel ,  Blake H. Lewis

IPC: G06F3/0484 ,  G06F3/06

CPC classification number: G06F3/0641 ,  G06F3/0604 ,  G06F3/0608 ,  G06F3/0643 ,  G06F3/067 ,  G06F3/0688 ,  G06F2003/0697

Abstract: In one embodiment, a layered file system includes a volume layer and an extent store layer configured to provide sequential log-structured layout of data and metadata on solid state drives (SSDs) of one or more storage arrays. The data is organized as variable-length extents of one or more logical units (LUNs). The metadata includes volume metadata mappings from offset ranges of a LUN to extent keys and extent metadata mappings of the extent keys to storage locations of the extents on the SSDs. The extent store layer maintaining the extent metadata mappings determines whether an extent is stored on a storage array, and, in response to determination that the extent is stored on the storage array, returns an extent key for the stored extent to the volume layer to enable global inline de-duplication that obviates writing a duplicate copy of the extent on the storage array.

Abstract translation: 在一个实施例中，分层文件系统包括卷层和盘区存储层，其被配置为在一个或多个存储阵列的固态驱动器（SSD）上提供数据和元数据的顺序日志结构布局。 数据被组织为一个或多个逻辑单元（LUN）的可变长度范围。 元数据包括从LUN的偏移范围到扩展密钥的卷元数据映射以及扩展密钥到SSD上的扩展区的存储位置的扩展元数据映射。 维护盘区元数据映射的盘区存储层确定盘区是否存储在存储阵列上，并且响应于确定盘区存储在存储阵列上，将存储的盘区的盘区密钥返回到卷层以启用 全局内联重复数据删除，从而避免在存储阵列上写入扩展区的重复副本。

公开(公告)号：US20160357743A1

公开(公告)日：2016-12-08

申请号：US14728482

申请日：2015-06-02

Applicant: NetApp, Inc.

Inventor： Manish Swaminathan ,  Dhaval Patel ,  Edward D. McClanahan ,  Jeffrey S. Kimmel

IPC: G06F17/30

CPC classification number: G06F17/3033 ,  G06F12/0246 ,  G06F12/0261 ,  G06F17/30194 ,  G06F17/30914

Abstract: A technique reduces an amount of metadata stored in a memory of a node in a cluster. An extent store layer of a storage input/output (I/O) stack executing on the node stores key-value pairs in a plurality of data structures, e.g., cuckoo hash tables, resident in the memory. The cuckoo hash table embodies metadata that describes an extent and, as such, may be organized to associate a location on disk with a value that identifies the location on disk. The value may be embodied as a locator that includes a reference count used to support deduplication functionality of the extent store layer with respect to the extent. The reference count is divided into two portions: a delta count portion stored in memory for each slot of the hash table and an overflow count portion stored on disk in a header of each extent. One bit of the delta count portion is reserved as an overflow bit that indicates whether the in-memory reference count has overflowed. Another bit of the delta count portion is reserved as a sign bit that indicates whether the value of the remaining delta count portion, which stores the “delta” of the reference count, is positive or negative. Overflow updates to the overflow count portion on disk are postponed until all of the bits of the delta count portion are consumed as negative/positive transitions.

Abstract translation: 一种技术减少了存储在群集中的节点的存储器中的元数据量。 在节点上执行的存储输入/输出（I / O）堆栈的盘区存储层将密钥值对存储在驻留在存储器中的多个数据结构（例如，布谷鸟哈希表）中。 杜鹃哈希表体现了描述范围的元数据，因此可以被组织以将磁盘上的位置与标识磁盘上的位置的值相关联。 该值可以体现为定位器，其包括用于相对于该范围支持扩展存储层的重复数据删除功能的引用计数。 引用计数被分为两部分：存储在哈希表的每个时隙的存储器中的增量计数部分和存储在每个盘区的标题中的盘上的溢出计数部分。 增量计数部分的一位被保留为指示内存中引用计数是否溢出的溢出位。 增量计数部分的另一位被保留为符号位，其指示存储引用计数的“delta”的剩余增量计数部分的值是正还是负。 推迟到磁盘溢出计数部分的溢出更新，直到增量计数部分的所有位被消耗为负/正转移。

公开(公告)号：US09514165B2

公开(公告)日：2016-12-06

申请号：US14163054

申请日：2014-01-24

Applicant: NETAPP, INC.

Inventor： Ben George ,  Warren Dukes, Jr.

IPC: G06F17/30 ,  G06F3/06 ,  H04L29/08

CPC classification number: G06F17/30171 ,  G06F3/0619 ,  G06F3/0622 ,  G06F3/0647 ,  G06F3/0689 ,  G06F11/07 ,  G06F11/1076 ,  G06F11/16 ,  G06F17/30079 ,  G06F17/303 ,  G06F17/30362 ,  H04L67/1097

Abstract: Methods and systems for handling lock state information between a first storage system node and a second storage system node coupled via a network link are provided. The second storage system node stores lock state information at a storage device previously managed by the first storage system node and notifies the first storage system node of a storage device location where the lock state information is stored. The second storage system node then transfers ownership of the storage device to the first storage system node that copies the lock state information from the storage device location to a memory location managed by the first storage system node. The first storage system node uses the lock state information to reconstruct any locks for storage space presented to a client and then processes client requests for reading and writing information at the storage device.

Abstract translation: 提供了用于处理通过网络链路耦合的第一存储系统节点和第二存储系统节点之间的锁状态信息的方法和系统。 第二存储系统节点在先前由第一存储系统节点管理的存储设备处存储锁定状态信息，并且向第一存储系统节点通知存储设备存储锁定状态信息的位置。 第二存储系统节点然后将存储设备的所有权转移到第一存储系统节点，其将锁定状态信息从存储设备位置复制到由第一存储系统节点管理的存储器位置。 第一存储系统节点使用锁状态信息来重建呈现给客户端的存储空间的任何锁，然后处理客户端在存储设备处读取和写入信息的请求。

公开(公告)号：US09503522B2

公开(公告)日：2016-11-22

申请号：US14929122

申请日：2015-10-30

Applicant: NetApp, Inc.

Inventor： Steven Boyd Nelson

IPC: G06F13/12 ,  G06F13/38 ,  H04L29/08 ,  G06F3/06 ,  G06F11/00

CPC classification number: H04L67/1095 ,  G06F3/0604 ,  G06F3/061 ,  G06F3/0614 ,  G06F3/0619 ,  G06F3/0647 ,  G06F3/065 ,  G06F3/0665 ,  G06F3/067 ,  G06F11/00 ,  G06F11/0727 ,  G06F11/0751 ,  H04L67/1097

Abstract: Data objects can be migrated, while live, to virtualized clustered storage arrays in an efficient manner to allow for efficient transition from non-clustered storage to the virtualized clustered storage arrays. A data migration specification indicates data objects to be migrated and parameters for the migration. The parameters include a source of a data object, a destination of the data object in the virtualized clustered storage arrays, and a transfer space. A migration engine validates and parses the data migration specification. For each unique association of source, destination, and transfer space, the migration engine instantiates a migration process that drives and monitors migration of the corresponding data object. The migration processes operate in parallel for migration of the specified data objects into the virtualized clustered storage arrays.

公开(公告)号：US09501420B2

公开(公告)日：2016-11-22

申请号：US14520532

申请日：2014-10-22

Applicant: NetApp, Inc.

Inventor： Sai Rama Krishna Susarla ,  Sandeep Kumar Reddy Ummadi ,  William Patrick Delaney

IPC: G06F12/08

CPC classification number: G06F12/0897 ,  G06F12/0842 ,  G06F12/0862 ,  G06F12/0871 ,  G06F2212/283 ,  G06F2212/313 ,  G06F2212/6024 ,  G06F2212/6026

Abstract: A system and method for recognizing data access patterns in large data sets and for preloading a cache based on the recognized patterns is provided. In some embodiments, the method includes receiving a data transaction directed to an address space and recording the data transaction in a first set of counters and in a second set of counters. The first set of counters divides the address space into address ranges of a first size, whereas the second set of counters divides the address space into address ranges of a second size that is different from the first size. One of a storage device or a cache thereof is selected to service the data transaction based on the first set of counters, and data is preloaded into the cache based on the second set of counters.

Abstract translation: 提供一种用于识别大数据集中的数据访问模式并基于识别的模式来预加载高速缓存的系统和方法。 在一些实施例中，该方法包括接收指向地址空间的数据事务并将数据事务记录在第一组计数器和第二组计数器中。 第一组计数器将地址空间划分为第一大小的地址范围，而第二组计数器将地址空间划分为与第一大小不同的第二大小的地址范围。 选择存储设备或其高速缓存之一以基于第一组计数器来服务数据事务，并且基于第二组计数器将数据预加载到高速缓存中。

公开(公告)号：US20160336028A1

公开(公告)日：2016-11-17

申请号：US15220650

申请日：2016-07-27

Applicant: NetApp, Inc.

Inventor： David Anthony Slik ,  Maxim Gerard Smith ,  John William Haskins, JR.

IPC: G11B5/09 ,  G11B20/12

CPC classification number: G11B5/09 ,  G11B5/59694 ,  G11B20/1217 ,  G11B27/36 ,  G11B2020/1238 ,  G11B2020/1292 ,  G11B2220/2516

Abstract: Technology is disclosed for deferring storage operations (e.g., writes or reads) during hostile events. When a data storage device experiences a hostile event, e.g., a vibration, shock, etc. contact by a head of the data storage device with a disk surface can cause errors or indeed damage. The technology can cause a data storage device to suspend storage operations until the hostile event is no longer detected.

Abstract translation: 公开了用于在敌对事件期间推迟存储操作（例如，写入或读取）的技术。 当数据存储设备遇到具有磁盘表面的数据存储设备的头部的敌对事件（例如振动，冲击等）接触可能导致错误或确实的损坏。 该技术可能导致数据存储设备暂停存储操作，直到不再检测到敌对事件。

公开(公告)号：US09489312B2

公开(公告)日：2016-11-08

申请号：US14134108

申请日：2013-12-19

Applicant: NetApp Inc.

Inventor： Anshul Madan ,  James F. Lentini ,  Michael N. Condict ,  Stephen M. Byan

IPC: G06F17/30 ,  G06F12/08 ,  G06F17/00 ,  G06F13/00 ,  G06F15/16 ,  G06F11/30 ,  G06F3/06

CPC classification number: G06F3/0641 ,  G06F3/0608 ,  G06F3/0611 ,  G06F3/0659 ,  G06F3/067 ,  G06F3/0679 ,  G06F11/3037 ,  G06F12/0891 ,  G06F13/00 ,  G06F15/16 ,  G06F17/00 ,  G06F17/30 ,  G06F17/30097 ,  G06F17/30156 ,  G06F17/30162 ,  G06F17/30188 ,  G06F17/30194 ,  H04L67/2828 ,  H04L67/2852

Abstract: One or more techniques and/or systems are provided for performing host side deduplication. Host side deduplication may be performed upon writeable data within a write request received at a host computing device configured to access data stored by a storage server. The host side deduplication may be performed at the host computing device to determine whether the writeable data is already stored by the storage server based upon querying a host side cache comprising data stored by a storage server and/or a data structure comprising unique signatures of data stored by the storage server. If the writeable data is stored by the storage server, then a deduplication notification excluding the writeable data may be sent to the storage server, otherwise a write command comprising the writeable data may be sent. Accordingly, unnecessary network traffic of redundant data already stored by the storage server may be reduced.

公开(公告)号：US09483510B2

公开(公告)日：2016-11-01

申请号：US14255818

申请日：2014-04-17

Applicant: NetApp, Inc.

Inventor： Anand Sitaram ,  Sachin Maheshwari

IPC: G06T7/00 ,  G06F17/30

CPC classification number: G06F17/30312 ,  G06F11/3034 ,  G06F11/3409 ,  G06F11/3419 ,  G06F17/302 ,  G06F17/30864

Abstract: Technology is disclosed for providing access to operation performance of various storage mediums in a distributed storage system, which store and host data associated with a database (“the technology”). The technology can identify the storage mediums storing data associated with a particular database, gather data associated with performance of each of the identified storage mediums storing data associated with the particular database, and generate performance statistics associated with each of the identified storage mediums utilizing the gathered data and provide the generated statistics as a performance overview of storage associated with the particular database.

Abstract translation: 公开了用于提供存储和托管与数据库相关联的数据（“该技术”）的分布式存储系统中的各种存储介质的操作性能的技术。 该技术可以识别存储与特定数据库相关联的数据的存储介质，收集与存储与特定数据库相关联的数据的所识别的存储介质的性能相关联的数据，并且利用所收集的数据生成与识别的每个存储介质相关联的性能统计信息 数据，并将生成的统计信息提供为与特定数据库相关联的存储的性能概述。

公开(公告)号：US09483487B2

公开(公告)日：2016-11-01

申请号：US14456914

申请日：2014-08-11

Applicant: NetApp, Inc.

Inventor： Vivek Gupta ,  Ameet Pyati ,  Satish Singhal ,  Pawan Saxena

IPC: G06F12/00 ,  G06F17/30 ,  G06F3/06

CPC classification number: G06F17/30156 ,  G06F3/0608 ,  G06F3/0619 ,  G06F3/0641 ,  G06F3/0686 ,  G06F2003/0694

Abstract: A hardware and/or software facility to enable emulated storage devices to share data stored on physical storage resources of a storage system. The facility may be implemented on a virtual tape library (VTL) system configured to back up data sets that have a high level of redundancy on multiple virtual tapes. The facility organizes all or a portion of the physical storage resources according to a common store data layout. By enabling emulated storage devices to share data stored on physical storage resources, the facility enables deduplication across the emulated storage devices irrespective of the emulated storage device to which the data is or was originally written, thereby eliminating duplicate data on the physical storage resources and improving the storage consumption of the emulated storage devices on the physical storage resources.

Abstract translation: 一种用于使仿真存储设备共享存储在存储系统的物理存储资源上的数据的硬件和/或软件设施。 该设施可以在配置为备份在多个虚拟磁带上具有高冗余级别的数据集的虚拟磁带库（VTL）系统上实现。 该设施根据公共商店数据布局组织物理存储资源的全部或部分。 通过启用仿真存储设备来共享存储在物理存储资源上的数据，该设施可以在仿真存储设备上进行重复数据删除，而不管数据是或最初写入的仿真存储设备，从而消除物理存储资源上的重复数据，并改善 模拟存储设备对物理存​​储资源的存储消耗。