Object store architecture for distributed data processing system
    1.
    发明授权
    Object store architecture for distributed data processing system 有权
    分布式数据处理系统的对象存储体系结构

    公开(公告)号:US09582213B2

    公开(公告)日:2017-02-28

    申请号:US14939760

    申请日:2015-11-12

    Applicant: NetApp, Inc.

    Abstract: Embodiments described herein provide an object store that efficiently manages and services objects for use by clients of a distributed data processing system. Illustratively, the object store may be embodied as a quasi-shared storage system that interacts with nodes of the distributed data processing system to service the objects as blocks of data stored on a plurality of storage devices, such as disks, of the storage system. To that end, an architecture of the object store may include an on-disk layout, e.g., of the storage system, and an incore layout, e.g., of the nodes, that cooperate to illustratively convert the blocks to objects for access by the clients.

    Abstract translation: 本文描述的实施例提供了有效地管理和服务对象以供分布式数据处理系统的客户端使用的对象存储。 示例性地,对象存储可以被体现为准共享存储系统,其与分布式数据处理系统的节点进行交互,以将对象作为存储在存储系统的多个存储设备(例如磁盘)上的数据块。 为此,对象商店的架构可以包括例如存储系统的磁盘布局,以及诸如节点之类的布局布局,这些布局协作以示意性地将块转换为对象以供客户端访问 。

    OBJECT STORE ARCHITECTURE FOR DISTRIBUTED DATA PROCESSING SYSTEM
    2.
    发明申请
    OBJECT STORE ARCHITECTURE FOR DISTRIBUTED DATA PROCESSING SYSTEM 有权
    分布式数据处理系统的对象存储架构

    公开(公告)号:US20160062694A1

    公开(公告)日:2016-03-03

    申请号:US14939760

    申请日:2015-11-12

    Applicant: NetApp, Inc.

    Abstract: Embodiments described herein provide an object store that efficiently manages and services objects for use by clients of a distributed data processing system. Illustratively, the object store may be embodied as a quasi-shared storage system that interacts with nodes of the distributed data processing system to service the objects as blocks of data stored on a plurality of storage devices, such as disks, of the storage system. To that end, an architecture of the object store may include an on-disk layout, e.g., of the storage system, and an incore layout, e.g., of the nodes, that cooperate to illustratively convert the blocks to objects for access by the clients.

    Abstract translation: 本文描述的实施例提供了有效地管理和服务对象以供分布式数据处理系统的客户端使用的对象存储。 示例性地,对象存储可以被体现为准共享存储系统,其与分布式数据处理系统的节点进行交互,以将对象作为存储在存储系统的多个存储设备(例如磁盘)上的数据块。 为此,对象商店的架构可以包括例如存储系统的磁盘布局,以及诸如节点之类的布局布局,这些布局协作以示意性地将块转换为对象以供客户端访问 。

    STORAGE ARCHITECTURE FOR SERVER FLASH AND STORAGE ARRAY OPERATION
    3.
    发明申请
    STORAGE ARCHITECTURE FOR SERVER FLASH AND STORAGE ARRAY OPERATION 有权
    用于服务器闪存和存储阵列操作的存储架构

    公开(公告)号:US20140095758A1

    公开(公告)日:2014-04-03

    申请号:US13630664

    申请日:2012-09-28

    Applicant: NETAPP, INC.

    CPC classification number: G06F3/0613 G06F3/0656 G06F3/0685 G06F12/0866

    Abstract: A storage architecture of a storage system environment has a storage connector interface configured to exchange data directly between flash storage devices on a server and a storage array of the environment so as to bypass main memory and a system bus of the server. According to one or more embodiments, the storage connnector interface includes control logic configured to implement the data exchange in accordance with one of a plurality of operational modes that deploy and synchronize the data on the flash storage devices and the storage array. Advantageously, the storage connector interface obviates latencies and bandwidth consumption associated with prior data exchanges over the main memory and bus, thereby enhancing storage architecture performance.

    Abstract translation: 存储系统环境的存储架构具有被配置为在服务器上的闪存存储设备与环境的存储阵列之间直接交换数据的存储连接器接口,以便绕过主存储器和服务器的系统总线。 根据一个或多个实施例,存储连接器接口包括控制逻辑,其被配置为根据在闪存存储设备和存储阵列上部署和同步数据的多个操作模式之一来实现数据交换。 有利地,存储连接器接口消除与主存储器和总线上的先前数据交换相关联的延迟和带宽消耗,从而增强存储架构性能。

    Extent-based storage architecture
    4.
    发明授权
    Extent-based storage architecture 有权
    基于范围的存储架构

    公开(公告)号:US08924440B2

    公开(公告)日:2014-12-30

    申请号:US13968117

    申请日:2013-08-15

    Applicant: NetApp, Inc.

    Abstract: An extent-based storage architecture is implemented by a storage server receiving a read request for an extent from a client, wherein the extent includes a group of contiguous blocks and the read request includes a file block number. The storage server retrieves an extent identifier from a first sorted data structure, wherein the storage server uses the received file block number to traverse the first sorted data structure to the extent identifier. The storage server retrieves a reference to the extent from a second sorted data structure, wherein the storage server uses the retrieved extent identifier to traverse the second sorted data structure to the reference, and wherein the second sorted data structure is global across a plurality of volumes. The storage server retrieves the extent from a storage device using the reference and returns the extent to the client.

    Abstract translation: 基于范围的存储架构由存储服务器实现,所述存储服务器从客户端接收对范围的读取请求,其中所述扩展区包括一组相邻块,并且所述读取请求包括文件块号。 存储服务器从第一排序数据结构检索区段标识符,其中存储服务器使用接收到的文件块号来遍历第一排序数据结构到区段标识符。 存储服务器从第二排序数据结构检索对范围的引用,其中存储服务器使用所检索的扩展名标识符遍历到引用的第二排序数据结构,并且其中第二排序数据结构在多个卷中是全局的 。 存储服务器使用引用从存储设备检索范围,并将该范围返回给客户端。

    Flash optimized, log-structured layer of a file system
    5.
    发明授权
    Flash optimized, log-structured layer of a file system 有权
    闪存优化,文件系统的日志结构层

    公开(公告)号:US08880788B1

    公开(公告)日:2014-11-04

    申请号:US14160991

    申请日:2014-01-22

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, a flash-optimized, log-structured layer of a file system of a storage input/output (I/O) stack executes on one or more nodes of a cluster. The log-structured layer of the file system provides sequential storage of data and metadata on solid state drives (SSDs) to reduce write amplification, while leveraging variable compression and variable length data features of the storage I/O stack. The data may be organized as an arbitrary number of variable-length extents of one or more host-visible logical units (LUNs). The metadata may include mappings from host-visible logical block address ranges of a LUN to extent keys, as well as mappings of the extent keys to SSD storage locations of the extents. The storage location of an extent on SSD is effectively “virtualized” by its mapped extent key such that relocation of the extent on SSD does not require update to volume layer metadata.

    Abstract translation: 在一个实施例中,存储输入/输出(I / O)堆栈的文件系统的闪存优化的日志结构化层在集群的一个或多个节点上执行。 文件系统的日志结构化层在固态驱动器(SSD)上提供数据和元数据的顺序存储,以减少写入放大,同时利用存储I / O堆栈的可变压缩和可变长度数据特征。 数据可以被组织为一个或多个主机可见逻辑单元(LUN)的任意数量的可变长度盘区。 元数据可以包括从LUN到扩展密钥的主机可见逻辑块地址范围的映射,以及扩展密钥到扩展区的SSD存储位置的映射。 SSD上的盘区的存储位置被其映射的盘区密钥有效地“虚拟化”,使得SSD上盘区的重新定位不需要更新到卷层元数据。

    Flash optimized, log-structured layer of a file system
    6.
    发明授权
    Flash optimized, log-structured layer of a file system 有权
    闪存优化,文件系统的日志结构层

    公开(公告)号:US09448924B2

    公开(公告)日:2016-09-20

    申请号:US14150717

    申请日:2014-01-08

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, storage arrays of solid state drives (SSDs) coupled to a node are organized as redundant array of independent disks (RAID) groups. Each storage array includes one or more segments. Each segment has contiguous free space on the SSDs. Data and metadata is organized on the SSDs with a sequential log-structured layout, with the data organized as variable-length extents of one or more logical units (LUNs). Segment cleaning is performed to clean a selected segment by moving the extents of the selected segment that contain valid data to one or more different segments so as to free the selected segment. Additional extents are written as a sequence of contiguous range write operations to the entire free segment with temporal locality to reduce data relocation within the SSDs as a result of the write operations.

    Abstract translation: 在一个实施例中,耦合到节点的固态驱动器(SSD)的存储阵列被组织为独立磁盘(RAID)组的冗余阵列。 每个存储阵列包括一个或多个段。 每个段在SSD上具有连续的可用空间。 数据和元数据在具有顺序日志结构布局的SSD上组织,数据组织为一个或多个逻辑单元(LUN)的可变长度范围。 执行段清洁以通过将包含有效数据的所选段的范围移动到一个或多个不同段来清理所选择的段,以便释放所选择的段。 作为连续范围写入操作的序列,附加范围被写入具有时间局部性的整个空闲段,以减少作为写入操作的结果的SSD内的数据重定位。

    FLASH OPTIMIZED, LOG-STRUCTURED LAYER OF A FILE SYSTEM
    7.
    发明申请
    FLASH OPTIMIZED, LOG-STRUCTURED LAYER OF A FILE SYSTEM 有权
    闪存优化,文件系统的日志结构层

    公开(公告)号:US20150193338A1

    公开(公告)日:2015-07-09

    申请号:US14150717

    申请日:2014-01-08

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, storage arrays of solid state drives (SSDs) coupled to a node are organized as redundant array of independent disks (RAID) groups. Each storage array includes one or more segments. Each segment has contiguous free space on the SSDs. Data and metadata is organized on the SSDs with a sequential log-structured layout, with the data organized as variable-length extents of one or more logical units (LUNs). Segment cleaning is performed to clean a selected segment by moving the extents of the selected segment that contain valid data to one or more different segments so as to free the selected segment. Additional extents are written as a sequence of contiguous range write operations to the entire free segment with temporal locality to reduce data relocation within the SSDs as a result of the write operations.

    Abstract translation: 在一个实施例中,耦合到节点的固态驱动器(SSD)的存储阵列被组织为独立磁盘(RAID)组的冗余阵列。 每个存储阵列包括一个或多个段。 每个段在SSD上具有连续的可用空间。 数据和元数据在具有顺序日志结构布局的SSD上组织,数据组织为一个或多个逻辑单元(LUN)的可变长度范围。 执行段清洁以通过将包含有效数据的所选段的范围移动到一个或多个不同段来清理所选择的段,以便释放所选择的段。 作为连续范围写入操作的序列,附加范围被写入具有时间局部性的整个空闲段,以减少作为写入操作的结果的SSD内的数据重定位。

    Flash optimized, log-structured layer of a file system

    公开(公告)号:US10042853B2

    公开(公告)日:2018-08-07

    申请号:US15239125

    申请日:2016-08-17

    Applicant: NetApp, Inc.

    Abstract: A flash-optimized, log-structured layer of a file system of a storage input/output (I/O) stack executes on one or more nodes of a cluster. The log-structured layer of the file system provides sequential storage of data and metadata (i.e., a log-structured layout) on solid state drives (SSDs) of storage arrays in the cluster to reduce write amplification, while leveraging variable compression and variable length data features of the storage I/O stack. The data may be organized as an arbitrary number of variable-length extents of one or more host-visible logical units (LUNs) served by the nodes. The metadata may include mappings from host-visible logical block address ranges (i.e., offset ranges) of a LUN to extent keys, as well as mappings of the extent keys to SSD storage locations of the extents. The storage location of an extent on SSD is effectively “virtualized” by its mapped extent key (i.e., extent store layer mappings) such that relocation of the extent on SSD does require update to volume layer metadata (i.e., the extent key sufficiently identifies the extent).

    FLASH OPTIMIZED, LOG-STRUCTURED LAYER OF A FILE SYSTEM
    9.
    发明申请
    FLASH OPTIMIZED, LOG-STRUCTURED LAYER OF A FILE SYSTEM 审中-公开
    闪存优化,文件系统的日志结构层

    公开(公告)号:US20160357776A1

    公开(公告)日:2016-12-08

    申请号:US15239125

    申请日:2016-08-17

    Applicant: NetApp, Inc.

    Abstract: A flash-optimized, log-structured layer of a file system of a storage input/output (I/O) stack executes on one or more nodes of a cluster. The log-structured layer of the file system provides sequential storage of data and metadata (i.e., a log-structured layout) on solid state drives (SSDs) of storage arrays in the cluster to reduce write amplification, while leveraging variable compression and variable length data features of the storage I/O stack. The data may be organized as an arbitrary number of variable-length extents of one or more host-visible logical units (LUNs) served by the nodes. The metadata may include mappings from host-visible logical block address ranges (i.e., offset ranges) of a LUN to extent keys, as well as mappings of the extent keys to SSD storage locations of the extents. The storage location of an extent on SSD is effectively “virtualized” by its mapped extent key (i.e., extent store layer mappings) such that relocation of the extent on SSD does require update to volume layer metadata (i.e., the extent key sufficiently identifies the extent).

    Abstract translation: 存储输入/输出(I / O)堆栈的文件系统的闪存优化的日志结构化层在集群的一个或多个节点上执行。 文件系统的日志结构化层在集群中的存储阵列的固态驱动器(SSD)上提供数据和元数据(即,日志结构化布局)的顺序存储,以减少写入放大,同时利用可变压缩和可变长度 存储I / O堆栈的数据特征。 数据可以被组织为由节点服务的一个或多个主机可见逻辑单元(LUN)的可变长度范围的任意数量。 元数据可以包括从LUN到扩展密钥的主机可见逻辑块地址范围(即,偏移范围)的映射,以及扩展密钥到扩展区的SSD存储位置的映射。 SSD上的盘区的存储位置被其映射的盘区密钥(即,盘区存储层映射)有效地“虚拟化”,使得SSD上盘区的重新定位需要更新到卷层元数据(即,扩展密钥足够地识别 程度)。

    Storage architecture for server flash and storage array operation
    10.
    发明授权
    Storage architecture for server flash and storage array operation 有权
    服务器闪存和存储阵列操作的存储架构

    公开(公告)号:US09146684B2

    公开(公告)日:2015-09-29

    申请号:US13630664

    申请日:2012-09-28

    Applicant: NetApp, Inc.

    CPC classification number: G06F3/0613 G06F3/0656 G06F3/0685 G06F12/0866

    Abstract: A storage architecture of a storage system environment has a storage connector interface configured to exchange data directly between flash storage devices on a server and a storage array of the environment so as to bypass main memory and a system bus of the server. According to one or more embodiments, the storage connnector interface includes control logic configured to implement the data exchange in accordance with one of a plurality of operational modes that deploy and synchronize the data on the flash storage devices and the storage array. Advantageously, the storage connector interface obviates latencies and bandwidth consumption associated with prior data exchanges over the main memory and bus, thereby enhancing storage architecture performance.

    Abstract translation: 存储系统环境的存储架构具有被配置为在服务器上的闪存存储设备与环境的存储阵列之间直接交换数据的存储连接器接口,以便绕过主存储器和服务器的系统总线。 根据一个或多个实施例,存储连接器接口包括控制逻辑,其被配置为根据在闪存存储设备和存储阵列上部署和同步数据的多个操作模式之一来实现数据交换。 有利地,存储连接器接口消除与主存储器和总线上的先前数据交换相关联的延迟和带宽消耗,从而增强存储架构性能。

Patent Agency Ranking