Extensible and elastic data management services engine external to a storage domain

    公开(公告)号:US11232160B2

    公开(公告)日:2022-01-25

    申请号:US16375942

    申请日:2019-04-05

    Applicant: NetApp Inc.

    Abstract: A data management services architecture includes architectural components that run in both a storage and compute domains. The architectural components redirect storage requests from the storage domain to the compute domain, manage resources allocated from the compute domain, ensure compliance with a policy that governs resource consumption, deploy program code for data management services, dispatch service requests to deployed services, and monitor deployed services. The architectural components also include a service map to locate program code for data management services, and service instance information for monitoring deployed services and dispatching requests to deployed services. Since deployed services can be stateless or stateful, the services architecture also includes state data for the stateful services, with supporting resources that can expand or contract based on policy and/or service demand. The architectural components also include containers for the deployed services.

    DATA STORAGE ARCHITECTURE FOR STORING METADATA WITH DATA
    12.
    发明申请
    DATA STORAGE ARCHITECTURE FOR STORING METADATA WITH DATA 审中-公开
    用数据存储元数据的数据存储架构

    公开(公告)号:US20160062674A1

    公开(公告)日:2016-03-03

    申请号:US14476609

    申请日:2014-09-03

    Applicant: NetApp, Inc.

    Abstract: Technology is disclosed for a data storage architecture for providing enhanced storage resiliency for a data object. The data storage architecture can be implemented in a single-tier configuration and/or a multi-tier configuration. In the single-tier configuration, a data object is encoded, e.g., based on an erasure coding method, to generate many data fragments, which are stored across many storage devices. In the multi-tier configuration, a data object is encoded, e.g., based on an erasure coding method, to generate many data segments, which are sent to one or more tiers of storage nodes. Each of the storage nodes further encodes the data segment to generate many data fragments representing the data segment, which are stored across many storage devices associated with the storage node. The I/O operations for rebuilding the data in case of device failures is spread across many storage devices, which minimizes the wear of a given storage device.

    Abstract translation: 公开了用于为数据对象提供增强的存储弹性的数据存储架构的技术。 数据存储架构可以在单层配置和/或多层配置中实现。 在单层配置中,例如基于擦除编码方法对数据对象进行编码,以生成许多存储在多个存储设备中的数据片段。 在多层配置中,例如基于擦除编码方法对数据对象进行编码,以生成发送到一层或多层存储节点的许多数据段。 每个存储节点进一步对数据段进行编码以生成表示数据段的许多数据片段,其被存储在与存储节点相关联的许多存储设备中。 在设备故障的情况下重建数据的I / O操作分布在许多存储设备中,这样可以最大限度地减少给定存储设备的磨损。

    Elastic, ephemeral in-line deduplication service

    公开(公告)号:US11537573B2

    公开(公告)日:2022-12-27

    申请号:US16807636

    申请日:2020-03-03

    Applicant: NetApp Inc.

    Abstract: A deduplication service can be provided to a storage domain from a services framework that expands and contracts to both meet service demand and to conform to resource management of a compute domain. The deduplication service maintains a fingerprint database and reference count data in compute domain resources, but persists these into the storage domain for use in the case of a failure or interruption of the deduplication service in the compute domain. The deduplication service responds to service requests from the storage domain with indications of paths in a user namespace and whether or not a piece of data had a fingerprint match in the fingerprint database. The indication of a match guides the storage domain to either store the piece of data into the storage backend or to reference another piece of data. The deduplication service uses the fingerprints to define paths for corresponding pieces of data.

    EXTENSIBLE AND ELASTIC DATA MANAGEMENT SERVICES ENGINE EXTERNAL TO A STORAGE DOMAIN

    公开(公告)号:US20190238641A1

    公开(公告)日:2019-08-01

    申请号:US16375942

    申请日:2019-04-05

    Applicant: NetApp Inc.

    CPC classification number: H04L67/142 H04L67/1097 H04L67/327

    Abstract: A data management services architecture includes architectural components that run in both a storage and compute domains. The architectural components redirect storage requests from the storage domain to the compute domain, manage resources allocated from the compute domain, ensure compliance with a policy that governs resource consumption, deploy program code for data management services, dispatch service requests to deployed services, and monitor deployed services. The architectural components also include a service map to locate program code for data management services, and service instance information for monitoring deployed services and dispatching requests to deployed services. Since deployed services can be stateless or stateful, the services architecture also includes state data for the stateful services, with supporting resources that can expand or contract based on policy and/or service demand. The architectural components also include containers for the deployed services.

    Hierarchical data storage architecture

    公开(公告)号:US09665427B2

    公开(公告)日:2017-05-30

    申请号:US14481311

    申请日:2014-09-09

    Applicant: NetApp, Inc.

    Abstract: Technology is disclosed for a data storage architecture for providing enhanced storage resiliency for a data object. The data storage architecture can be implemented in a single-tier configuration and/or a multi-tier configuration. In the single-tier configuration, a data object is encoded, e.g., based on an erasure coding method, to generate many data fragments, which are stored across many storage devices. In the multi-tier configuration, a data object is encoded, e.g., based on an erasure coding method, to generate many data segments, which are sent to one or more tiers of storage nodes. Each of the storage nodes further encodes the data segment to generate many data fragments representing the data segment, which are stored across many storage devices associated with the storage node. The I/O operations for rebuilding the data in case of device failures is spread across many storage devices, which minimizes the wear of a given storage device.

    EXTENSIBLE AND ELASTIC DATA MANAGEMENT SERVICES ENGINE EXTERNAL TO A STORAGE DOMAIN
    16.
    发明申请
    EXTENSIBLE AND ELASTIC DATA MANAGEMENT SERVICES ENGINE EXTERNAL TO A STORAGE DOMAIN 审中-公开
    可扩展和弹性数据管理服务引擎到外部存储域

    公开(公告)号:US20170031955A1

    公开(公告)日:2017-02-02

    申请号:US14815470

    申请日:2015-07-31

    Applicant: NetApp, Inc.

    CPC classification number: H04L67/142 H04L67/1097 H04L67/327

    Abstract: A data management services architecture includes architectural components that run in both a storage and compute domains. The architectural components redirect storage requests from the storage domain to the compute domain, manage resources allocated from the compute domain, ensure compliance with a policy that governs resource consumption, deploy program code for data management services, dispatch service requests to deployed services, and monitor deployed services. The architectural components also include a service map to locate program code for data management services, and service instance information for monitoring deployed services and dispatching requests to deployed services. Since deployed services can be stateless or stateful, the services architecture also includes state data for the stateful services, with supporting resources that can expand or contract based on policy and/or service demand. The architectural components also include containers for the deployed services.

    Abstract translation: 数据管理服务架构包括在存储和计算域中运行的架构组件。 架构组件将存储请求从存储域重定向到计算域,管理从计算域分配的资源,确保符合管理资源消耗的策略,部署数据管理服务的程序代码,向部署的服务发送服务请求,并监视 部署服务。 架构组件还包括用于定位用于数据管理服务的程序代码的服务映射,以及用于监视所部署的服务并向部署的服务发送请求的服务实例信息。 由于部署的服务可以是无状态的或有状态的,所以服务体系结构还包括有状态服务的状态数据,可以根据策略和/或服务需求扩展或合同的支持资源。 架构组件还包括部署服务的容器。

    FILE SYSTEM FOR EFFICIENT OBJECT FRAGMENT ACCESS
    17.
    发明申请
    FILE SYSTEM FOR EFFICIENT OBJECT FRAGMENT ACCESS 有权
    用于有效对象片段访问的文件系统

    公开(公告)号:US20160063008A1

    公开(公告)日:2016-03-03

    申请号:US14475332

    申请日:2014-09-02

    Applicant: NetApp, Inc.

    CPC classification number: G06F17/30082 G06F17/3012

    Abstract: Technology is disclosed for accessing data fragments of data objects. The method receives a request for storing a data fragment of a data object in the storage server. The request includes an object identifier of the data object. The method further extracts a first string from the object identifier. The method then determines whether there is an existing file system object having a file system name that matches the first string. If there is no file system object that has a file system name that matches the first string, the method stores the data fragment as a fragment file with a file system name matching the first string.

    Abstract translation: 公开了用于访问数据对象的数据片段的技术。 该方法接收在存储服务器中存储数据对象的数据片段的请求。 请求包括数据对象的对象标识符。 该方法还从对象标识符中提取第一个字符串。 该方法然后确定是否存在具有与第一个字符串匹配的文件系统名称的现有文件系统对象。 如果没有与第一个字符串匹配的文件系统名称的文件系统对象,则该方法将数据片段存储为具有与第一个字符串匹配的文件系统名称的片段文件。

Patent Agency Ranking