-
公开(公告)号:US09767104B2
公开(公告)日:2017-09-19
申请号:US14475332
申请日:2014-09-02
Applicant: NetApp, Inc.
Inventor: Barry Patrick Benight
IPC: G06F17/30
CPC classification number: G06F17/30082 , G06F17/3012
Abstract: Technology is disclosed for accessing data fragments of data objects. The method receives a request for storing a data fragment of a data object in the storage server. The request includes an object identifier of the data object. The method further extracts a first string from the object identifier. The method then determines whether there is an existing file system object having a file system name that matches the first string. If there is no file system object that has a file system name that matches the first string, the method stores the data fragment as a fragment file with a file system name matching the first string.
-
公开(公告)号:US20160239384A1
公开(公告)日:2016-08-18
申请号:US15143437
申请日:2016-04-29
Applicant: NetApp, Inc.
Inventor: David Anthony Slik , Barry Patrick Benight
CPC classification number: G06F11/1076 , G06F11/1092 , G06F17/30312 , G06F2003/0692 , H03M13/154 , H04L67/1097 , H04L69/40
Abstract: Systems and techniques for managing data storage are disclosed. In some aspects, a front-end node responds to a request to write an object by dividing the object into multiple source data segments. The front-end node generates redundancy data for the multiple source data segments using a rateless erasure encoding. The front-end node associates a respective subset of the redundancy data with each of the multiple source data segments, wherein each subset of redundancy data and associated source data segment form an encoded segment. The rateless erasure encoding further includes defining multiple segment-level fragments within each of the encoded segments. The front-end node transmits each of the encoded segments to a selected one of multiple storage nodes, wherein each of the selected storage nodes are selected based on a determined storage layout of the encoded segments across the multiple storage nodes. For each of the received encoded segments, the storage node generates one or more protection fragments based on redundancy data generated from the segment-level fragments and stores the segment-level fragments and corresponding protection fragments across multiple storage media devices managed by the selected storage node.
Abstract translation: 公开了用于管理数据存储的系统和技术。 在某些方面,前端节点通过将对象划分成多个源数据段来响应写入对象的请求。 前端节点使用无可擦除擦除编码生成多个源数据段的冗余数据。 前端节点将冗余数据的相应子集与多个源数据段中的每一个相关联,其中冗余数据和相关源数据段的每个子集形成编码段。 无限擦除编码还包括在每个编码段内定义多个片段级片段。 前端节点将每个编码的段传输到多个存储节点中的一个选定的一个,其中基于所确定的跨多个存储节点的编码段的存储布局来选择所选择的存储节点中的每一个。 对于每个接收到的编码段,存储节点基于从段级别片段生成的冗余数据生成一个或多个保护片段,并将片段级片段和对应的保护片段存储在由所选存储节点管理的多个存储媒体设备 。
-
公开(公告)号:US20160062832A1
公开(公告)日:2016-03-03
申请号:US14475376
申请日:2014-09-02
Applicant: NetApp. Inc.
Inventor: David Slik , Barry Patrick Benight
CPC classification number: G06F11/1076 , G06F3/064 , G06F3/0683 , G06F3/0689 , G06F11/1092 , G06F16/22 , G06F2003/0692 , H04L67/1097
Abstract: Technology is disclosed for a data storage architecture for providing enhanced storage resiliency for a data object. The data storage architecture can be implemented in a single-tier configuration and/or a multi-tier configuration. In the single-tier configuration, a data object is encoded, e.g., based on an erasure coding method, to generate many data fragments, which are stored across many storage devices. In the multi-tier configuration, a data object is encoded, e.g., based on an erasure coding method, to generate many data segments, which are sent to one or more tiers of storage nodes. Each of the storage nodes further encodes the data segment to generate many data fragments representing the data segment, which are stored across many storage devices associated with the storage node. The I/O operations for rebuilding the data in case of device failures is spread across many storage devices, which minimizes the wear of a given storage device.
Abstract translation: 公开了用于为数据对象提供增强的存储弹性的数据存储架构的技术。 数据存储架构可以在单层配置和/或多层配置中实现。 在单层配置中,例如基于擦除编码方法对数据对象进行编码,以生成许多存储在多个存储设备中的数据片段。 在多层配置中,例如基于擦除编码方法对数据对象进行编码,以生成发送到一层或多层存储节点的许多数据段。 每个存储节点进一步对数据段进行编码以生成表示数据段的许多数据片段,其被存储在与存储节点相关联的许多存储设备中。 在设备故障的情况下重建数据的I / O操作分布在许多存储设备中,这样可以最大限度地减少给定存储设备的磨损。
-
公开(公告)号:US11709897B2
公开(公告)日:2023-07-25
申请号:US17013712
申请日:2020-09-07
Applicant: NetApp Inc.
Inventor: Deepak Raghu Kenchammana-Hosekote , Shiva Chaitanya , Saeed Ghanbari , Barry Patrick Benight , David Anthony Slik
IPC: G06F16/93 , H04L67/142 , H04L67/1097 , G06F16/20 , G06F16/10 , H04L67/63
CPC classification number: G06F16/93 , G06F16/10 , G06F16/20 , H04L67/1097 , H04L67/142 , H04L67/63
Abstract: A data management services architecture includes architectural components that run in both a storage and compute domains. The architectural components redirect storage requests from the storage domain to the compute domain, manage resources allocated from the compute domain, ensure compliance with a policy that governs resource consumption, deploy program code for data management services, dispatch service requests to deployed services, and monitor deployed services. The architectural components also include a service map to locate program code for data management services, and service instance information for monitoring deployed services and dispatching requests to deployed services. Since deployed services can be stateless or stateful, the services architecture also includes state data for the stateful services, with supporting resources that can expand or contract based on policy and/or service demand. The architectural components also include containers for the deployed services.
-
公开(公告)号:US20190238640A1
公开(公告)日:2019-08-01
申请号:US16375929
申请日:2019-04-05
Applicant: NetApp Inc.
Inventor: Deepak Raghu Kenchammana-Hosekote , Shiva Chaitanya , Saeed Ghanbari , Barry Patrick Benight , David Anthony Slik
IPC: H04L29/08
CPC classification number: H04L67/142 , H04L67/1097 , H04L67/327
Abstract: A data management services architecture includes architectural components that run in both a storage and compute domains. The architectural components redirect storage requests from the storage domain to the compute domain, manage resources allocated from the compute domain, ensure compliance with a policy that governs resource consumption, deploy program code for data management services, dispatch service requests to deployed services, and monitor deployed services. The architectural components also include a service map to locate program code for data management services, and service instance information for monitoring deployed services and dispatching requests to deployed services. Since deployed services can be stateless or stateful, the services architecture also includes state data for the stateful services, with supporting resources that can expand or contract based on policy and/or service demand. The architectural components also include containers for the deployed services.
-
公开(公告)号:US20170091232A1
公开(公告)日:2017-03-30
申请号:US14866683
申请日:2015-09-25
Applicant: NetApp, Inc.
Inventor: Saeed Ghanbari , Barry Patrick Benight , Deepak Raghu Kenchammana-Hosekote , Shiva Chaitanya
IPC: G06F17/30
Abstract: A deduplication service can be provided to a storage domain from a services framework that expands and contracts to both meet service demand and to conform to resource management of a compute domain. The deduplication service maintains a fingerprint database and reference count data in compute domain resources, but persists these into the storage domain for use in the case of a failure or interruption of the deduplication service in the compute domain. The deduplication service responds to service requests from the storage domain with indications of paths in a user namespace and whether or not a piece of data had a fingerprint match in the fingerprint database. The indication of a match guides the storage domain to either store the piece of data into the storage backend or to reference another piece of data. The deduplication service uses the fingerprints to define paths for corresponding pieces of data.
-
公开(公告)号:US20240126820A1
公开(公告)日:2024-04-18
申请号:US18357277
申请日:2023-07-24
Applicant: NetApp Inc.
Inventor: Deepak Raghu Kenchammana-Hosekote , Shiva Chaitanya , Saeed Ghanbari , Barry Patrick Benight , David Anthony Slik
IPC: G06F16/93 , G06F16/10 , G06F16/20 , H04L67/1097 , H04L67/142 , H04L67/63
CPC classification number: G06F16/93 , G06F16/10 , G06F16/20 , H04L67/1097 , H04L67/142 , H04L67/63
Abstract: A data management services architecture includes architectural components that run in both a storage and compute domains. The architectural components redirect storage requests from the storage domain to the compute domain, manage resources allocated from the compute domain, ensure compliance with a policy that governs resource consumption, deploy program code for data management services, dispatch service requests to deployed services, and monitor deployed services. The architectural components also include a service map to locate program code for data management services, and service instance information for monitoring deployed services and dispatching requests to deployed services. Since deployed services can be stateless or stateful, the services architecture also includes state data for the stateful services, with supporting resources that can expand or contract based on policy and/or service demand. The architectural components also include containers for the deployed services.
-
公开(公告)号:US10769212B2
公开(公告)日:2020-09-08
申请号:US14815470
申请日:2015-07-31
Applicant: NetApp, Inc.
Inventor: Deepak Raghu Kenchammana-Hosekote , Shiva Chaitanya , Saeed Ghanbari , Barry Patrick Benight , David Anthony Slik
Abstract: A data management services architecture includes architectural components that run in both a storage and compute domains. The architectural components redirect storage requests from the storage domain to the compute domain, manage resources allocated from the compute domain, ensure compliance with a policy that governs resource consumption, deploy program code for data management services, dispatch service requests to deployed services, and monitor deployed services. The architectural components also include a service map to locate program code for data management services, and service instance information for monitoring deployed services and dispatching requests to deployed services. Since deployed services can be stateless or stateful, the services architecture also includes state data for the stateful services, with supporting resources that can expand or contract based on policy and/or service demand. The architectural components also include containers for the deployed services.
-
公开(公告)号:US09823969B2
公开(公告)日:2017-11-21
申请号:US15143437
申请日:2016-04-29
Applicant: NetApp, Inc.
Inventor: David Anthony Slik , Barry Patrick Benight
CPC classification number: G06F11/1076 , G06F11/1092 , G06F17/30312 , G06F2003/0692 , H03M13/154 , H04L67/1097 , H04L69/40
Abstract: Systems and techniques for managing data storage are disclosed. In some aspects, a front-end node responds to a request to write an object by dividing the object into multiple source data segments. The front-end node generates redundancy data for the multiple source data segments using a rateless erasure encoding. The front-end node associates a respective subset of the redundancy data with each of the multiple source data segments, wherein each subset of redundancy data and associated source data segment form an encoded segment. The rateless erasure encoding further includes defining multiple segment-level fragments within each of the encoded segments. The front-end node transmits each of the encoded segments to a selected one of multiple storage nodes, wherein each of the selected storage nodes are selected based on a determined storage layout of the encoded segments across the multiple storage nodes. For each of the received encoded segments, the storage node generates one or more protection fragments based on redundancy data generated from the segment-level fragments and stores the segment-level fragments and corresponding protection fragments across multiple storage media devices managed by the selected storage node.
-
公开(公告)号:US20230086414A1
公开(公告)日:2023-03-23
申请号:US18071790
申请日:2022-11-30
Applicant: NetApp Inc.
Inventor: Saeed Ghanbari , Barry Patrick Benight , Deepak Raghu Kenchammana-Hosekote , Shiva Chaitanya
IPC: G06F16/215 , G06F16/2458 , G06F16/174
Abstract: A deduplication service can be provided to a storage domain from a services framework that expands and contracts to both meet service demand and to conform to resource management of a compute domain. The deduplication service maintains a fingerprint database and reference count data in compute domain resources, but persists these into the storage domain for use in the case of a failure or interruption of the deduplication service in the compute domain. The deduplication service responds to service requests from the storage domain with indications of paths in a user namespace and whether or not a piece of data had a fingerprint match in the fingerprint database. The indication of a match guides the storage domain to either store the piece of data into the storage backend or to reference another piece of data. The deduplication service uses the fingerprints to define paths for corresponding pieces of data.
-
-
-
-
-
-
-
-
-