公开(公告)号：US20160062694A1

公开(公告)日：2016-03-03

申请号：US14939760

申请日：2015-11-12

Applicant: NetApp, Inc.

Inventor： Gaurav Makkar ,  Srinivasan Narayanamurthy ,  Kartheek Muthyala ,  Stephen Daniel

IPC: G06F3/06

CPC classification number: G06F3/0629 ,  G06F3/0604 ,  G06F3/061 ,  G06F3/064 ,  G06F3/0643 ,  G06F3/067 ,  G06F3/0689 ,  G06F17/30165

Abstract: Embodiments described herein provide an object store that efficiently manages and services objects for use by clients of a distributed data processing system. Illustratively, the object store may be embodied as a quasi-shared storage system that interacts with nodes of the distributed data processing system to service the objects as blocks of data stored on a plurality of storage devices, such as disks, of the storage system. To that end, an architecture of the object store may include an on-disk layout, e.g., of the storage system, and an incore layout, e.g., of the nodes, that cooperate to illustratively convert the blocks to objects for access by the clients.

Abstract translation: 本文描述的实施例提供了有效地管理和服务对象以供分布式数据处理系统的客户端使用的对象存储。 示例性地，对象存储可以被体现为准共享存储系统，其与分布式数据处理系统的节点进行交互，以将对象作为存储在存储系统的多个存储设备（例如磁盘）上的数据块。 为此，对象商店的架构可以包括例如存储系统的磁盘布局，以及诸如节点之类的布局布局，这些布局协作以示意性地将块转换为对象以供客户端访问 。

公开(公告)号：US10423499B2

公开(公告)日：2019-09-24

申请号：US15081582

申请日：2016-03-25

Applicant: NetApp, Inc.

Inventor： Ranjit Kumar ,  Kartheek Muthyala ,  Sisir Shekhar

IPC: G06F11/14 ,  G06F16/16

Abstract: A method and system for managing backup storage of file system entities. In an aspect, a file system catalog includes a database populator tool that generates records within a metadata table that may be maintained within a database. In response to detecting a replication cycle, the populator tool reads a stream of replication operations. For each of the replication operations, the populator tool determines the type of operation and in response to determining that a directory inode is an operand of the replication operation, the tool generates one or more catalog records. Each of the generated records includes and logically associates data entries corresponding to an inode number, a parent inode number, an entity type, a point-in-time-image (PTI) ID, an absolute path, and an operation.

公开(公告)号：US20190026192A1

公开(公告)日：2019-01-24

申请号：US16138551

申请日：2018-09-21

Applicant: NetApp, Inc.

Inventor： Kartheek Muthyala ,  Ranjit Kumar ,  Sisir Shekhar

IPC: G06F11/14 ,  G06F3/06 ,  G06F17/30

Abstract: Technology is disclosed for backing up data to and recovering data from a destination storage system that stores data in a format different form that of a primary storage system (“the technology”). A replication stream having the data of multiple files, metadata of the files, and reference maps including a mapping of the corresponding file to a portion of the data of the corresponding file is generated at the primary storage system. The replication stream is sent to a parser to map or convert the data, the files, and the reference maps to multiple storage objects in a format the destination storage system is configured to store. Various types of storage objects are generated, including a first type of the storage objects having the data, a second type of storage objects storing the reference maps, and a third type of the storage objects storing metadata of the files.

公开(公告)号：US09575974B2

公开(公告)日：2017-02-21

申请号：US14137706

申请日：2013-12-20

Applicant: NetApp, Inc.

Inventor： Kartheek Muthyala ,  Gaurav Makkar ,  Arun Suresh ,  Srinivasan Narayanamurthy

IPC: G06F17/30

CPC classification number: G06F17/30076 ,  G06F17/30094 ,  G06F17/30182 ,  G06F17/30194 ,  G06F17/30227

Abstract: Technology is disclosed for managing data in a distributed file system (“the technology”). The technology can gather metadata information associated with the data stored within a first file system, store the metadata information in association with a data identifier within a second file system, retrieve the stored metadata information using the data identifier from within the second file system and locate and retrieve the data associated with the metadata information from within first file system.

Abstract translation: 公开了用于管理分布式文件系统（“技术”）中的数据的技术。 该技术可以收集与存储在第一文件系统中的数据相关联的元数据信息，与第二文件系统内的数据标识符相关联地存储元数据信息，使用来自第二文件系统内的数据标识符检索存储的元数据信息，并且定位 并从第一文件系统内检索与元数据信息相关联的数据。

公开(公告)号：US09507800B2

公开(公告)日：2016-11-29

申请号：US14061596

申请日：2013-10-23

Applicant: NetApp, Inc.

Inventor： Srinivasan Narayanamurthy ,  Gaurav Makkar ,  Kartheek Muthyala ,  Arun Suresh

IPC: G06F17/30

CPC classification number: G06F17/30215 ,  G06F17/30132

Abstract: Technology is disclosed for managing data in a distributed processing system (“the technology”). In various embodiments, the technology pushes “cold” data from a primary storage of the distributed processing system to a backup storage thereby maximizing the usage of the space on the primary storage to store “hot” data on which most data processing activities are performed in the distributed processing system. The cold data is retrieved from the backup storage into the primary storage on demand, for example, upon receiving an access request from a client. While the primary storage stores the data in a format specific to the distributed processing system, the backup storage stores the data in a different format, for example, format corresponding to the type of backup storage.

Abstract translation: 公开了用于在分布式处理系统（“该技术”）中管理数据的技术。 在各种实施例中，该技术将“冷”数据从分布式处理系统的主存储器推送到备份存储器，从而最大化主存储器上的空间的使用，以存储在其上执行大多数数据处理活动的“热”数据 分布式处理系统。 例如，在从客户端接收到访问请求时，根据需要将冷数据从备份存储器检索到主存储器中。 当主存储器以特定于分布式处理系统的格式存储数据时，备份存储器以不同的格式存储数据，例如与备份存储器类型对应的格式。

公开(公告)号：US20160246803A1

公开(公告)日：2016-08-25

申请号：US15097034

申请日：2016-04-12

Applicant: NETAPP, INC.

Inventor： Gaurav Makkar ,  Srinivasan Narayanamurthy ,  Kartheek Muthyala

IPC: G06F17/30

CPC classification number: G06F17/30088 ,  G06F17/302 ,  G06F17/30203 ,  G06F17/30212 ,  G06F17/30312 ,  G06F17/30327

Abstract: Technology is disclosed for managing data in a distributed file system (“the technology”). The technology can gather metadata information associated with the data stored within the distributed file system, create a secondary namespace within a local file system of a local host using the gathered metadata information and store the gathered metadata information as files within the secondary namespace. Further, when a request to create a PPI of the distributed file system is received, the technology can create a PPI of the secondary namespace using a PPI creation feature of the local file system.

公开(公告)号：US20160210308A1

公开(公告)日：2016-07-21

申请号：US15081520

申请日：2016-03-25

Applicant: NetApp, Inc.

Inventor： Sisir Shekhar ,  Michael R. Eisler ,  Kartheek Muthyala ,  Ranjit Kumar

IPC: G06F17/30

CPC classification number: G06F16/178 ,  G06F3/0619 ,  G06F3/064 ,  G06F3/065 ,  G06F3/067 ,  G06F11/1464 ,  G06F16/116 ,  G06F16/174 ,  G06F16/1844 ,  G06F2201/84

Abstract: A method and system for replicating file system entities in a manner that preserves block-level access and file system efficiency mechanisms such as deduplication are disclosed. In an embodiment, a replication engine receives a stream of file system entities that include a file system inodes and file system data blocks. The replication engine generates object-based storage (OBS) objects based on data and reference information specified by the file system entities. As part of generating the OBS objects, the replication engine generates at least one inode file object that associates file block numbers of a file system inode file and the inode numbers. The replication engine uses inode information to generate reference objects that logically associate file block numbers with data block numbers in per inode manner. The replication engine further generates data objects that contains the file system data blocks and that associates the data blocks with corresponding data block numbers.

Abstract translation: 公开了以保持块级访问和文件系统效率机制（例如重复数据消除）的方式复制文件系统实体的方法和系统。 在一个实施例中，复制引擎接收包括文件系统inode和文件系统数据块的文件系统实体流。 复制引擎基于文件系统实体指定的数据和参考信息生成基于对象的存储（OBS）对象。 作为生成OBS对象的一部分，复制引擎生成至少一个inode文件对象，它将文件系统inode文件的文件块号与inode号相关联。 复制引擎使用inode信息来生成参考对象，这些引用对象以文件块号与数据块号在每个inode方式逻辑地相关联。 复制引擎还生成包含文件系统数据块的数据对象，并将数据块与对应的数据块号相关联。

公开(公告)号：US20150269032A1

公开(公告)日：2015-09-24

申请号：US14217941

申请日：2014-03-18

Applicant: NetApp, Inc.

Inventor： Kartheek Muthyala ,  Ranjit Kumar ,  Sisir Shekhar

IPC: G06F11/14 ,  G06F17/30

CPC classification number: G06F11/1464 ,  G06F3/0607 ,  G06F3/065 ,  G06F3/067 ,  G06F16/116 ,  G06F16/178 ,  G06F2201/84

Abstract: Technology is disclosed for backing up data to and recovering data from a destination storage system that stores data in a format different form that of a primary storage system (“the technology”). A replication stream having the data of multiple files, metadata of the files, and reference maps including a mapping of the corresponding file to a portion of the data of the corresponding file is generated at the primary storage system. The replication stream is sent to a parser to map or convert the data, the files, and the reference maps to multiple storage objects in a format the destination storage system is configured to store. Various types of storage objects are generated, including a first type of the storage objects having the data, a second type of storage objects storing the reference maps, and a third type of the storage objects storing metadata of the files.

Abstract translation: 公开了用于将数据备份到以及以与主存储系统（“技术”）不同的格式存储数据的目的地存储系统的数据备份的技术。 在主存储系统中生成具有多个文件的数据，文件的元数据以及包括对应的文件与对应的文件的一部分的映射的参考图的复制流。 将复制流发送到解析器，以目标存储系统配置为存储的格式将数据，文件和参考映射映射或转换为多个存储对象。 生成各种类型的存储对象，包括具有数据的第一类型的存储对象，存储参考图的第二类型的存储对象以及存储文件元数据的第三类存储对象。