公开(公告)号：US20170277602A1

公开(公告)日：2017-09-28

申请号：US15081582

申请日：2016-03-25

Applicant: NetApp, Inc.

Inventor： Ranjit Kumar ,  Kartheek Muthyala ,  Sisir Shekhar

IPC: G06F11/14

Abstract: A method and system for managing backup storage of file system entities. In an aspect, a file system catalog includes a database populator tool that generates records within a metadata table that may be maintained within a database. In response to detecting a replication cycle, the populator tool reads a stream of replication operations. For each of the replication operations, the populator tool determines the type of operation and in response to determining that a directory inode is an operand of the replication operation, the tool generates one or more catalog records. Each of the generated records includes and logically associates data entries corresponding to an inode number, a parent inode number, an entity type, a point-in-time-image (PTI) ID, an absolute path, and an operation.

公开(公告)号：US09208181B2

公开(公告)日：2015-12-08

申请号：US14523801

申请日：2014-10-24

Applicant: NetApp Inc.

Inventor： Vineet Pandey ,  Chhavi Sharma ,  Ranjit Kumar ,  Parag Deshmukh ,  Kaladhar Voruganti

IPC: G06F17/30 ,  G06F9/455 ,  G06F15/173 ,  H04L29/08

CPC classification number: G06F17/303 ,  G06F9/45533 ,  G06F15/17331 ,  G06F17/30079 ,  G06F17/30088 ,  G06F17/30179 ,  G06F17/30607 ,  H04L67/06 ,  H04L67/1023 ,  H04L67/1097

Abstract: One or more techniques and/or systems are provided for migrating a dataset from a file storage system to an object storage system. That is, a snapshot of a file system may be received from the file storage system. The snapshot may comprise file data associated with a file of the file system. The file may be converted into an object using the file data. The object may be stored within a data constituent volume of the object storage system. A namespace volume, used to track objects, may be populated with a redirector that maps a front-end data path (e.g., a path used by clients to reference the object) to a back-end data path that specifies a path to the object within the data constituent volume. In this way, a dataset of one or more files may be migrated from the file storage system to the object storage system.

Abstract translation: 提供一个或多个技术和/或系统用于将数据集从文件存储系统迁移到对象存储系统。 也就是说，可以从文件存储系统接收文件系统的快照。 快照可以包括与文件系统的文件相关联的文件数据。 可以使用文件数据将文件转换成对象。 对象可以存储在对象存储系统的数据构成卷内。 用于跟踪对象的命名空间卷可以用映射前端数据路径（例如，客户端引用对象的路径）的重定向器填充到指定对象的路径的后端数据路径 在数据构成卷内。 以这种方式，一个或多个文件的数据集可以从文件存储系统迁移到对象存储系统。

公开(公告)号：US11416444B2

公开(公告)日：2022-08-16

申请号：US15081520

申请日：2016-03-25

Applicant: NetApp, Inc.

Inventor： Sisir Shekhar ,  Michael R. Eisler ,  Kartheek Muthyala ,  Ranjit Kumar

IPC: G06F16/11 ,  G06F16/178 ,  G06F16/182 ,  G06F16/174

Abstract: A method and system for replicating file system entities in a manner that preserves block-level access and file system efficiency mechanisms such as deduplication are disclosed. In an embodiment, a replication engine receives a stream of file system entities that include a file system inodes and file system data blocks. The replication engine generates object-based storage (OBS) objects based on data and reference information specified by the file system entities. As part of generating the OBS objects, the replication engine generates at least one inode file object that associates file block numbers of a file system inode file and the inode numbers. The replication engine uses inode information to generate reference objects that logically associate file block numbers with data block numbers in per inode manner. The replication engine further generates data objects that contains the file system data blocks and that associates the data blocks with corresponding data block numbers.

公开(公告)号：US10423499B2

公开(公告)日：2019-09-24

申请号：US15081582

申请日：2016-03-25

Applicant: NetApp, Inc.

Inventor： Ranjit Kumar ,  Kartheek Muthyala ,  Sisir Shekhar

IPC: G06F11/14 ,  G06F16/16

Abstract: A method and system for managing backup storage of file system entities. In an aspect, a file system catalog includes a database populator tool that generates records within a metadata table that may be maintained within a database. In response to detecting a replication cycle, the populator tool reads a stream of replication operations. For each of the replication operations, the populator tool determines the type of operation and in response to determining that a directory inode is an operand of the replication operation, the tool generates one or more catalog records. Each of the generated records includes and logically associates data entries corresponding to an inode number, a parent inode number, an entity type, a point-in-time-image (PTI) ID, an absolute path, and an operation.

公开(公告)号：US20190026192A1

公开(公告)日：2019-01-24

申请号：US16138551

申请日：2018-09-21

Applicant: NetApp, Inc.

Inventor： Kartheek Muthyala ,  Ranjit Kumar ,  Sisir Shekhar

IPC: G06F11/14 ,  G06F3/06 ,  G06F17/30

Abstract: Technology is disclosed for backing up data to and recovering data from a destination storage system that stores data in a format different form that of a primary storage system (“the technology”). A replication stream having the data of multiple files, metadata of the files, and reference maps including a mapping of the corresponding file to a portion of the data of the corresponding file is generated at the primary storage system. The replication stream is sent to a parser to map or convert the data, the files, and the reference maps to multiple storage objects in a format the destination storage system is configured to store. Various types of storage objects are generated, including a first type of the storage objects having the data, a second type of storage objects storing the reference maps, and a third type of the storage objects storing metadata of the files.

公开(公告)号：US20160210308A1

公开(公告)日：2016-07-21

申请号：US15081520

申请日：2016-03-25

Applicant: NetApp, Inc.

Inventor： Sisir Shekhar ,  Michael R. Eisler ,  Kartheek Muthyala ,  Ranjit Kumar

IPC: G06F17/30

CPC classification number: G06F16/178 ,  G06F3/0619 ,  G06F3/064 ,  G06F3/065 ,  G06F3/067 ,  G06F11/1464 ,  G06F16/116 ,  G06F16/174 ,  G06F16/1844 ,  G06F2201/84

Abstract: A method and system for replicating file system entities in a manner that preserves block-level access and file system efficiency mechanisms such as deduplication are disclosed. In an embodiment, a replication engine receives a stream of file system entities that include a file system inodes and file system data blocks. The replication engine generates object-based storage (OBS) objects based on data and reference information specified by the file system entities. As part of generating the OBS objects, the replication engine generates at least one inode file object that associates file block numbers of a file system inode file and the inode numbers. The replication engine uses inode information to generate reference objects that logically associate file block numbers with data block numbers in per inode manner. The replication engine further generates data objects that contains the file system data blocks and that associates the data blocks with corresponding data block numbers.

Abstract translation: 公开了以保持块级访问和文件系统效率机制（例如重复数据消除）的方式复制文件系统实体的方法和系统。 在一个实施例中，复制引擎接收包括文件系统inode和文件系统数据块的文件系统实体流。 复制引擎基于文件系统实体指定的数据和参考信息生成基于对象的存储（OBS）对象。 作为生成OBS对象的一部分，复制引擎生成至少一个inode文件对象，它将文件系统inode文件的文件块号与inode号相关联。 复制引擎使用inode信息来生成参考对象，这些引用对象以文件块号与数据块号在每个inode方式逻辑地相关联。 复制引擎还生成包含文件系统数据块的数据对象，并将数据块与对应的数据块号相关联。

公开(公告)号：US20150269032A1

公开(公告)日：2015-09-24

申请号：US14217941

申请日：2014-03-18

Applicant: NetApp, Inc.

Inventor： Kartheek Muthyala ,  Ranjit Kumar ,  Sisir Shekhar

IPC: G06F11/14 ,  G06F17/30

CPC classification number: G06F11/1464 ,  G06F3/0607 ,  G06F3/065 ,  G06F3/067 ,  G06F16/116 ,  G06F16/178 ,  G06F2201/84

Abstract: Technology is disclosed for backing up data to and recovering data from a destination storage system that stores data in a format different form that of a primary storage system (“the technology”). A replication stream having the data of multiple files, metadata of the files, and reference maps including a mapping of the corresponding file to a portion of the data of the corresponding file is generated at the primary storage system. The replication stream is sent to a parser to map or convert the data, the files, and the reference maps to multiple storage objects in a format the destination storage system is configured to store. Various types of storage objects are generated, including a first type of the storage objects having the data, a second type of storage objects storing the reference maps, and a third type of the storage objects storing metadata of the files.

Abstract translation: 公开了用于将数据备份到以及以与主存储系统（“技术”）不同的格式存储数据的目的地存储系统的数据备份的技术。 在主存储系统中生成具有多个文件的数据，文件的元数据以及包括对应的文件与对应的文件的一部分的映射的参考图的复制流。 将复制流发送到解析器，以目标存储系统配置为存储的格式将数据，文件和参考映射映射或转换为多个存储对象。 生成各种类型的存储对象，包括具有数据的第一类型的存储对象，存储参考图的第二类型的存储对象以及存储文件元数据的第三类存储对象。

公开(公告)号：US20150046502A1

公开(公告)日：2015-02-12

申请号：US14523801

申请日：2014-10-24

Applicant: NetApp Inc.

Inventor： Vineet Pandey ,  Chhavi Sharma ,  Ranjit Kumar ,  Parag Deshmukh ,  Kaladhar Voruganti

IPC: G06F17/30

CPC classification number: G06F17/303 ,  G06F9/45533 ,  G06F15/17331 ,  G06F17/30079 ,  G06F17/30088 ,  G06F17/30179 ,  G06F17/30607 ,  H04L67/06 ,  H04L67/1023 ,  H04L67/1097

Abstract: One or more techniques and/or systems are provided for migrating a dataset from a file storage system to an object storage system. That is, a snapshot of a file system may be received from the file storage system. The snapshot may comprise file data associated with a file of the file system. The file may be converted into an object using the file data. The object may be stored within a data constituent volume of the object storage system. A namespace volume, used to track objects, may be populated with a redirector that maps a front-end data path (e.g., a path used by clients to reference the object) to a back-end data path that specifies a path to the object within the data constituent volume. In this way, a dataset of one or more files may be migrated from the file storage system to the object storage system.

Abstract translation: 提供一个或多个技术和/或系统用于将数据集从文件存储系统迁移到对象存储系统。 也就是说，可以从文件存储系统接收文件系统的快照。 快照可以包括与文件系统的文件相关联的文件数据。 可以使用文件数据将文件转换成对象。 对象可以存储在对象存储系统的数据构成卷内。 用于跟踪对象的命名空间卷可以用映射前端数据路径（例如，客户端引用对象的路径）的重定向器填充到指定对象的路径的后端数据路径 在数据构成卷内。 以这种方式，一个或多个文件的数据集可以从文件存储系统迁移到对象存储系统。

公开(公告)号：US08924425B1

公开(公告)日：2014-12-30

申请号：US13707039

申请日：2012-12-06

Applicant: NetApp Inc.

Inventor： Vineet Pandey ,  Chhavi Sharma ,  Ranjit Kumar ,  Parag Deshmukh ,  Kaladhar Voruganti

IPC: G06F17/30 ,  G06F9/455 ,  G06F15/173 ,  H04L29/08

CPC classification number: G06F17/303 ,  G06F9/45533 ,  G06F15/17331 ,  G06F17/30079 ,  G06F17/30088 ,  G06F17/30179 ,  G06F17/30607 ,  H04L67/06 ,  H04L67/1023 ,  H04L67/1097

Abstract: One or more techniques and/or systems are provided for migrating a dataset from a file storage system to an object storage system. That is, a snapshot of a file system may be received from the file storage system. The snapshot may comprise file data associated with a file of the file system. The file may be converted into an object using the file data. The object may be stored within a data constituent volume of the object storage system. A namespace volume, used to track objects, may be populated with a redirector that maps a front-end data path (e.g., a path used by clients to reference the object) to a back-end data path that specifies a path to the object within the data constituent volume. In this way, a dataset of one or more files may be migrated from the file storage system to the object storage system.

Abstract translation: 提供一个或多个技术和/或系统用于将数据集从文件存储系统迁移到对象存储系统。 也就是说，可以从文件存储系统接收文件系统的快照。 快照可以包括与文件系统的文件相关联的文件数据。 可以使用文件数据将文件转换成对象。 对象可以存储在对象存储系统的数据构成卷内。 用于跟踪对象的命名空间卷可以用映射前端数据路径（例如，客户端引用对象的路径）的重定向器填充到指定对象的路径的后端数据路径 在数据构成卷内。 以这种方式，一个或多个文件的数据集可以从文件存储系统迁移到对象存储系统。