公开(公告)号：US20140304241A1

公开(公告)日：2014-10-09

申请号：US14310286

申请日：2014-06-20

Applicant: NetApp, Inc.

Inventor： Steven C. Miller ,  Roger Stager

IPC: G06F17/30

CPC classification number: G06F17/30156 ,  H03M7/3084

Abstract: A sampling based technique for eliminating duplicate data (de-duplication) stored on storage resources, is provided. According to the invention, when a new data set, e.g., a backup data stream, is received by a server, e.g., a storage system or virtual tape library (VTL) system implementing the invention, one or more anchors are identified within the new data set. The anchors are identified using a novel anchor detection circuitry in accordance with an illustrative embodiment of the present invention. Upon receipt of the new data set by, for example, a network adapter of a VTL system, the data set is transferred using direct memory access (DMA) operations to a memory associated with an anchor detection hardware card that is operatively interconnected with the storage system. The anchor detection hardware card may be implemented as, for example, a FPGA is to quickly identify anchors within the data set. As the anchor detection process is performed using a hardware assist, the load on a main processor of the system is reduced, thereby enabling line speed de-duplication.

Abstract translation: 提供了用于消除存储在存储资源上的重复数据（重复数据删除）的基于抽样的技术。 根据本发明，当服务器（例如，实施本发明的存储系统或虚拟磁带库（VTL））系统接收到诸如备份数据流的新数据集时，在新的数据集内识别出一个或多个锚点 数据集。 根据本发明的说明性实施例，使用新颖的锚定检测电路来识别锚。 在通过例如VTL系统的网络适配器接收到新数据集时，使用直接存储器访问（DMA）操作将数据集传送到与锚定检测硬件卡相关联的存储器，该存储器与存储器可操作地互连 系统。 锚定检测硬件卡可以被实现为例如FPGA快速识别数据集内的锚点。 由于使用硬件辅助进行锚定检测处理，系统的主处理器上的负载减少，从而实现线速度重复数据删除。

公开(公告)号：US09069787B2

公开(公告)日：2015-06-30

申请号：US14310286

申请日：2014-06-20

Applicant: NetApp, Inc.

Inventor： Steven C. Miller ,  Roger Stager

IPC: G06F17/30 ,  H03M7/30

CPC classification number: G06F17/30156 ,  H03M7/3084

Abstract: A sampling based technique for eliminating duplicate data (de-duplication) stored on storage resources, is provided. According to the invention, when a new data set, e.g., a backup data stream, is received by a server, e.g., a storage system or virtual tape library (VTL) system implementing the invention, one or more anchors are identified within the new data set. The anchors are identified using a novel anchor detection circuitry in accordance with an illustrative embodiment of the present invention. Upon receipt of the new data set by, for example, a network adapter of a VTL system, the data set is transferred using direct memory access (DMA) operations to a memory associated with an anchor detection hardware card that is operatively interconnected with the storage system. The anchor detection hardware card may be implemented as, for example, a FPGA is to quickly identify anchors within the data set. As the anchor detection process is performed using a hardware assist, the load on a main processor of the system is reduced, thereby enabling line speed de-duplication.

Abstract translation: 提供了用于消除存储在存储资源上的重复数据（重复数据删除）的基于抽样的技术。 根据本发明，当服务器（例如，实施本发明的存储系统或虚拟磁带库（VTL））系统接收到诸如备份数据流的新数据集时，在新的数据集内识别出一个或多个锚点 数据集。 使用根据本发明的说明性实施例的新型锚定检测电路来识别锚。 在通过例如VTL系统的网络适配器接收到新数据集时，使用直接存储器访问（DMA）操作将数据集传送到与锚定检测硬件卡相关联的存储器，该存储器与存储器可操作地互连 系统。 锚定检测硬件卡可以被实现为例如FPGA快速识别数据集内的锚点。 由于使用硬件辅助进行锚定检测处理，系统的主处理器上的负载减少，从而实现线速度重复数据删除。