公开(公告)号：US09489312B2

公开(公告)日：2016-11-08

申请号：US14134108

申请日：2013-12-19

Applicant: NetApp Inc.

Inventor： Anshul Madan ,  James F. Lentini ,  Michael N. Condict ,  Stephen M. Byan

IPC: G06F17/30 ,  G06F12/08 ,  G06F17/00 ,  G06F13/00 ,  G06F15/16 ,  G06F11/30 ,  G06F3/06

CPC classification number: G06F3/0641 ,  G06F3/0608 ,  G06F3/0611 ,  G06F3/0659 ,  G06F3/067 ,  G06F3/0679 ,  G06F11/3037 ,  G06F12/0891 ,  G06F13/00 ,  G06F15/16 ,  G06F17/00 ,  G06F17/30 ,  G06F17/30097 ,  G06F17/30156 ,  G06F17/30162 ,  G06F17/30188 ,  G06F17/30194 ,  H04L67/2828 ,  H04L67/2852

Abstract: One or more techniques and/or systems are provided for performing host side deduplication. Host side deduplication may be performed upon writeable data within a write request received at a host computing device configured to access data stored by a storage server. The host side deduplication may be performed at the host computing device to determine whether the writeable data is already stored by the storage server based upon querying a host side cache comprising data stored by a storage server and/or a data structure comprising unique signatures of data stored by the storage server. If the writeable data is stored by the storage server, then a deduplication notification excluding the writeable data may be sent to the storage server, otherwise a write command comprising the writeable data may be sent. Accordingly, unnecessary network traffic of redundant data already stored by the storage server may be reduced.

公开(公告)号：US20150134625A1

公开(公告)日：2015-05-14

申请号：US14079549

申请日：2013-11-13

Applicant: NetApp, Inc.

Inventor： James F. Lentini ,  Anshul Madan ,  Deepak R. Kenchammana-Hosekote

IPC: G06F17/30 ,  H04L29/08

CPC classification number: G06F16/215 ,  H04L67/2857

Abstract: Technology is disclosed for improving the storage efficiency and communication efficiency for a storage client device by maximizing the cache hit rate and minimizing data requests to the storage server. The storage server provides a duplication list to the storage client device. The duplication list contains references (e.g. storage addresses) to data blocks that contain duplicate data content. The storage client uses the duplication list to improve the cache hit rate. The duplication list is pruned to contain references to data blocks relevant to the storage client device. The storage server can prune the duplication list based on a working set of storage objects for a client. Alternatively, the storage server can prune the duplication list based on content characteristics, e.g. duplication degree and access frequency. Duplicate blocks to which the client does not have access can be excluded from the duplication list.

Abstract translation: 公开了用于通过最大化高速缓存命中率和最小化对存储服务器的数据请求来提高存储客户端设备的存储效率和通信效率的技术。 存储服务器向存储客户端设备提供复制列表。 复制列表包含对包含重复数据内容的数据块的引用（例如存储地址）。 存储客户端使用复制列表来提高缓存命中率。 复制列表被修剪以包含对与存储客户端设备相关的数据块的引用。 存储服务器可以根据客户机的一组存储对象来修剪复制列表。 或者，存储服务器可以基于内容特征修剪复制列表，例如， 重复度和访问频率。 客户端无法访问的重复块可以从复制列表中排除。

公开(公告)号：US20170091183A1

公开(公告)日：2017-03-30

申请号：US14865869

申请日：2015-09-25

Applicant: NetApp, Inc.

Inventor： Deepak Raghu Kenchammana-Hosekote ,  Anshul Madan

IPC: G06F17/30

CPC classification number: G06F17/3015 ,  G06F17/30194 ,  G06F17/30867

Abstract: A technique described herein performs peer to peer network write deduplication. A host system generates a fingerprint for data associated with a write request. The host system may then determine whether the generated fingerprint matches a local fingerprint stored in a local data structure or whether the generated fingerprint matches a global fingerprint associated with a global data structure, wherein the local fingerprint is associated with data previously written to the storage system by the host and wherein the global fingerprint is associated with data previously written to the storage system by a different host. If a match is found, the host system constructs a deduplication command utilizing a logical address corresponding to a storage location that stores the data. If a match is not found, a write command for the data of the write request is constructed and sent to the storage system.

公开(公告)号：US20140136789A1

公开(公告)日：2014-05-15

申请号：US14134108

申请日：2013-12-19

Applicant: NetApp Inc.

Inventor： Anshul Madan ,  James F. Lentini ,  Michael N. Condict ,  Stephen M. Byan

IPC: G06F12/08

CPC classification number: G06F3/0641 ,  G06F3/0608 ,  G06F3/0611 ,  G06F3/0659 ,  G06F3/067 ,  G06F3/0679 ,  G06F11/3037 ,  G06F12/0891 ,  G06F13/00 ,  G06F15/16 ,  G06F17/00 ,  G06F17/30 ,  G06F17/30097 ,  G06F17/30156 ,  G06F17/30162 ,  G06F17/30188 ,  G06F17/30194 ,  H04L67/2828 ,  H04L67/2852

Abstract: One or more techniques and/or systems are provided for performing host side deduplication. Host side deduplication may be performed upon writeable data within a write request received at a host computing device configured to access data stored by a storage server. The host side deduplication may be performed at the host computing device to determine whether the writeable data is already stored by the storage server based upon querying a host side cache comprising data stored by a storage server and/or a data structure comprising unique signatures of data stored by the storage server. If the writeable data is stored by the storage server, then a deduplication notification excluding the writeable data may be sent to the storage server, otherwise a write command comprising the writeable data may be sent. Accordingly, unnecessary network traffic of redundant data already stored by the storage server may be reduced.

Abstract translation: 提供一个或多个技术和/或系统用于执行主机端重复数据删除。 主机重复数据删除可以在被配置为访问由存储服务器存储的数据的主计算设备接收的写请求内的可写数据上执行。 可以在主机计算设备处执行主机重复数据删除，以基于查询包含由存储服务器存储的数据的主机侧缓存器和/或包括唯一的数据签名的数据结构来确定存储服务器是否已经存储了可写数据 由存储服务器存储。 如果存储服务器存储可写数据，则可以向存储服务器发送排除可写数据的重复数据消除通知，否则可以发送包含可写数据的写命令。 因此，可以减少由存储服务器已经存储的冗余数据的不必要的网络流量。

公开(公告)号：US10459649B2

公开(公告)日：2019-10-29

申请号：US15337088

申请日：2016-10-28

Applicant: NetApp, Inc.

Inventor： Anshul Madan ,  James F. Lentini ,  Michael N. Condict ,  Stephen M. Byan

IPC: G06F16/00 ,  G06F3/06 ,  G06F17/00 ,  G06F13/00 ,  G06F15/16 ,  G06F11/30 ,  G06F16/13 ,  G06F16/18 ,  G06F16/182 ,  G06F16/174 ,  G06F12/0891 ,  H04L29/08

Abstract: One or more techniques and/or systems are provided for performing host side deduplication. Host side deduplication may be performed upon writeable data within a write request received at a host computing device configured to access data stored by a storage server. The host side deduplication may be performed at the host computing device to determine whether the writeable data is already stored by the storage server based upon querying a host side cache comprising data stored by a storage server and/or a data structure comprising unique signatures of data stored by the storage server. If the writeable data is stored by the storage server, then a deduplication notification excluding the writeable data may be sent to the storage server, otherwise a write command comprising the writeable data may be sent. Accordingly, unnecessary network traffic of redundant data already stored by the storage server may be reduced.

公开(公告)号：US09842114B2

公开(公告)日：2017-12-12

申请号：US14865869

申请日：2015-09-25

Applicant: NetApp, Inc.

Inventor： Deepak Raghu Kenchammana-Hosekote ,  Anshul Madan

IPC: G06F17/00 ,  G06F17/30

CPC classification number: G06F17/3015 ,  G06F17/30194 ,  G06F17/30867

Abstract: A technique described herein performs peer to peer network write deduplication. A host system generates a fingerprint for data associated with a write request. The host system may then determine whether the generated fingerprint matches a local fingerprint stored in a local data structure or whether the generated fingerprint matches a global fingerprint associated with a global data structure, wherein the local fingerprint is associated with data previously written to the storage system by the host and wherein the global fingerprint is associated with data previously written to the storage system by a different host. If a match is found, the host system constructs a deduplication command utilizing a logical address corresponding to a storage location that stores the data. If a match is not found, a write command for the data of the write request is constructed and sent to the storage system.

公开(公告)号：US20150213047A1

公开(公告)日：2015-07-30

申请号：US14162868

申请日：2014-01-24

Applicant: NetApp Inc.

Inventor： Anshul Madan

IPC: G06F17/30

CPC classification number: G06F16/1748 ,  G06F3/0641

Abstract: One or more techniques and/or systems are provided for coalescing sequences for host side deduplication. A host device may receive a write command from a client device. The write command may comprise a set of data blocks that are to be written to a storage device. The host device may perform host side deduplication by identifying one or more data blocks of the write command that comprise data already stored by the storage device as storage device data blocks. The host device may evaluate the one or more data blocks to identify adjacent data blocks. The host device may coalesce adjacent data blocks into a deduplication sequence. The host device may issue a host side write deduplication command to the storage device (e.g., through a storage controller) based upon the deduplication sequence, which may improve performance by mitigating a number of commands issued to and/or processed by the storage device.

Abstract translation: 提供一个或多个技术和/或系统用于聚合序列用于主机端重复数据删除。 主机设备可以从客户端设备接收写命令。 写入命令可以包括要写入存储设备的一组数据块。 主机设备可以通过将包括存储设备已经存储的数据的写入命令的一个或多个数据块识别为存储设备数据块来执行主机侧重复数据删除。 主机设备可以评估一个或多个数据块以识别相邻的数据块。 主机设备可以将相邻数据块合并成重复数据删除序列。 主机设备可以基于重复数据删除序列向存储设备（例如，通过存储控制器）发出主机侧写入重复删除命令，这可以通过减轻发布给存储设备和/或由存储设备处理的命令的数量来提高性能。