公开(公告)号：US08423517B2

公开(公告)日：2013-04-16

申请号：US13022551

申请日：2011-02-07

申请人： Alexander Kesselman ,  Alexandre Drobychev ,  Daniel J. Ford

发明人： Alexander Kesselman ,  Alexandre Drobychev ,  Daniel J. Ford

IPC分类号： G06F17/30

CPC分类号： G06F17/30336 ,  G06F17/30551

摘要： A system and method for determining an age of an object is provided. A first index for a timestamp entry in a sequence of timestamps corresponding to a time at which an object was created is identified. At least one subsequence of timestamps from the sequence of timestamps having indexes for entries in the sequence of timestamps that are between the first index in the sequence of timestamps and a last index for a last timestamp entry in the sequence of timestamps is identified, wherein the at least one subsequence of timestamps conforms to a function of a time interval between storage of consecutive current timestamps reported by clock of the computer system. Timestamps from the sequence of timestamps that are not included in the at least one subsequence of timestamps are removed. An age of the object is determined based on the at least one subsequence of timestamps.

摘要翻译： 提供了一种用于确定对象的年龄的系统和方法。 识别对应于创建对象的时间的时间戳序列中的时间戳条目的第一索引。 识别来自具有时间戳序列中的时间序列序列中的条目的时间戳序列的时间戳的至少一个子序列，其中时间戳序列中的第一索引和时间戳序列中的最后时间戳条目的最后索引之间，其中， 时间戳的至少一个子序列符合由计算机系统的时钟报告的连续当前时间戳的存储之间的时间间隔的函数。 来自不包括在时间戳的至少一个子序列中的时间戳序列的时间戳被去除。 基于时间戳的至少一个子序列来确定对象的年龄。

公开(公告)号：US20120259948A1

公开(公告)日：2012-10-11

申请号：US13444247

申请日：2012-04-11

申请人： Alexandre DROBYCHEV ,  Alexander KESSELMAN

发明人： Alexandre DROBYCHEV ,  Alexander KESSELMAN

IPC分类号： G06F15/16

CPC分类号： G06F17/30578 ,  G06F17/30091 ,  G06F17/30212

摘要： A method performed by two or more devices of a group of devices in a distributed data replication system may include receiving a group of chunks having a same unique temporary identifier, the group of chunks comprising an object to be uploaded; creating an entry for the object in a replicated index, the entry being keyed by the unique temporary identifier, and the replicated index being replicated at each of the two or more devices; and determining, by an initiating device of the two or more devices, that a union of the group of chunks contains all data of the object. The method may also include calculating a content-based identifier to the object; creating another entry for the object in the replicated index, the other entry being keyed by the content-based identifier; and updating the replicated index to point from the unique temporary identifier to the content-based identifier.

摘要翻译： 分布式数据复制系统中的一组设备的两个或多个设备执行的方法可以包括接收具有相同唯一临时标识符的一组块，该组块包括要上传的对象; 在复制索引中创建对象的条目，该条目由唯一临时标识符键入，并且复制索引被复制在两个或更多个设备中的每一个上; 以及由所述两个或多个设备的发起设备确定所述一组组合的联合包含所述对象的所有数据。 该方法还可以包括：向对象计算基于内容的标识符; 为复制索引中的对象创建另一个条目，另一个条目由基于内容的标识符键入; 并将所复制的索引更新为从唯一临时标识符指向基于内容的标识符。

公开(公告)号：US08271455B2

公开(公告)日：2012-09-18

申请号：US13024186

申请日：2011-02-09

申请人： Alexander Kesselman

发明人： Alexander Kesselman

IPC分类号： G06F7/00

CPC分类号： G06F17/30575

摘要： A system and method for storing replication requests for objects in a distributed storage system is provided. A plurality of replication requests for objects stored on storage devices in a distributed storage system is received. Respective row keys are generated for respective replication requests in the plurality of replication requests based on parameters of the respective replication requests. The respective row keys include respective globally-determined priorities for the respective replication requests that facilitate sorting of the respective replication requests by priority. The respective replication requests are stored in respective records of a distributed database using the respective row keys, wherein the respective records of the distributed database are distributed across a plurality of nodes of the distributed database.

摘要翻译： 提供了一种用于在分布式存储系统中存储对象的复制请求的系统和方法。 接收对存储在分布式存储系统中的存储设备上的对象的多个复制请求。 基于各个复制请求的参数，为多个复制请求中的相应复制请求生成相应的行密钥。 相应的行密钥包括用于各个复制请求的各自全局确定的优先级，这些优先级便于按优先级分类相应的复制请求。 各个复制请求使用相应的行密钥存储在分布式数据库的相应记录中，其中分布式数据库的相应记录分布在分布式数据库的多个节点上。

公开(公告)号：US20110196834A1

公开(公告)日：2011-08-11

申请号：US13024186

申请日：2011-02-09

申请人： Alexander Kesselman

发明人： Alexander Kesselman

IPC分类号： G06F17/30

CPC分类号： G06F17/30575

摘要： A system and method for storing replication requests for objects in a distributed storage system is provided. A plurality of replication requests for objects stored on storage devices in a distributed storage system is received. Respective row keys are generated for respective replication requests in the plurality of replication requests based on parameters of the respective replication requests. The respective row keys include respective globally-determined priorities for the respective replication requests that facilitate sorting of the respective replication requests by priority. The respective replication requests are stored in respective records of a distributed database using the respective row keys, wherein the respective records of the distributed database are distributed across a plurality of nodes of the distributed database.

摘要翻译： 提供了一种用于在分布式存储系统中存储对象的复制请求的系统和方法。 接收对存储在分布式存储系统中的存储设备上的对象的多个复制请求。 基于各个复制请求的参数，为多个复制请求中的相应复制请求生成相应的行密钥。 相应的行密钥包括用于各个复制请求的各自全局确定的优先级，这些优先级便于按优先级分类相应的复制请求。 各个复制请求使用相应的行密钥存储在分布式数据库的相应记录中，其中分布式数据库的相应记录分布在分布式数据库的多个节点上。

公开(公告)号：US08838595B2

公开(公告)日：2014-09-16

申请号：US13024091

申请日：2011-02-09

申请人： Alexander Kesselman

发明人： Alexander Kesselman

IPC分类号： G06F7/00 ,  G06F17/30

CPC分类号： G06F17/30575

摘要： A system and method for operating on objects stored in a distributed database is provided. Rows of a distributed database that correspond to an index are identified. The identified rows are sorted lexicographically based on row names of the identified rows. The sorted rows are ordered by priorities of objects corresponding to the sorted rows. The objects corresponding to the sorted rows are operated on in priority order. In some embodiments, the objects are replication requests for replicating data in a distributed storage system, and operating on the objects corresponding to the sorted rows in priority order includes executing the replication requests in priority order to replicate data in the distributed storage system.

摘要翻译： 提供了一种用于对存储在分布式数据库中的对象进行操作的系统和方法。 识别与索引对应的分布式数据库的行。 根据识别的行的行名，按照字面顺序对识别的行进行排序。 排序的行按照排序行对应的对象的优先级进行排序。 对应于排序行的对象按优先级顺序进行操作。 在一些实施例中，对象是用于在分布式存储系统中复制数据的复制请求，并且以优先级顺序对与排序行相对应的对象进行操作，包括以优先顺序执行复制请求以复制分布式存储系统中的数据。

公开(公告)号：US08712974B2

公开(公告)日：2014-04-29

申请号：US12644693

申请日：2009-12-22

申请人： Gia Datuashvili ,  Alexander Kesselman ,  Alexandre Drobychev

发明人： Gia Datuashvili ,  Alexander Kesselman ,  Alexandre Drobychev

IPC分类号： G06F7/00 ,  G06F17/00

CPC分类号： H04L67/1095 ,  G06F17/30156 ,  G06F17/30174 ,  G06F17/30212 ,  G06F17/30371 ,  G06F17/30489 ,  G06F17/30575

摘要： A method is performed by a device of a group of devices in a distributed data replication system. The method includes storing an index of objects in the distributed data replication system, the index being replicated while the objects are stored locally by the plurality of devices in the distributed data replication system. The method also includes conducting a scan of at least a portion of the index and identifying a redundant replica(s) of the at least one of the objects based on the scan of the index. The method further includes de-duplicating the redundant replica(s), and updating the index to reflect the status of the redundant replica.

摘要翻译： 一种方法由分布式数据复制系统中的一组设备的设备执行。 所述方法包括在所述分布式数据复制系统中存储对象的索引，所述索引在所述对象由所述分布式数据复制系统中的所述多个设备在本地存储的同时进行复制。 该方法还包括对索引的至少一部分进行扫描，并且基于索引的扫描来识别所述至少一个对象的冗余副本。 该方法还包括解除复制冗余副本，并更新索引以反映冗余副本的状态。

公开(公告)号：US08615485B2

公开(公告)日：2013-12-24

申请号：US13024250

申请日：2011-02-09

申请人： Zunger Yonatan ,  Alexandre Drobychev ,  Alexander Kesselman ,  George Datuashvili ,  Zia M. Syed

发明人： Zunger Yonatan ,  Alexandre Drobychev ,  Alexander Kesselman ,  George Datuashvili ,  Zia M. Syed

IPC分类号： G06F7/00

CPC分类号： G06F17/30194

摘要： A method for managing multiple generations of an object within a distributed storage system is implemented at a computing device. The computing device receives metadata and content of a first generation of an object from a first client connected to the distributed storage system and stores the first generation's metadata and content within a first storage sub-system. The computing device receives metadata and content of a second generation of the object from a second client connected to the distributed storage system and stores the second generation's metadata and content within a second storage sub-system. The computing device independently replicates the first generation's metadata and content from the first storage sub-system to the second storage sub-system and replicates the second generation's metadata and content from the second storage sub-system to the first storage sub-system such that both storage sub-systems include a replica of the object's first and second generations.

摘要翻译： 一种在分布式存储系统内管理多代对象的方法在计算设备上实现。 计算设备从连接到分布式存储系统的第一客户端接收第一代对象的元数据和内容，并将第一代的元数据和内容存储在第一存储子系统中。 计算设备从连接到分布式存储系统的第二客户端接收第二代对象的元数据和内容，并将第二代的元数据和内容存储在第二存储子系统内。 计算设备将第一代元数据和内容从第一存储子系统独立地复制到第二存储子系统，并将第二代元数据和内容从第二存储子系统复制到第一存储子系统， 存储子系统包括对象的第一代和第二代的副本。

公开(公告)号：US20110196835A1

公开(公告)日：2011-08-11

申请号：US13024243

申请日：2011-02-09

申请人： Alexander Kesselman

发明人： Alexander Kesselman

IPC分类号： G06F17/30

CPC分类号： G06F17/30575

摘要： A system and method for executing replication requests for objects in a distributed storage system is provided. A replication queue is identified from a plurality of replication queues corresponding to a replication key. The replication key includes information related to at least a source storage device in a distributed storage system at which objects are located and a destination storage device in the distributed storage system to which the objects are to be replicated. A distributed database is scanned using an identifier of the replication queue to produce a list of replication requests corresponding to the replication queue. The records of the distributed database are distributed across a plurality of nodes of the distributed database. The replication requests in the list of replication requests are executed in priority order. Replication requests are deleted from the distributed database only when the replication requests are complete.

摘要翻译： 提供了一种用于对分布式存储系统中的对象执行复制请求的系统和方法。 从对应于复制密钥的多个复制队列中识别复制队列。 复制密钥包括与对象所在的分布式存储系统中的至少一个源存储设备相关的信息，以及将被复制对象的分布式存储系统中的目的地存储设备。 使用复制队列的标识符扫描分布式数据库，以产生与复制队列对应的复制请求的列表。 分布式数据库的记录分布在分布式数据库的多个节点上。 复制请求列表中的复制请求按优先级顺序执行。 仅当复制请求完成时，才能从分布式数据库中删除复制请求。

公开(公告)号：US07139280B2

公开(公告)日：2006-11-21

申请号：US09918347

申请日：2001-07-30

申请人： Yishay Mansour ,  Alexander Kesselman

发明人： Yishay Mansour ,  Alexander Kesselman

IPC分类号： H04L12/28

CPC分类号： H04L49/254 ,  H04L49/103 ,  H04L49/3027 ,  H04L49/503 ,  H04L49/90

摘要： A method for allocating space among a plurality of queues in a buffer includes sorting all the queues of the buffer according to size, thereby to establish a sorted order of the queues. At least one group of the queues is selected, consisting of a given number of the queues in accordance with the sorted order. A portion of the space in the buffer is allocated to the group, responsive to the number of the queues in the group. A data packet is accepted into one of the queues in the group responsive to whether the data packet will cause the space occupied in the buffer by the queues in the group to exceed the allocated portion of the space.

公开(公告)号：US08468291B2

公开(公告)日：2013-06-18

申请号：US13444247

申请日：2012-04-11

申请人： Alexandre Drobychev ,  Alexander Kesselman

发明人： Alexandre Drobychev ,  Alexander Kesselman

IPC分类号： G06F13/00

CPC分类号： G06F17/30578 ,  G06F17/30091 ,  G06F17/30212

摘要： A method performed by two or more devices of a group of devices in a distributed data replication system may include receiving a group of chunks having a same unique temporary identifier, the group of chunks comprising an object to be uploaded; creating an entry for the object in a replicated index, the entry being keyed by the unique temporary identifier, and the replicated index being replicated at each of the two or more devices; and determining, by an initiating device of the two or more devices, that a union of the group of chunks contains all data of the object. The method may also include calculating a content-based identifier to the object; creating another entry for the object in the replicated index, the other entry being keyed by the content-based identifier; and updating the replicated index to point from the unique temporary identifier to the content-based identifier.

摘要翻译： 分布式数据复制系统中的一组设备的两个或多个设备执行的方法可以包括接收具有相同唯一临时标识符的一组块，该组块包括要上传的对象; 在复制索引中创建对象的条目，该条目由唯一临时标识符键入，并且复制索引被复制在两个或更多个设备中的每一个上; 以及由所述两个或多个设备的发起设备确定所述一组组合的联合包含所述对象的所有数据。 该方法还可以包括：向对象计算基于内容的标识符; 为复制索引中的对象创建另一个条目，另一个条目由基于内容的标识符键入; 并将所复制的索引更新为从唯一临时标识符指向基于内容的标识符。