-
公开(公告)号:US07636868B2
公开(公告)日:2009-12-22
申请号:US11476974
申请日:2006-06-27
申请人: William R. Hoffman , Marcus J. Jager , John P. MacCormick , Kristof Roomp , Chandramohan A. Thekkath , Lidong Zhou
发明人: William R. Hoffman , Marcus J. Jager , John P. MacCormick , Kristof Roomp , Chandramohan A. Thekkath , Lidong Zhou
IPC分类号: G06F11/00
CPC分类号: G06F17/30581 , H04L67/1095 , H04L69/40
摘要: A global state management service manages replication in a distributed system. A distributed system can have several replica groups. The global state management service manages state associated with each replica group. Data replication is implemented without implementing an instance of a state machine on each device in a replica group. A replica group comprises a primary device and at least one secondary device. Each device in a replica group contains a replica of data of interest. The global state management service manages the allocation of primary and secondary devices. In the absence of a failure in either a primary device or a secondary device, read and write operations are performed without consulting the global state management service. When a failure is detected, the global state management service manages failover.
摘要翻译: 全局状态管理服务管理分布式系统中的复制。 分布式系统可以有多个复制组。 全局状态管理服务管理与每个副本组相关联的状态。 实现数据复制,而不在副本组中的每个设备上实现状态机的实例。 副本组包括主设备和至少一个辅助设备。 副本组中的每个设备都包含一个感兴趣的数据副本。 全球状态管理服务管理主要和次要设备的分配。 在主设备或辅助设备中没有故障的情况下,执行读写操作,而无需咨询全局状态管理服务。 当检测到故障时,全局状态管理服务管理故障转移。
-
公开(公告)号:US20070299955A1
公开(公告)日:2007-12-27
申请号:US11476974
申请日:2006-06-27
申请人: William R. Hoffman , Marcus J. Jager , John P. MacCormick , Kristof Roomp , Chandramohan A. Thekkath , Lidong Zhou
发明人: William R. Hoffman , Marcus J. Jager , John P. MacCormick , Kristof Roomp , Chandramohan A. Thekkath , Lidong Zhou
IPC分类号: G06F15/173
CPC分类号: G06F17/30581 , H04L67/1095 , H04L69/40
摘要: A global state management service manages replication in a distributed system. A distributed system can have several replica groups. The global state management service manages state associated with each replica group. Data replication is implemented without implementing an instance of a state machine on each device in a replica group. A replica group comprises a primary device and at least one secondary device. Each device in a replica group contains a replica of data of interest. The global state management service manages the allocation of primary and secondary devices. In the absence of a failure in either a primary device or a secondary device, read and write operations are performed without consulting the global state management service. When a failure is detected, the global state management service manages failover.
摘要翻译: 全局状态管理服务管理分布式系统中的复制。 分布式系统可以有多个复制组。 全局状态管理服务管理与每个副本组相关联的状态。 实现数据复制,而不在副本组中的每个设备上实现状态机的实例。 副本组包括主设备和至少一个辅助设备。 副本组中的每个设备都包含一个感兴趣的数据副本。 全球状态管理服务管理主要和次要设备的分配。 在主设备或辅助设备中没有故障的情况下,执行读写操作,而无需咨询全局状态管理服务。 当检测到故障时,全局状态管理服务管理故障转移。
-
公开(公告)号:US20070282806A1
公开(公告)日:2007-12-06
申请号:US11445960
申请日:2006-06-02
申请人: William R. Hoffman , Marcus J. Jager , John P. MacCormick , Kristof Roomp , Chandramohan A. Thekkath
发明人: William R. Hoffman , Marcus J. Jager , John P. MacCormick , Kristof Roomp , Chandramohan A. Thekkath
IPC分类号: G06F17/30
CPC分类号: G06F17/30067 , Y10S707/99933
摘要: A searchable storage system indexes data, such as a blob (binary large object) as it is stored. The indexes are stored simultaneously with the data by the same storage mechanism. Data cannot be stored without indexing it. Any indexing technique may be used. The indexes are then used to access the data. This ensures that any inconsistencies can handled at the local level, and are not visible to clients of the system. Data can be put in to, or taken out from, the searchable storage system. Additionally, a query on the data in the searchable storage system may be performed.
摘要翻译: 可搜索的存储系统索引数据,如存储的blob(二进制大对象)。 索引与同一存储机制的数据同时存储。 数据无法存储,无需索引。 可以使用任何索引技术。 然后使用索引来访问数据。 这样可以确保在本地级别可以处理任何不一致之处,并且系统的客户端不可见。 数据可以放入或从可搜索的存储系统中取出。 此外,可以执行关于可搜索存储系统中的数据的查询。
-
公开(公告)号:US07698258B2
公开(公告)日:2010-04-13
申请号:US11445960
申请日:2006-06-02
申请人: William R Hoffman , Marcus J. Jager , John P. MacCormick , Kristof Roomp , Chandramohan A. Thekkath
发明人: William R Hoffman , Marcus J. Jager , John P. MacCormick , Kristof Roomp , Chandramohan A. Thekkath
IPC分类号: G06F7/00
CPC分类号: G06F17/30067 , Y10S707/99933
摘要: A searchable storage system indexes data, such as a blob (binary large object) as it is stored. The indexes are stored simultaneously with the data by the same storage mechanism. Data cannot be stored without indexing it. Any indexing technique may be used. The indexes are then used to access the data. This ensures that any inconsistencies can handled at the local level, and are not visible to clients of the system. Data can be put in to, or taken out from, the searchable storage system. Additionally, a query on the data in the searchable storage system may be performed.
摘要翻译: 可搜索的存储系统索引数据,如存储的blob(二进制大对象)。 索引与同一存储机制的数据同时存储。 数据无法存储,无需索引。 可以使用任何索引技术。 然后使用索引来访问数据。 这样可以确保在本地级别处理任何不一致的情况,并且系统的客户端不可见。 数据可以放入或从可搜索的存储系统中取出。 此外,可以执行关于可搜索存储系统中的数据的查询。
-
公开(公告)号:US07734573B2
公开(公告)日:2010-06-08
申请号:US11013274
申请日:2004-12-14
IPC分类号: G06F17/30
CPC分类号: G06F11/1469 , G06F11/1451 , G06F11/1471 , Y10S707/99953
摘要: Methods and apparatuses are provided for recovering one or more replicated datasets. In accordance to some embodiments of the invention, this is accomplished by determining whether a log contains one or more entries indicating a corruption in a replicated data item; and recovering the replicated data item if the log contains any such entries. The log, however, is maintained at a higher layer in a software hierarchy than the layer at which the replicated data item is recovered. As a result, there is no need to maintain a separate replication log at the layer where the replicated data item is recovered. In accordance to some embodiments of the invention, this is accomplished by recording an entry indicating that an operation was performed on a replicated record in a log at a higher layer in a software hierarchy, determining whether a failure occurred during the operation, and reconciling the replicated record at a lower layer in the software hierarchy if it is determined that a failure occurred during the operation. As a result, the present invention eliminates the need for additional disk writes required by conventional techniques that use a replication log to at the same layer where the data recovery is performed.
摘要翻译: 提供了用于恢复一个或多个复制数据集的方法和装置。 根据本发明的一些实施例,这是通过确定日志是否包含指示复制数据项中的损坏的一个或多个条目来实现的; 并且如果日志包含任何这样的条目,则恢复复制的数据项。 然而,日志在软件层次结构中保留在复制数据项恢复的层的较高层。 因此,无需在复制的数据项被恢复的层上维护单独的复制日志。 根据本发明的一些实施例,这是通过记录指示对软件层级中较高层的日志中的复制记录执行操作的条目,确定在操作期间是否发生故障,并且 如果确定在操作期间发生故障,则在软件层次结构中较低层的复制记录。 结果,本发明消除了对在执行数据恢复的同一层使用复制日志的常规技术所需的附加磁盘写入的需要。
-
公开(公告)号:US07529891B2
公开(公告)日:2009-05-05
申请号:US11230028
申请日:2005-09-19
CPC分类号: G06F12/0862 , G06F2212/6022
摘要: Balanced prefetching automatically balances the benefits of prefetching data that has not been accessed recently against the benefits of caching recently accessed data, and can be applied to most types of structured data without needing application-specific details or hints. Balanced prefetching is performed in applications in a computer system, such as storage-centric applications, including file systems and databases. Balanced prefetching exploits the structure of the data being prefetched, providing superior application throughput. For a fixed amount of memory, it is automatically and dynamically determined how much memory should be devoted to prefetching.
摘要翻译: 平衡预取自动平衡了最近未被访问的预取数据的优点与缓存最近访问的数据的好处,并且可以应用于大多数类型的结构化数据,而无需特定于应用程序的详细信息或提示。 在计算机系统的应用程序中执行平衡预取,例如以存储为中心的应用程序,包括文件系统和数据库。 平衡预取利用了预取数据的结构,提供卓越的应用程序吞吐量。 对于固定的内存量,它会自动和动态地确定应该将多少内存用于预取。
-
公开(公告)号:US08560691B2
公开(公告)日:2013-10-15
申请号:US11820285
申请日:2007-06-19
IPC分类号: G06F15/173 , G06F15/16
CPC分类号: G06F17/30194
摘要: Techniques are provided for moving an item from one item server to another item server in a distributed storage system, using a location service, APIs, and item states. There are three parties that transact with each other: a source item server, a destination item server, and a location service. Each item stored at the source has a move status, e.g., “stationary”, “source attempting transfer”, “destination accepting transfer”, or “destination attempting transfer”. Similarly, each item stored at the destination also has a move status, e.g., “stationary”, “source attempting transfer”, “destination accepting transfer”, or “destination attempting transfer”. The location service desirably has an entry for every item stored by the storage system. An item's entry may comprise the item's current location (e.g., an identifier of an item server) together with a state, such as “stable” or “attempting transfer”.
摘要翻译: 提供了用于使用位置服务,API和项目状态将项目从一个项目服务器移动到分布式存储系统中的另一个项目服务器的技术。 有三方交互:源项目服务器,目标项目服务器和位置服务。 存储在源中的每个项目具有移动状态,例如“静止”,“源尝试转移”,“目的地接受转移”或“目的地尝试转移”。 类似地,存储在目的地的每个项目也具有移动状态,例如“静止”,“源尝试转移”,“目的地接受转移”或“目的地尝试转移”。 位置服务期望具有用于由存储系统存储的每个项目的条目。 项目的条目可以包括项目的当前位置(例如,项目服务器的标识符)以及诸如“稳定”或“尝试传送”的状态。
-
公开(公告)号:US20080320005A1
公开(公告)日:2008-12-25
申请号:US11820285
申请日:2007-06-19
IPC分类号: G06F17/30
CPC分类号: G06F17/30194
摘要: Techniques are provided for moving an item from one item server to another item server in a distributed storage system, using a location service, APIs, and item states. There are three parties that transact with each other: a source item server, a destination item server, and a location service. Each item stored at the source has a move status, e.g., “stationary”, “source attempting transfer”, “destination accepting transfer”, or “destination attempting transfer”. Similarly, each item stored at the destination also has a move status, e.g., “stationary”, “source attempting transfer”, “destination accepting transfer”, or “destination attempting transfer”. The location service desirably has an entry for every item stored by the storage system. An item's entry may comprise the item's current location (e.g., an identifier of an item server) together with a state, such as “stable” or “attempting transfer”.
摘要翻译: 提供了用于使用位置服务,API和项目状态将项目从一个项目服务器移动到分布式存储系统中的另一个项目服务器的技术。 有三方交互:源项目服务器,目标项目服务器和位置服务。 存储在源中的每个项目具有移动状态,例如“静止”,“源尝试转移”,“目的地接受转移”或“目的地尝试转移”。 类似地,存储在目的地的每个项目也具有移动状态,例如“静止”,“源尝试转移”,“目的地接受转移”或“目的地尝试转移”。 位置服务期望具有用于由存储系统存储的每个项目的条目。 项目的条目可以包括项目的当前位置(例如,项目服务器的标识符)以及诸如“稳定”或“尝试传送”的状态。
-
公开(公告)号:US20080228836A1
公开(公告)日:2008-09-18
申请号:US11717285
申请日:2007-03-13
申请人: John P. MacCormick
发明人: John P. MacCormick
IPC分类号: G06F12/00
CPC分类号: G06F11/2094 , G06F11/1662
摘要: A deterministic technique is used for assigning locations to object replicas in a data center, while taking the various constraints into account that guarantee high availability and fast recovery. Example constraints include not putting the replicas on the same machine and not on the same rack, in case the rack or the network switch goes down. Also, because power distribution units (PDUs) can fail, the two replicas are not put on the same PDU. A solution is guaranteed to be found, if one exists.
摘要翻译: 确定性技术用于在数据中心中为对象副本分配位置,同时考虑到保证高可用性和快速恢复的各种约束。 示例约束不包括将副本放在同一台机器上,而不是在同一机架上,以防机架或网络交换机出现故障。 另外,由于配电单元(PDU)出现故障,两个副本不会放在同一PDU上。 确保找到一个解决方案(如果存在)。
-
公开(公告)号:US07926103B2
公开(公告)日:2011-04-12
申请号:US10455472
申请日:2003-06-05
IPC分类号: G06F11/00
CPC分类号: H04L63/0254 , H04L63/1466
摘要: Preventing replay attacks on servers. At least one Bloom filter may be set up in a server for tracking requests received from clients. Identifying data may be generated for each request. The identifying data may be checked against the Bloom filter array. If a match is found, the message may be a replay and may be rejected. If a match is not found, the request identifying data may be added to the Bloom filter and the request may be processed.
摘要翻译: 防止服务器上的重播攻击。 可以在服务器中设置至少一个布隆过滤器来跟踪从客户端接收到的请求。 可以为每个请求生成识别数据。 可以针对Bloom过滤器阵列检查识别数据。 如果找到匹配,该消息可能是重播,可能被拒绝。 如果没有找到匹配,则可以将请求标识数据添加到布隆过滤器,并且可以处理该请求。
-
-
-
-
-
-
-
-
-