-
公开(公告)号:US09213709B2
公开(公告)日:2015-12-15
申请号:US13569994
申请日:2012-08-08
申请人: Kestutis Patiejunas , Bryan J. Donlan , Colin L. Lazier , James Christopher Sorenson, III , Mark C. Seigle , Christian L. Claiborn
发明人: Kestutis Patiejunas , Bryan J. Donlan , Colin L. Lazier , James Christopher Sorenson, III , Mark C. Seigle , Christian L. Claiborn
CPC分类号: G06F17/30371 , G06F17/30073 , G06F17/30997 , G06F21/606 , G06F21/6209 , G06F21/6218 , H04L63/08 , H04L67/1097
摘要: Methods and systems are provided herein that facilitate cost-effective and reliable data identification in an archival data storage system. In an embodiment, a data object stored in an archival data storage system is identified by a data object identifier which encodes storage location information that may be used to locate a data object stored in an archival data storage system that reduces the cost to store a global index. The data object identifier may also encode policy information such as access control information usable for validating subsequent access to the data object, payload validation information such as size and digest usable for verifying the integrity of the payload data, metadata validation information such as error-detection codes usable for validating integrity of the data object identifier and other information.
摘要翻译: 本文提供的方法和系统便于在档案数据存储系统中进行成本有效和可靠的数据识别。 在一个实施例中,存储在存档数据存储系统中的数据对象被数据对象标识符识别,数据对象标识符编码存储位置信息,存储位置信息可用于定位存储在存档数据存储系统中的数据对象,其降低了存储全局的成本 指数。 数据对象标识符还可以编码诸如用于验证对数据对象的后续访问的访问控制信息的策略信息,诸如可用于验证有效载荷数据的完整性的有效载荷确认信息,例如可用于验证有效载荷数据的完整性的有效载荷确认信息,元数据验证信息 用于验证数据对象标识符和其他信息的完整性的代码。
-
公开(公告)号:US09092441B1
公开(公告)日:2015-07-28
申请号:US13570029
申请日:2012-08-08
申请人: Kestutis Patiejunas , Colin L. Lazier , James Christopher Sorenson, III , Mark C. Seigle , Christian L. Claiborn
发明人: Kestutis Patiejunas , Colin L. Lazier , James Christopher Sorenson, III , Mark C. Seigle , Christian L. Claiborn
CPC分类号: G06F17/30073 , G06F17/30221
摘要: Methods and systems are provided herein that facilitate cost-effective, scalable and reliable archival data organization and management. In an embodiment, data are redundantly encoded and stored to provide data reliability. Further, encoded data may be stored in self-describing storage entities that provide information describing data stored therein. Information provided by self-describing storage entities may be used to construct a limited map that is usable to facilitate data placement and data location services during data storage and retrieval. Data reliability and durability is provided because information about data stored in the system is mostly contained in the storage entities themselves. Cost efficiency is provided because only a limited map is provided for efficiency purposes instead of a potentially large global index data structure.
摘要翻译: 本文提供的方法和系统便于成本有效,可扩展和可靠的归档数据组织和管理。 在一个实施例中,对数据进行冗余编码和存储以提供数据可靠性。 此外,编码数据可以存储在提供描述存储在其中的数据的信息的自描述存储实体中。 由自描述存储实体提供的信息可用于构建有限地图,其可用于在数据存储和检索期间促进数据放置和数据定位服务。 提供数据可靠性和耐用性,因为关于存储在系统中的数据的信息主要包含在存储实体本身中。 提供成本效率,因为仅为有效的目的而不是潜在的大型全局索引数据结构提供有限的映射。
-
公开(公告)号:US20140047261A1
公开(公告)日:2014-02-13
申请号:US13569591
申请日:2012-08-08
IPC分类号: G06F1/26
CPC分类号: G06F1/266 , G06F1/3268 , Y02D10/154
摘要: Embodiments of the present disclosure are directed to, among other things, managing power of one or more data storage devices. In some examples, a storage service may obtain a schedule associated with enabling different storage devices at different times. The storage service may also identify a request of a batch of requests for accessing the storage devices. In some cases, the storage service may also determine which storage device to activate based at least in part on the schedule and/or the request. Further, the storage service may manage power of a storage device based at least in part on the determination of which storage device to activate.
摘要翻译: 本公开的实施例尤其涉及管理一个或多个数据存储设备的功率。 在一些示例中,存储服务可以获得与在不同时间启用不同存储设备相关联的调度。 存储服务还可以识别对批量的访问存储设备的请求的请求。 在某些情况下,存储服务还可以至少部分地基于时间表和/或请求来确定要激活的存储设备。 此外,存储服务可以至少部分地基于要激活哪个存储设备的确定来管理存储设备的功率。
-
公开(公告)号:US20140047040A1
公开(公告)日:2014-02-13
申请号:US13570074
申请日:2012-08-08
申请人: Kestutis Patiejunas , Christian L. Claiborn , Colin L. Lazier , Claire E. Suver , Mark C. Seigle
发明人: Kestutis Patiejunas , Christian L. Claiborn , Colin L. Lazier , Claire E. Suver , Mark C. Seigle
IPC分类号: H04L12/58
CPC分类号: G06F17/30371 , G06F11/14 , G06F11/1443 , G06F11/1464 , G06F17/30 , G06F17/30144 , G06F17/30309 , H04L51/24
摘要: An application programming interface for a data storage service provides a convenient mechanism for clients of the data storage service to access its various capabilities. An API call may be made to initiate a job and in response a job identifier may be provided. A separate API call specifying the job identifier may be made and a response providing information related to the job may result. Various API calls may be used to store data, retrieve data, obtain an inventory of stored data, and to obtain other information relating to stored data.
摘要翻译: 用于数据存储服务的应用编程接口为数据存储服务的客户端提供方便的机制来访问其各种能力。 可以进行API调用以启动作业,并且作为响应,可以提供作业标识符。 可以制定指定作业标识符的单独的API调用,并且可能导致提供与作业相关的信息的响应。 可以使用各种API调用来存储数据,检索数据,获取存储的数据的库存,以及获得与存储的数据有关的其他信息。
-
公开(公告)号:US20140046908A1
公开(公告)日:2014-02-13
申请号:US13570088
申请日:2012-08-08
申请人: Kestutis Patiejunas , James R. Hamilton , Colin L. Lazier , Alyssa H. Henry , Mark C. Seigle , Christian L. Claiborn
发明人: Kestutis Patiejunas , James R. Hamilton , Colin L. Lazier , Alyssa H. Henry , Mark C. Seigle , Christian L. Claiborn
IPC分类号: G06F17/30
CPC分类号: G06F17/30008 , G06F17/30073
摘要: A cost-effective, durable and scalable archival data storage system is provided herein that allow customers to store, retrieve and delete archival data objects, among other operations. For data storage, in an embodiment, the system stores data in a transient data store and provides a data object identifier may be used by subsequent requests. For data retrieval, in an embodiment, the system creates a job corresponding to the data retrieval and provides a job identifier associated with the created job. Once the job is executed, data retrieved is provided in a transient data store to enable customer download. In various embodiments, jobs associated with storage, retrieval and deletion are scheduled and executed using various optimization techniques such as load balancing, batch processed and partitioning. Data is redundantly encoded and stored in self-describing storage entities increasing reliability while reducing storage costs. Data integrity is ensured by integrity checks along data paths.
摘要翻译: 本文提供了一种经济高效,可持续和可扩展的存档数据存储系统,允许客户存储,检索和删除存档数据对象以及其他操作。 对于数据存储,在一个实施例中,系统将数据存储在瞬态数据存储器中,并且可以由随后的请求使用提供的数据对象标识符。 对于数据检索,在一个实施例中,系统创建与数据检索相对应的作业,并提供与创建的作业相关联的作业标识符。 执行作业后,在瞬态数据存储中提供检索的数据,以便客户下载。 在各种实施例中,使用诸如负载平衡,批处理和分区之类的各种优化技术调度和执行与存储,检索和删除相关联的作业。 数据被冗余编码并存储在自描述存储实体中,从而提高可靠性,同时降低存储成本。 通过沿着数据路径的完整性检查来确保数据完整性。
-
公开(公告)号:US20140046906A1
公开(公告)日:2014-02-13
申请号:US13569994
申请日:2012-08-08
申请人: Kestutis Patiejunas , Bryan J. Donlan , Colin L. Lazier , James Christopher Sorenson, III , Mark C. Seigle , Christian L. Claiborn
发明人: Kestutis Patiejunas , Bryan J. Donlan , Colin L. Lazier , James Christopher Sorenson, III , Mark C. Seigle , Christian L. Claiborn
IPC分类号: G06F17/30
CPC分类号: G06F17/30371 , G06F17/30073 , G06F17/30997 , G06F21/606 , G06F21/6209 , G06F21/6218 , H04L63/08 , H04L67/1097
摘要: Methods and systems are provided herein that facilitate cost-effective and reliable data identification in an archival data storage system. In an embodiment, a data object stored in an archival data storage system is identified by a data object identifier which encodes storage location information that may be used to locate a data object stored in an archival data storage system that reduces the cost to store a global index. The data object identifier may also encode policy information such as access control information usable for validating subsequent access to the data object, payload validation information such as size and digest usable for verifying the integrity of the payload data, metadata validation information such as error-detection codes usable for validating integrity of the data object identifier and other information.
摘要翻译: 本文提供的方法和系统便于在档案数据存储系统中进行成本有效和可靠的数据识别。 在一个实施例中,存储在存档数据存储系统中的数据对象被数据对象标识符识别,数据对象标识符编码存储位置信息,存储位置信息可用于定位存储在存档数据存储系统中的数据对象,其降低了存储全局的成本 指数。 数据对象标识符还可以编码诸如用于验证对数据对象的后续访问的访问控制信息的策略信息,诸如可用于验证有效载荷数据的完整性的有效载荷确认信息,例如可用于验证有效载荷数据的完整性的有效载荷确认信息,元数据验证信息 用于验证数据对象标识符和其他信息的完整性的代码。
-
公开(公告)号:US09767098B2
公开(公告)日:2017-09-19
申请号:US13570088
申请日:2012-08-08
申请人: Kestutis Patiejunas , James R. Hamilton , Colin L. Lazier , Alyssa H. Henry , Mark C. Seigle , Christian L. Claiborn
发明人: Kestutis Patiejunas , James R. Hamilton , Colin L. Lazier , Alyssa H. Henry , Mark C. Seigle , Christian L. Claiborn
IPC分类号: G06F17/30
CPC分类号: G06F17/30008 , G06F17/30073
摘要: A cost-effective, durable and scalable archival data storage system is provided herein that allow customers to store, retrieve and delete archival data objects, among other operations. For data storage, in an embodiment, the system stores data in a transient data store and provides a data object identifier may be used by subsequent requests. For data retrieval, in an embodiment, the system creates a job corresponding to the data retrieval and provides a job identifier associated with the created job. Once the job is executed, data retrieved is provided in a transient data store to enable customer download. In various embodiments, jobs associated with storage, retrieval and deletion are scheduled and executed using various optimization techniques such as load balancing, batch processed and partitioning. Data is redundantly encoded and stored in self-describing storage entities increasing reliability while reducing storage costs. Data integrity is ensured by integrity checks along data paths.
-
公开(公告)号:US09727559B2
公开(公告)日:2017-08-08
申请号:US13570088
申请日:2012-08-08
申请人: Kestutis Patiejunas , James R. Hamilton , Colin L. Lazier , Alyssa H. Henry , Mark C. Seigle , Christian L. Claiborn
发明人: Kestutis Patiejunas , James R. Hamilton , Colin L. Lazier , Alyssa H. Henry , Mark C. Seigle , Christian L. Claiborn
IPC分类号: G06F17/30
摘要: A cost-effective, durable and scalable archival data storage system is provided herein that allow customers to store, retrieve and delete archival data objects, among other operations. For data storage, in an embodiment, the system stores data in a transient data store and provides a data object identifier may be used by subsequent requests. For data retrieval, in an embodiment, the system creates a job corresponding to the data retrieval and provides a job identifier associated with the created job. Once the job is executed, data retrieved is provided in a transient data store to enable customer download. In various embodiments, jobs associated with storage, retrieval and deletion are scheduled and executed using various optimization techniques such as load balancing, batch processed and partitioning. Data is redundantly encoded and stored in self-describing storage entities increasing reliability while reducing storage costs. Data integrity is ensured by integrity checks along data paths.
-
公开(公告)号:US09354683B2
公开(公告)日:2016-05-31
申请号:US13569591
申请日:2012-08-08
CPC分类号: G06F1/266 , G06F1/3268 , Y02D10/154
摘要: Embodiments of the present disclosure are directed to, among other things, managing power of one or more data storage devices. In some examples, a storage service may obtain a schedule associated with enabling different storage devices at different times. The storage service may also identify a request of a batch of requests for accessing the storage devices. In some cases, the storage service may also determine which storage device to activate based at least in part on the schedule and/or the request. Further, the storage service may manage power of a storage device based at least in part on the determination of which storage device to activate.
摘要翻译: 本公开的实施例尤其涉及管理一个或多个数据存储设备的功率。 在一些示例中,存储服务可以获得与在不同时间启用不同存储设备相关联的调度。 存储服务还可以识别对批量的访问存储设备的请求的请求。 在某些情况下,存储服务还可以至少部分地基于时间表和/或请求来确定要激活的存储设备。 此外,存储服务可以至少部分地基于要激活哪个存储设备的确定来管理存储设备的功率。
-
公开(公告)号:US09225675B2
公开(公告)日:2015-12-29
申请号:US13570074
申请日:2012-08-08
申请人: Kestutis Patiejunas , Christian L. Claiborn , Colin L. Lazier , Claire E. Suver , Mark C. Seigle
发明人: Kestutis Patiejunas , Christian L. Claiborn , Colin L. Lazier , Claire E. Suver , Mark C. Seigle
CPC分类号: G06F17/30371 , G06F11/14 , G06F11/1443 , G06F11/1464 , G06F17/30 , G06F17/30144 , G06F17/30309 , H04L51/24
摘要: An application programming interface for a data storage service provides a convenient mechanism for clients of the data storage service to access its various capabilities. An API call may be made to initiate a job and in response a job identifier may be provided. A separate API call specifying the job identifier may be made and a response providing information related to the job may result. Various API calls may be used to store data, retrieve data, obtain an inventory of stored data, and to obtain other information relating to stored data.
摘要翻译: 用于数据存储服务的应用编程接口为数据存储服务的客户端提供方便的机制来访问其各种能力。 可以进行API调用以启动作业,并且作为响应,可以提供作业标识符。 可以制定指定作业标识符的单独的API调用,并且可能导致提供与该作业相关的信息的响应。 可以使用各种API调用来存储数据,检索数据,获取存储的数据的库存,以及获得与存储的数据有关的其他信息。
-
-
-
-
-
-
-
-
-