-
公开(公告)号:US20240330270A1
公开(公告)日:2024-10-03
申请号:US18740434
申请日:2024-06-11
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Neal Fachan , Samuel James McKelvie , Laurion Darrell Burchall , Christopher Richard Newcombe , Pradeep Jnana Madhavarapu , Benjamin Tobler , James McClellan Corey
CPC classification number: G06F16/2365 , G06F11/1451 , G06F11/1471 , G06F16/23 , G06F11/2094 , G06F2201/80
Abstract: A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.
-
公开(公告)号:US20230208884A1
公开(公告)日:2023-06-29
申请号:US18145842
申请日:2022-12-22
Applicant: Amazon Technologies, Inc.
Inventor: Quinton R. Hoole , Roland Paterson-Jones , Christopher C. Pinkham , Benjamin Tobler , Willem R. van Biljon , Gabriel Smit , Christopher Brown
IPC: H04L9/40 , H04L67/01 , H04L41/22 , H04L12/14 , H04L41/0813 , H04L67/10 , G06F9/455 , H04L67/1097
CPC classification number: H04L63/20 , H04L63/102 , H04L67/01 , H04L41/22 , H04L12/1442 , H04L41/0813 , H04L67/10 , G06F9/45558 , H04L63/10 , H04L67/1097 , H04L12/1439 , G06F2009/45587 , G06F2009/45595
Abstract: Techniques are described for managing communications between multiple intercommunicating computing nodes, such as multiple virtual machine nodes hosted on one or more physical computing machines or systems. In some situations, users may specify groups of computing nodes and optionally associated access policies for use in the managing of the communications for those groups, such as by specifying which source nodes are allowed to transmit data to particular destinations nodes. In addition, determinations of whether initiated data transmissions from source nodes to destination nodes are authorized may be dynamically negotiated for and recorded for later use in automatically authorizing future such data transmissions without negotiation. This abstract is provided to comply with rules requiring an abstract, and it is submitted with the intention that it will not be used to interpret or limit the scope or meaning of the claims.
-
公开(公告)号:US20200327114A1
公开(公告)日:2020-10-15
申请号:US16914075
申请日:2020-06-26
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Neal Fachan , Samuel James McKelvie , Laurion Darrell Burchall , Christopher Richard Newcombe , Pradeep Jnana Madhavarapu , Benjamin Tobler , James McClellan Corey
Abstract: A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.
-
公开(公告)号:US09621593B2
公开(公告)日:2017-04-11
申请号:US14928659
申请日:2015-10-30
Applicant: Amazon Technologies, Inc.
Inventor: Quinton R. Hoole , Roland Paterson-Jones , Christopher C. Pinkham , Benjamin Tobler , Willem R. van Biljon , Gabriel Smit , Christopher Brown
CPC classification number: H04L63/20 , G06F9/45558 , G06F2009/45587 , G06F2009/45595 , H04L12/1439 , H04L12/1442 , H04L41/0813 , H04L41/22 , H04L63/10 , H04L63/102 , H04L67/10 , H04L67/1097 , H04L67/42
Abstract: Techniques are described for managing the execution of programs on multiple computing systems, such as on virtual machine nodes executing on the computing systems. A program execution service may in some situations provide the multiple computing systems and manage the program execution on behalf of multiple customers or other users, including to select appropriate computing systems to execute one or more instances of a program for a user, such as based in part on configuration information specified by the user. The described techniques may further include managing communications between multiple intercommunicating computing nodes in some situations.
-
公开(公告)号:US09253211B2
公开(公告)日:2016-02-02
申请号:US13843287
申请日:2013-03-15
Applicant: Amazon Technologies, Inc.
Inventor: Quinton R. Hoole , Roland Paterson-Jones , Christopher C. Pinkham , Benjamin Tobler , Willem R. van Biljon , Gabriel Smit , Christopher Brown
CPC classification number: H04L63/20 , G06F9/45558 , G06F2009/45587 , G06F2009/45595 , H04L12/1439 , H04L12/1442 , H04L41/0813 , H04L41/22 , H04L63/10 , H04L63/102 , H04L67/10 , H04L67/1097 , H04L67/42
Abstract: Techniques are described for managing communications between multiple intercommunicating computing nodes, such as multiple virtual machine nodes hosted on one or more physical computing machines or systems. In some situations, users may specify groups of computing nodes and optionally associated access policies for use in the managing of the communications for those groups, such as by specifying which source nodes are allowed to transmit data to particular destinations nodes. In addition, determinations of whether initiated data transmissions from source nodes to destination nodes are authorized may be dynamically negotiated for and recorded for later use in automatically authorizing future such data transmissions without negotiation. This abstract is provided to comply with rules requiring an abstract, and it is submitted with the intention that it will not be used to interpret or limit the scope or meaning of the claims.
-
公开(公告)号:US09223843B1
公开(公告)日:2015-12-29
申请号:US14094154
申请日:2013-12-02
Applicant: Amazon Technologies, Inc.
Inventor: Pradeep Jnana Madhavarapu , Raman Mittal , Benjamin Tobler , James McClellan Corey , Yan Valerie Leshinsky , Samuel James McKelvie , Anurag Windlass Gupta
IPC: G06F17/30
CPC classification number: G06F17/30371 , G06F17/30368 , G06F17/30578
Abstract: A log-structured data store may implement optimized log storage for asynchronous log updates. In some embodiments, log records may be received indicating updates to data stored for a storage client and indicating positions in a log record sequence. The log records themselves may not be guaranteed to be received according to the log record sequence. Received log records may be stored in a hot log portion of a block-based storage device according to an order in which they are received. Log records in the hot log portion may then be identified to be moved to a cold log portion of the block-based storage device in order to complete a next portion of the log record sequence. Log records may be modified, such as compressed, or coalesced, before being stored together in a data block of the cold log portion according to the log record sequence.
Abstract translation: 日志结构化数据存储可以实现用于异步日志更新的优化日志存储。 在一些实施例中,可以接收指示对存储用于存储客户端的数据的更新并指示日志记录序列中的位置的日志记录。 可能无法保证根据日志记录顺序接收日志记录。 接收到的日志记录可以根据它们被接收的顺序存储在基于块的存储设备的热日志部分中。 然后可以将热日志部分中的日志记录识别为移动到基于块的存储设备的冷日志部分,以便完成日志记录序列的下一部分。 可以根据日志记录序列将日志记录修改,例如压缩或合并,然后一起存储在冷日志部分的数据块中。
-
公开(公告)号:US12038906B2
公开(公告)日:2024-07-16
申请号:US18054870
申请日:2022-11-11
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Neal Fachan , Samuel James McKelvie , Laurion Darrell Burchall , Christopher Richard Newcombe , Pradeep Jnana Madhavarapu , Benjamin Tobler , James McClellan Corey
CPC classification number: G06F16/2365 , G06F11/1451 , G06F11/1471 , G06F16/23 , G06F11/2094 , G06F2201/80
Abstract: A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.
-
公开(公告)号:US10229011B2
公开(公告)日:2019-03-12
申请号:US15413331
申请日:2017-01-23
Applicant: Amazon Technologies, Inc.
Inventor: Yan Valerie Leshinsky , James McClellan Corey , Pradeep Jnana Madhavarapu , Anurag Windlass Gupta , Benjamin Tobler , Samuel James McKelvie
Abstract: A distributed database system may implement log-structured distributed storage using a single log sequence number space. A log for a data volume may be maintained in a log-structured distributed storage system. The log may be segmented across multiple protection groups according to a partitioning of user data for the data volume. Updates to the log may be assigned a log sequence number from a log sequence number space for the data volume. A protection group may be determined for an update according to which partition of user data space the update pertains. Metadata to be included with the log record may indicate a previous log sequence number of a log record maintained at the protection group. The log record may be sent to the protection group and identified as committed based on acknowledgments received from storage nodes implementing the protection group.
-
公开(公告)号:US10223184B1
公开(公告)日:2019-03-05
申请号:US14036792
申请日:2013-09-25
Applicant: Amazon Technologies, Inc.
Inventor: Samuel James McKelvie , Benjamin Tobler , James McClellan Corey , Pradeep Jnana Madhavarapu , Oscar Ricardo Moll Thomae , Christopher Richard Newcombe , Yan Valerie Leshinsky , Anurag Windlass Gupta
Abstract: A log-structured distributed storage system may implement individual write quorums. Log records may be sent to different storage nodes of a quorum set storing data for a storage client sufficient to satisfy a write quorum requirement. For each log record, acknowledgments from storage nodes are received, and a determination is made whether the write quorum requirement is satisfied for the log record. Different log records may be maintained at different storage nodes, and still satisfy the write quorum requirement such that in some embodiments no one storage node may maintain all of the log records sent to storage nodes in the quorum set.
-
公开(公告)号:US09385963B1
公开(公告)日:2016-07-05
申请号:US13958660
申请日:2013-08-05
Applicant: Amazon Technologies, Inc.
IPC: H04L12/26 , H04L12/911
CPC classification number: H04L47/70 , H04L12/4641 , H04L67/02 , H04L67/32
Abstract: A system for allocating constrained resources (e.g., downstream services, execution threads, database connections, input/output channels, computational resources, and/or memory) to requested services that are dependent on those resources may include multiple resource queues, each of which maintains a queue of requests for a respective constrained resource, and multiple service request queues, from which requests may be subsequently serviced. As each request reaches the head of a resource queue, it may receive a resource token for a respective constrained resource. Once the request has collected resource tokens for each of the constrained resources on which it depends, the request may be passed to a service request queue that maintains a queue of requests of a particular type. Requests in the multiple service request queues may be serviced on a round-robin or weighted round-robin basis. The number of tokens available for each constrained resource may be modified based on observed system performance.
-
-
-
-
-
-
-
-
-