-
公开(公告)号:US12038906B2
公开(公告)日:2024-07-16
申请号:US18054870
申请日:2022-11-11
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Neal Fachan , Samuel James McKelvie , Laurion Darrell Burchall , Christopher Richard Newcombe , Pradeep Jnana Madhavarapu , Benjamin Tobler , James McClellan Corey
CPC classification number: G06F16/2365 , G06F11/1451 , G06F11/1471 , G06F16/23 , G06F11/2094 , G06F2201/80
Abstract: A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.
-
公开(公告)号:US09672237B2
公开(公告)日:2017-06-06
申请号:US14201517
申请日:2014-03-07
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Pradeep Jnana Madhavarapu , Laurion Darrell Burchall , Neal Fachan
CPC classification number: G06F17/30368 , G06F11/1474 , G06F17/30575 , G06F2201/80 , G06F2201/82
Abstract: A database system may maintain a plurality of log records at a distributed storage system. Each of the plurality of log records may be associated with a respective change to a data page. Upon detection of a coalesce event for a particular data page, log records linked to the particular data page may be applied to generate the particular data page in its current state. Detecting the coalesce event may be a determination that the number of log records linked to the particular data page exceeds a threshold.
-
公开(公告)号:US10331655B2
公开(公告)日:2019-06-25
申请号:US15613637
申请日:2017-06-05
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Pradeep Jnana Madhavarapu , Laurion Darrell Burchall , Neal Fachan
Abstract: A database system may maintain a plurality of log records at a distributed storage system. Each of the plurality of log records may be associated with a respective change to a data page. Upon detection of a coalesce event for a particular data page, log records linked to the particular data page may be applied to generate the particular data page in its current state. Detecting the coalesce event may be a determination that the number of log records linked to the particular data page exceeds a threshold.
-
公开(公告)号:US20170220436A1
公开(公告)日:2017-08-03
申请号:US15489523
申请日:2017-04-17
Applicant: Amazon Technologies, Inc.
Inventor: Nicholas Ryman Vogel , Colm McCarthaigh , Grant Alexander MacDonald McAlister , Laurion Darrell Burchall , Jorgen Lawrence Johnson
CPC classification number: G06F11/2033 , G06F11/2005 , G06F11/2023 , G06F11/2028 , G06F11/3006 , G06F13/362 , H04L29/08144 , H04L41/0893 , H04L41/5051 , H04L41/5096 , H04L43/0805 , H04L43/0817 , H04L43/10 , H04L67/327
Abstract: Methods and apparatus for a primary role reporting service for resource groups are disclosed. A reporting intermediary assigned to a resource group of a network-accessible service receives role information indicating the identity of a primary member of the group from a state manager of the network-accessible service. The intermediary receives a health status query pertaining to the resource group from a health checking subsystem used by a network address discovery service, and provides a health status response based on the role information. The response provided by the reporting intermediary is used by the network address discovery service to provide a network address in response to a lookup query for the resource group.
-
公开(公告)号:US20240330270A1
公开(公告)日:2024-10-03
申请号:US18740434
申请日:2024-06-11
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Neal Fachan , Samuel James McKelvie , Laurion Darrell Burchall , Christopher Richard Newcombe , Pradeep Jnana Madhavarapu , Benjamin Tobler , James McClellan Corey
CPC classification number: G06F16/2365 , G06F11/1451 , G06F11/1471 , G06F16/23 , G06F11/2094 , G06F2201/80
Abstract: A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.
-
公开(公告)号:US11030055B2
公开(公告)日:2021-06-08
申请号:US14201505
申请日:2014-03-07
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Laurion Darrell Burchall , Pradeep Jnana Madhavarapu , Neal Fachan
Abstract: A distributed database system may implement fast crash recovery. Upon recovery from a database head node failure, a connection with one or more storage nodes of a distributed storage system storing data for a database implemented by the database head node may be established. Upon establishment of the connection with the storage nodes, that database may be made available for access, such as for various access requests. In various embodiments, redo log records may not be replayed in order to provide access to the database. In at least some embodiments, the storage nodes may provide a current state of data stored for the database in response to requests.
-
公开(公告)号:US20200327114A1
公开(公告)日:2020-10-15
申请号:US16914075
申请日:2020-06-26
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Neal Fachan , Samuel James McKelvie , Laurion Darrell Burchall , Christopher Richard Newcombe , Pradeep Jnana Madhavarapu , Benjamin Tobler , James McClellan Corey
Abstract: A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.
-
公开(公告)号:US09760596B2
公开(公告)日:2017-09-12
申请号:US13893004
申请日:2013-05-13
Applicant: Amazon Technologies, Inc.
Inventor: Laurion Darrell Burchall , Pradeep Jnana Madhavarapu , Christopher Richard Newcombe , Anurag Windlass Gupta
CPC classification number: G06F17/30377 , G06F9/466 , G06F17/30351 , G06F17/30359 , G06F17/30371
Abstract: Nodes of a database service may receive a read request to perform a read of a record stored by the database service and a transaction request to perform a transaction to the record. First and second indications of time may be associated with the read and transaction, respectively. A potential read anomaly (e.g., fuzzy read, read skew, etc.) may be detected based, at least in part, on a determination that the first indication of time is within a threshold value of the second indication of time. In response to detecting the potential read anomaly, the read may be performed after the transaction specified by the transaction request, regardless of whether the first indication of time is indicative of an earlier point in time than the second indication of time.
-
公开(公告)号:US09626262B1
公开(公告)日:2017-04-18
申请号:US14100414
申请日:2013-12-09
Applicant: Amazon Technologies, Inc.
Inventor: Nicholas Ryman Vogel , Colm MacCarthaigh , Grant Alexander MacDonald McAlister , Laurion Darrell Burchall , Jorgen Lawrence Johnson
CPC classification number: G06F11/2033 , G06F11/2005 , G06F11/2028 , G06F11/3006 , G06F13/362 , H04L29/08144 , H04L41/0893 , H04L41/5051 , H04L41/5096 , H04L43/0805 , H04L43/0817 , H04L43/10 , H04L67/327
Abstract: Methods and apparatus for a primary role reporting service for resource groups are disclosed. A reporting intermediary assigned to a resource group of a network-accessible service receives role information indicating the identity of a primary member of the group from a state manager of the network-accessible service. The intermediary receives a health status query pertaining to the resource group from a health checking subsystem used by a network address discovery service, and provides a health status response based on the role information. The response provided by the reporting intermediary is used by the network address discovery service to provide a network address in response to a lookup query for the resource group.
-
10.
公开(公告)号:US09251003B1
公开(公告)日:2016-02-02
申请号:US13967185
申请日:2013-08-14
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Pradeep Jnana Madhavarapu , Matthew David Allen , Laurion Darrell Burchall , James McClellan Corey
CPC classification number: G06F11/1469 , G06F11/1438 , G06F11/1441 , G06F17/30132 , G06F2201/80 , G06F2201/82 , G06F2201/84
Abstract: A database system may implement database cache survivability across database failures. In various embodiments, a database cache may be maintained independent of a failure of a database. A database cache may be maintained in a non-volatile memory device or maintained in a shared memory segment of system memory. Upon recovery from a database failure, a recovery point may be determined that indicates a consistent state of the database. Cache entries of the database cache inconsistent with the consistent state of the database may be invalidated, and the database cache may be made available for access requests directed toward the database. Valid cache entries from before the database failure may be made available without accessing a back-end data store for the database.
Abstract translation: 数据库系统可以跨数据库故障实现数据库缓存生存性。 在各种实施例中,可以独立于数据库的故障来维护数据库高速缓存。 可以将数据库高速缓存维护在非易失性存储器设备中或者维护在系统存储器的共享存储器段中。 从数据库故障恢复时,可以确定指示数据库一致状态的恢复点。 与数据库的一致状态不一致的数据库缓存的缓存条目可能被无效,并且数据库高速缓存可能被用于针对数据库的访问请求。 数据库故障之前的有效缓存条目可以在不访问数据库的后端数据存储的情况下可用。
-
-
-
-
-
-
-
-
-