-
公开(公告)号:US12277138B2
公开(公告)日:2025-04-15
申请号:US17810314
申请日:2022-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Ippokratis Pandis , Gokul Soundararajan , Gopal Paliwal , Punit Rajgaria , Sanuj Basu , Todd Jeffrey Green , Gaurav Saxena , Vadim Skipin , Johannes Wust , Hemanth Satyanarayana , Matthew Perry Abrams , Murali Brahmadesam
Abstract: Methods for replicating transactional tables of a transactional database to an analytical database and maintaining updates to those transactional table representations are disclosed. Snapshots of the transactional tables are provided to the analytical database via a transport mechanism, such as a data storage service or a data streaming service, and stored at the analytical database. Then, checkpoints comprising portions of a change-data-capture log that has recorded transactional changes to the transactional tables of the transactional database are provided to the analytical database via the same or different transport mechanism and used to commit those transactional changes to the snapshot representations. The snapshot representations may be used to respond to incoming analytical queries in order to provide real-time querying results.
-
公开(公告)号:US12007983B2
公开(公告)日:2024-06-11
申请号:US17810318
申请日:2022-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Ippokratis Pandis , Gokul Soundararajan , Gopal Paliwal , Vadim Skipin , Sanuj Basu
CPC classification number: G06F16/2379 , G06F16/2358 , G06F16/254
Abstract: Methods for implementing insert, update, and delete events of a change-data-capture log in transactional order to a representation of a transactional table are disclosed. Insert events may be applied and committed to the representation, while delete events may be buffered and committed to a shadow table. Such buffering may allow the delete events to be applied and committed as a batch to the given representation as a later background operation, allowing for an optimized application of the change-data-capture log to the representation. Once the delete events are committed to the representation, they are removed from the shadow table. Update events may be similarly treated in which the insert event component of the update event is applied and committed to the representation while the delete event component is committed to the shadow table, before being later committed to the representation and removed from the shadow table.
-
公开(公告)号:US20240004860A1
公开(公告)日:2024-01-04
申请号:US17810312
申请日:2022-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Gokul Soundararajan , Gopal Paliwal , Punit Rajgaria , Sanuj Basu
IPC: G06F16/23 , G06F16/22 , G06F16/242
CPC classification number: G06F16/2358 , G06F16/2433 , G06F16/2282
Abstract: Methods for negotiating parameters for maintaining, at an analytical database, a replica of a transactional table, stored at a transactional database, are disclosed. By establishing parameters of said maintenance prior to commencing, the transactional database and the analytical database may remain only loosely coupled after completing the negotiation. The parameters of the negotiation may be stored in a location that is accessible to both the transactional database and the analytical database, such that the results of the negotiation may be accessed during the process of maintaining the replica. The negotiation may include a procedure to provide portions of a change-data-capture log, associated to the transactional table, to the analytical database via a transport mechanism such that the replica may be updated, in addition to a list of agreed upon data definition language commands that may be used in the portions of the change-data-capture log.
-
公开(公告)号:US12093239B2
公开(公告)日:2024-09-17
申请号:US17810312
申请日:2022-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Gokul Soundararajan , Gopal Paliwal , Punit Rajgaria , Sanuj Basu
IPC: G06F16/23 , G06F16/22 , G06F16/242
CPC classification number: G06F16/2358 , G06F16/2282 , G06F16/2433
Abstract: Methods for negotiating parameters for maintaining, at an analytical database, a replica of a transactional table, stored at a transactional database, are disclosed. By establishing parameters of said maintenance prior to commencing, the transactional database and the analytical database may remain only loosely coupled after completing the negotiation. The parameters of the negotiation may be stored in a location that is accessible to both the transactional database and the analytical database, such that the results of the negotiation may be accessed during the process of maintaining the replica. The negotiation may include a procedure to provide portions of a change-data-capture log, associated to the transactional table, to the analytical database via a transport mechanism such that the replica may be updated, in addition to a list of agreed upon data definition language commands that may be used in the portions of the change-data-capture log.
-
5.
公开(公告)号:US20240004897A1
公开(公告)日:2024-01-04
申请号:US17810314
申请日:2022-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Ippokratis Pandis , Gokul Soundararajan , Gopal Paliwal , Punit Rajgaria , Sanuj Basu , Todd Jeffrey Green , Gaurav Saxena , Vadim Skipin , Johannes Wust , Hemanth Satyanarayana , Matthew Perry Abrams , Murali Brahmadesam
CPC classification number: G06F16/27 , G06F16/25 , G06F16/283 , G06F16/2379
Abstract: Methods for replicating transactional tables of a transactional database to an analytical database and maintaining updates to those transactional table representations are disclosed. Snapshots of the transactional tables are provided to the analytical database via a transport mechanism, such as a data storage service or a data streaming service, and stored at the analytical database. Then, checkpoints comprising portions of a change-data-capture log that has recorded transactional changes to the transactional tables of the transactional database are provided to the analytical database via the same or different transport mechanism and used to commit those transactional changes to the snapshot representations. The snapshot representations may be used to respond to incoming analytical queries in order to provide real-time querying results.
-
6.
公开(公告)号:US20240004867A1
公开(公告)日:2024-01-04
申请号:US17810318
申请日:2022-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Ippokratis Pandis , Gokul Soundararajan , Gopal Paliwal , Vadim Skipin , Sanuj Basu
CPC classification number: G06F16/2379 , G06F16/254 , G06F16/2358
Abstract: Methods for implementing insert, update, and delete events of a change-data-capture log in transactional order to a representation of a transactional table are disclosed. Insert events may be applied and committed to the representation, while delete events may be buffered and committed to a shadow table. Such buffering may allow the delete events to be applied and committed as a batch to the given representation as a later background operation, allowing for an optimized application of the change-data-capture log to the representation. Once the delete events are committed to the representation, they are removed from the shadow table. Update events may be similarly treated in which the insert event component of the update event is applied and committed to the representation while the delete event component is committed to the shadow table, before being later committed to the representation and removed from the shadow table.
-
-
-
-
-