公开(公告)号：US20240403288A1

公开(公告)日：2024-12-05

申请号：US18326667

申请日：2023-05-31

Applicant: Shopify, Inc.

Inventor： Derek STRIDE ,  Oleksiy KOVYRIN

IPC: G06F16/23 ,  G06F16/2453 ,  G06F16/27

Abstract: The server hosting the database scans a binlog for database change events. When a log consumer identifies a change event indicating that certain database records were modified, the consumer pulls only the identifiers of the modified records from the binlog. The log consumer then populates and pushes only the identifiers of the modified records into a non-transitory storage location that is accessible to a database streaming bus. The streaming bus publishes the identifiers for consumption by instances of materialization workers. The hosting server invokes parallel processor threads to execute the materialization workers. The materialization worker rewrites a query script for constructing a materialized view of certain database records, including the modified database records indicated by the identifiers. The materialization worker executes the query script to construct the materialized view, which contains only the modified database records used for generating the database updates to commit to the database.