公开(公告)号：US20170206140A1

公开(公告)日：2017-07-20

申请号：US15476926

申请日：2017-03-31

Applicant: NETFLIX, INC.

Inventor： Charles SMITH ,  Jeffrey Magnusson ,  Siddharth Anand

IPC: G06F11/14 ,  G06F17/30 ,  G06F11/16

CPC classification number: G06F11/1446 ,  G06F11/1662 ,  G06F11/2094 ,  G06F16/2308 ,  G06F16/2358 ,  G06F16/2474 ,  G06F16/2477 ,  G06F2201/80 ,  G06F2201/82 ,  G06F2201/835 ,  G06F2201/84

Abstract: A method and system for building a point-in-time snapshot of an eventually-consistent data store. The data store includes key-value pairs stored on a plurality of storage nodes. In one embodiment, the data store is implemented as an Apache® Cassandra database running in the “cloud.” The data store includes a journaling mechanism that stores journals (i.e., inconsistent snapshots) of the data store on each node at various intervals. In Cassandra, these snapshots are sorted string tables that may be copied to a back-up storage location. A cluster of processing nodes may retrieve and resolve the inconsistent snapshots to generate a point-in-time snapshot of the data store corresponding to a lagging consistency point. In addition, the point-in-time snapshot may be updated as any new inconsistent snapshots are generated by the data store such that the lagging consistency point associated with the updated point-in-time snapshot is more recent.

公开(公告)号：US10942812B2

公开(公告)日：2021-03-09

申请号：US15476926

申请日：2017-03-31

Applicant: NETFLIX, INC.

Inventor： Charles Smith ,  Jeffrey Magnusson ,  Siddharth Anand

IPC: G06F12/00 ,  G06F11/14 ,  G06F16/23 ,  G06F16/2458 ,  G06F11/16 ,  G06F11/20

Abstract: A method and system for building a point-in-time snapshot of an eventually-consistent data store. The data store includes key-value pairs stored on a plurality of storage nodes. In one embodiment, the data store is implemented as an Apache® Cassandra database running in the “cloud.” The data store includes a journaling mechanism that stores journals (i.e., inconsistent snapshots) of the data store on each node at various intervals. In Cassandra, these snapshots are sorted string tables that may be copied to a back-up storage location. A cluster of processing nodes may retrieve and resolve the inconsistent snapshots to generate a point-in-time snapshot of the data store corresponding to a lagging consistency point. In addition, the point-in-time snapshot may be updated as any new inconsistent snapshots are generated by the data store such that the lagging consistency point associated with the updated point-in-time snapshot is more recent.