Invention Grant
- Patent Title: Lockless synchronization of LSM tree metadata in a distributed system
-
Application No.: US16231300Application Date: 2018-12-21
-
Publication No.: US11176099B2Publication Date: 2021-11-16
- Inventor: Wenguang Wang , Junlong Gao , Richard P. Spillane , Robert T. Johnson , Christos Karamanolis , Maxime Austruy
- Applicant: VMware, Inc.
- Applicant Address: US CA Palo Alto
- Assignee: VMware, Inc.
- Current Assignee: VMware, Inc.
- Current Assignee Address: US CA Palo Alto
- Main IPC: G06F16/178
- IPC: G06F16/178 ; G06F16/18

Abstract:
The disclosure herein describes synchronizing a data cache and an LSM tree file system on an object storage platform. Instructions to send a cached data set from the data cache to the LSM tree file system are received. An updated metadata catalog is generated. If the LSM tree structure is out of shape, compaction is performed on the LSM tree file system which may be on a different system or server. When an unmerged compacted metadata catalog is identified, a merged metadata catalog is generated, based on the compacted metadata catalog and the cached data set, and associated with the cached data set. The cached data set and the associated metadata catalog are sent to the LSM tree file system, whereby the data cache and the LSM tree file system are synchronized. Synchronization is enabled without the data cache or file system being locked and/or waiting for the other entity.
Information query