公开(公告)号：US11263128B2

公开(公告)日：2022-03-01

申请号：US15795650

申请日：2017-10-27

Applicant: Google LLC

Inventor： Wangyuan Zhang ,  Sandeep Singhal ,  Sangho Yoon ,  Guangda Lai ,  Arash Baratloo ,  Zhifan Zhang ,  Gael Hatchue Njouyep ,  Pramod Gaud

IPC: G06F12/02 ,  G06F16/11 ,  G06F16/17 ,  G06F16/182 ,  G06F16/22 ,  G06F3/06

Abstract: A method includes receiving data objects, determining a predicted lifespan of each data object, and instantiating multiple shard files. Each shard file has an associated predicted lifespan range. The method also includes writing each data object into a corresponding shard file having the associated predicted lifespan range that includes the predicted lifespan of the respective data object and storing the shard files in a distributed system. The method also includes determining whether any stored shard files satisfy a compaction criteria based on a number of deleted data objects in each corresponding stored shard file. For each stored shard file satisfying the compaction criteria, the method also includes compacting the stored shard file by rewriting the remaining data objects of the stored shard file into a new shard file.

公开(公告)号：US20190129844A1

公开(公告)日：2019-05-02

申请号：US15795650

申请日：2017-10-27

Applicant: Google LLC

Inventor： Wangyuan Zhang ,  Sandeep Singhal ,  Sangho Yoon ,  Guangda Lai ,  Arash Baratloo ,  Zhifan Zhang ,  Gael Hatchue Njouyep ,  Pramod Gaud

IPC: G06F12/02 ,  G06F3/06 ,  G06F17/30

Abstract: A method includes receiving data objects, determining a predicted lifespan of each data object, and instantiating multiple shard files. Each shard file has an associated predicted lifespan range. The method also includes writing each data object into a corresponding shard file having the associated predicted lifespan range that includes the predicted lifespan of the respective data object and storing the shard files in a distributed system. The method also includes determining whether any stored shard files satisfy a compaction criteria based on a number of deleted data objects in each corresponding stored shard file. For each stored shard file satisfying the compaction criteria, the method also includes compacting the stored shard file by rewriting the remaining data objects of the stored shard file into a new shard file.

公开(公告)号：US11954024B2

公开(公告)日：2024-04-09

申请号：US17648724

申请日：2022-01-24

Applicant: Google LLC

Inventor： Wangyuan Zhang ,  Sandeep Singhal ,  Sangho Yoon ,  Guangda Lai ,  Arash Baratloo ,  Zhifan Zhang ,  Gael Hatchue Njouyep ,  Pramod Gaud

IPC: G06F12/02 ,  G06F3/06 ,  G06F16/11 ,  G06F16/17 ,  G06F16/182 ,  G06F16/22

CPC classification number: G06F12/0261 ,  G06F3/0604 ,  G06F3/0608 ,  G06F16/122 ,  G06F16/1734 ,  G06F16/182 ,  G06F16/2219 ,  G06F3/0649

Abstract: A method includes receiving data objects, determining a predicted lifespan of each data object, and instantiating multiple shard files. Each shard file has an associated predicted lifespan range. The method also includes writing each data object into a corresponding shard file having the associated predicted lifespan range that includes the predicted lifespan of the respective data object and storing the shard files in a distributed system. The method also includes determining whether any stored shard files satisfy a compaction criteria based on a number of deleted data objects in each corresponding stored shard file. For each stored shard file satisfying the compaction criteria, the method also includes compacting the stored shard file by rewriting the remaining data objects of the stored shard file into a new shard file.

公开(公告)号：US20220147448A1

公开(公告)日：2022-05-12

申请号：US17648724

申请日：2022-01-24

Applicant: Google LLC

Inventor： Wangyuan Zhang ,  Sandeep Singhal ,  Sangho Yoon ,  Guangda Lai ,  Arash Baratloo ,  Zhifan Zhang ,  Gael Hatchue Njouyep ,  Pramod Gaud

IPC: G06F12/02 ,  G06F16/11 ,  G06F16/17 ,  G06F16/182 ,  G06F16/22 ,  G06F3/06

Abstract: A method includes receiving data objects, determining a predicted lifespan of each data object, and instantiating multiple shard files. Each shard file has an associated predicted lifespan range. The method also includes writing each data object into a corresponding shard file having the associated predicted lifespan range that includes the predicted lifespan of the respective data object and storing the shard files in a distributed system. The method also includes determining whether any stored shard files satisfy a compaction criteria based on a number of deleted data objects in each corresponding stored shard file. For each stored shard file satisfying the compaction criteria, the method also includes compacting the stored shard file by rewriting the remaining data objects of the stored shard file into a new shard file.