公开(公告)号：US20240095594A1

公开(公告)日：2024-03-21

申请号：US18459354

申请日：2023-08-31

Applicant: Google LLC

Inventor： Om Dipakbhai Thakkar ,  Arun Ganesh ,  Virat Vishnu Shejwalkar ,  Abhradeep Guha Thakurta ,  Rajiv Mathews

IPC: G06N20/00

CPC classification number: G06N20/00

Abstract: A method includes training a first differentially private (DP) model using a private training set, the private training set including a plurality of training samples, the first DP model satisfying a differential privacy budget, the differential privacy budget defining an amount of information about individual training samples of the private training set that may be revealed by the first DP model. The method also includes, while training the first DP model, generating a plurality of intermediate checkpoints, each intermediate checkpoint of the plurality of intermediate checkpoints representing a different intermediate state of the first DP model, each of the intermediate checkpoints satisfying the same differential privacy budget. The method further includes determining an aggregate of the first DP model and the plurality of intermediate checkpoints, and determining, using the aggregate, a second DP model, the second DP model satisfying the same differential privacy budget.