公开(公告)号：US20230153461A1

公开(公告)日：2023-05-18

申请号：US17987761

申请日：2022-11-15

Applicant: Hamid R. Tizhoosh ,  THE TORONTO-DOMINION BANK

Inventor： Shivam Kalra ,  Jesse Cole Cresswell ,  Junfeng Wen ,  Maksims Volkovs ,  Hamid R. Tizhoosh

IPC: G06F21/62

CPC classification number: G06F21/6245

Abstract: A model training system protects data leakage of private data in a federated learning environment by training a private model in conjunction with a proxy model. The proxy model is trained with protections for the private data and may be shared with other participants. Proxy models from other participants are used to train the private model, enabling the private model to benefit from parameters based on other models’ private data without privacy leakage. The proxy model may be trained with a differentially private algorithm that quantifies a privacy cost for the proxy model, enabling a participant to measure the potential exposure of private data and drop out. Iterations may include training the proxy and private models and then mixing the proxy models with other participants. The mixing may include updating and applying a bias to account for the weights of other participants in the received proxy models.