公开(公告)号：US20240320529A1

公开(公告)日：2024-09-26

申请号：US18611417

申请日：2024-03-20

Applicant: DeepMind Technologies Limited

Inventor： Sumanth Dathathri ,  Abigail Elizabeth See ,  Borja De Balle Pigem ,  Sumedh Kedar Ghaisas ,  Pushmeet Kohli ,  Po-Sen Huang ,  Johannes Maximilian Welbl

IPC: G06N7/01

CPC classification number: G06N7/01

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for watermarking a digital object generated by a machine learning model. The digital object is defined by a sequence of tokens. The watermarking involves modifying a probability distribution of the tokens by applying a succession of watermarking stages.

公开(公告)号：US20230351042A1

公开(公告)日：2023-11-02

申请号：US18141273

申请日：2023-04-28

Applicant: DeepMind Technologies Limited

Inventor： Soham De ,  Borja De Balle Pigem ,  Jamie Hayes ,  Samuel Laurence Smith ,  Leonard Alix Jean Eric Berrada Lancrey Javal

IPC: G06F21/62

CPC classification number: G06F21/6245

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for privacy-sensitive training of a neural network. In one aspect, a method includes training a set of neural network parameters of the neural network on a set of training data over multiple training iterations to optimize an objective function. Each training iteration includes: sampling a batch of network inputs from the set of training data; determining a clipped gradient for each network input in the batch of network inputs; and updating the neural network parameters using the clipped gradients for the network inputs in the batch of network inputs.