公开(公告)号：US12094474B1

公开(公告)日：2024-09-17

申请号：US18510537

申请日：2023-11-15

Applicant: DeepMind Technologies Limited

Inventor： Sven Adrian Gowal ,  Christopher Gamble ,  Florian Nils Stimberg ,  Sylvestre-Alvise Guglielmo Rebuffi ,  Sree Meghana Thotakuri ,  Jamie Hayes ,  Ian Goodfellow ,  Rudy Bunel ,  Miklós Zsigmond Horváth ,  David Stutz ,  Olivia Anne Wiles

IPC: G10L19/018 ,  G06F21/16 ,  G10L21/0232

CPC classification number: G10L19/018 ,  G06F21/16 ,  G10L21/0232

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for verifying the provenance of a digital object generated by a neural network, such as an image or audio object. Also methods, systems, and apparatus, including computer programs, for training a watermarking neural network and a watermark decoding neural network. The described techniques make efficient use of computing resources and are robust to attack.

公开(公告)号：US20240143696A1

公开(公告)日：2024-05-02

申请号：US18275737

申请日：2022-02-07

Applicant: DeepMind Technologies Limited

Inventor： Ali Taylan Cemgil ,  Krishnamurthy Dvijotham ,  Arnaud Doucet ,  Jamie Hayes

IPC: G06F17/18

CPC classification number: G06F17/18

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating one or more differentiable order statistics for a vector of scores. In one aspect, a method comprises: obtaining the vector of scores, wherein each position in the vector of scores is associated with a respective index from a set of indices; obtaining a plurality of pairs of indices; generating a respective swapping probability for each pair of indices based on the vector of scores; generating, for each pair of indices, a respective soft-swapping matrix for the pair of indices as a combination of: (i) an identity matrix, and (ii) an exchange matrix, wherein the exchange matrix is weighted in the combination by the swapping probability for the pair of indices; and generating the one or more differentiable order statistics for the vector of scores using the soft-swapping matrices.

公开(公告)号：US20250149048A1

公开(公告)日：2025-05-08

申请号：US18886824

申请日：2024-09-16

Applicant: DeepMind Technologies Limited

Inventor： Sven Adrian Gowal ,  Christopher Gamble ,  Florian Nils Stimberg ,  Sylvestre-Alvise Guglielmo Rebuffi ,  Sree Meghana Thotakuri ,  Jamie Hayes ,  Ian Goodfellow ,  Rudy Bunel ,  Miklós Zsigmond Horváth ,  David Stutz ,  Olivia Anne Wiles

IPC: G10L19/018 ,  G06F21/16 ,  G10L21/0232

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for verifying the provenance of a digital object generated by a neural network, such as an image or audio object. Also methods, systems, and apparatus, including computer programs, for training a watermarking neural network and a watermark decoding neural network. The described techniques make efficient use of computing resources and are robust to attack.

公开(公告)号：US20250087221A1

公开(公告)日：2025-03-13

申请号：US18886685

申请日：2024-09-16

Applicant: DeepMind Technologies Limited

Inventor： Sven Adrian Gowal ,  Christopher Gamble ,  Florian Nils Stimberg ,  Sylvestre-Alvise Guglielmo Rebuffi ,  Sree Meghana Thotakuri ,  Jamie Hayes ,  Ian Goodfellow ,  Rudy Bunel ,  Miklós Zsigmond Horváth ,  David Stutz ,  Olivia Anne Wiles

IPC: G10L19/018 ,  G06F21/16 ,  G10L21/0232

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for verifying the provenance of a digital object generated by a neural network, such as an image or audio object. Also methods, systems, and apparatus, including computer programs, for training a watermarking neural network and a watermark decoding neural network. The described techniques make efficient use of computing resources and are robust to attack.

公开(公告)号：US20230351042A1

公开(公告)日：2023-11-02

申请号：US18141273

申请日：2023-04-28

Applicant: DeepMind Technologies Limited

Inventor： Soham De ,  Borja De Balle Pigem ,  Jamie Hayes ,  Samuel Laurence Smith ,  Leonard Alix Jean Eric Berrada Lancrey Javal

IPC: G06F21/62

CPC classification number: G06F21/6245

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for privacy-sensitive training of a neural network. In one aspect, a method includes training a set of neural network parameters of the neural network on a set of training data over multiple training iterations to optimize an objective function. Each training iteration includes: sampling a batch of network inputs from the set of training data; determining a clipped gradient for each network input in the batch of network inputs; and updating the neural network parameters using the clipped gradients for the network inputs in the batch of network inputs.