公开(公告)号：US20210303686A1

公开(公告)日：2021-09-30

申请号：US16834461

申请日：2020-03-30

Applicant: BAE Systems Information and Electronic Systems Integration Inc.

Inventor： Jonathan Shuai ,  Ty M. Danet ,  Kalyanaraman Vaidyanathan

IPC: G06F21/56 ,  G06K9/62 ,  G06N7/00 ,  G06N3/04

Abstract: A system and method is provided that tests and determines whether candidate artificial intelligence model contains a Trojan from when it was trained and using the outcome determination of the Trojan to determine whether the candidate artificial intelligence model should be deployed. The system utilizes a first artificial intelligence that operates as a data generator and a second artificial intelligence that operates as a discriminator to determine whether the candidate artificial intelligence contains a Trojan. The first artificial intelligence combines sets of data with random Trojan triggers and the second artificial intelligence discriminates output classifications from the candidate artificial intelligence model to determine whether the Trojan is present based on probability outputs.

公开(公告)号：US11556647B2

公开(公告)日：2023-01-17

申请号：US16834461

申请日：2020-03-30

Applicant: BAE Systems Information and Electronic Systems Integration Inc.

Inventor： Jonathan Shuai ,  Ty M. Danet ,  Kalyanaraman Vaidyanathan

IPC: G06F21/00 ,  G06F21/56 ,  G06K9/62 ,  G06N3/04 ,  G06N7/00

Abstract: A system and method is provided that tests and determines whether candidate artificial intelligence model contains a Trojan from when it was trained and using the outcome determination of the Trojan to determine whether the candidate artificial intelligence model should be deployed. The system utilizes a first artificial intelligence that operates as a data generator and a second artificial intelligence that operates as a discriminator to determine whether the candidate artificial intelligence contains a Trojan. The first artificial intelligence combines sets of data with random Trojan triggers and the second artificial intelligence discriminates output classifications from the candidate artificial intelligence model to determine whether the Trojan is present based on probability outputs.