公开(公告)号：US20240193927A1

公开(公告)日：2024-06-13

申请号：US18486756

申请日：2023-10-13

Applicant: Hewlett Packard Enterprise Development LP

Inventor： Soumyendu Sarkar ,  Ashwin Ramesh Babu ,  Seyed Sajad Mousavi ,  Vineet Gundecha ,  Sahand Ghorbanpour ,  Avisek Naug

IPC: G06V10/82 ,  G06T5/00 ,  G06T7/11 ,  G06V10/776

CPC classification number: G06V10/82 ,  G06T5/001 ,  G06T7/11 ,  G06V10/776

Abstract: Systems and methods are provided for reinforcement Learning agents for adversarial black-box attacks to determine and refine robustness of a machine learning (ML) model. Examples include receiving an image corresponding to a ground truth and computing sensitivity of an ML model in classifying the image as the ground truth to added and removed distortions. An RL agent determines to add distortions to and remove distortions from the image based on the sensitivities. The ML Model classifies the image based on the added and removed distortions, and the process is repeated until the machine learning model misclassifies the image. Based on the misclassification, a measure of robustness is determined and/or the ML model can be retrained.