DATAWorks - Adversarial AI Testing & Evaluation

 

IBM’s open-source Adversarial Robustness Toolbox (ART) provides tools that:

  • assess model performance under adversarial attack
  • improve model resiliency in case of attack

In collaboration with the CDAO’s JATIC program, IBM created the Hardened Extension of ART (HEART) with:

  • an emphasis on DoD needs and use cases (UAVs, surveillance, etc)
  • alignment to best-in-class open-source standards to facilitate AI testing across broader evaluation criteria

The project’s open-source repos can be found here:

Adversarial Robustness Toolbox (ART)

Hardened Extension of ART (HEART)