Request for Information: Techniques and Tools for Vulnerability Assessment of AI-enabled Systems

The Defense Advanced Research Projects Agency (DARPA) Information Innovation Office (I2O) seeks information from industry developers and academic institutions regarding current and emerging techniques and tools for the operational assessment of potential vulnerabilities in DoD relevant artificial intelligence (AI)-enabled systems.

We seek techniques and tools that: 1) consider a spectrum of relevant adversarial access threat models (white box, grey box, black box, hidden box), 2) consider not just the AI model, but also vulnerabilities presented by the entire AI-enabled system development and deployment pipeline, and 3) consider the platform specific quirks in operationally assessing vulnerabilities including environmental conditions, multi-modal sensor ingest, and system purpose.

Responses to this RFI will be used to assess the current state of the art and to identify core gaps that will need to be addressed by a future program in AI vulnerability assessment.