# Performance and Reliability Evaluation for Continuous modIfications and uSEability of AI (PRECISE-AI)

Canonical: https://abierto.us/opportunities/arpahsol25113

- Solicitation number: ARPA-H-SOL-25-113
- Notice type: Solicitation (first published as presolicitation)
- Status: Closed. Deadline was January 15, 2025 at 5:00 PM EST
- Department: Department of Health and Human Services
- Agency: National Institutes of Health
- Contracting office: Advanced Research Projects Agency for Health (Arpa-H) (75N992)
- NAICS: 541715 Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology)
- Product or service code: AN13 Health R&D Services; Health Care Services; Experimental Development
- First posted: August 29, 2024
- Last posted: December 18, 2024
- SAM.gov: https://sam.gov/workspace/contract/opp/89a99518ba0c409582043a92a2b96a92/view

## Description

December 18, 2024 - Amendment 01 posted. This amended provides a revised Attachment 1, which requests Key Personnel information on the cover page. All other documents remain unchanged. The rapid advancement of artificial intelligence (AI) technologies is transforming healthcare by improving efficiencies, reducing costs, and enhancing health outcomes.

This potential is evident with over 850 FDA-approved medical devices now incorporating AI functionalities, a tenfold increase from 2018 to 2023. However, the ability to ensure the ongoing safety and efficacy of these AI systems has not kept pace. The conventional safety testing approach relies heavily on pre-market testing, assuming that these initial results will predict long-term performance.

However, pre-market results often fail to account for variations in operational processes and patient demographics, leading to unpredictable post-market performance that currently requires manual oversight by vendors. Performance and Reliability Evaluation for Continuous modIfications and uSEability of AI (PRECISE-AI) aims to create a suite of self-correction techniques that make it possible to automatically maintain peak model performance of predictive AI components across diverse clinical settings.

PRECISE-AI will advance novel approaches to optimally support clinician decision-making and scalably manage the performance of AI Decision Support Tools (AI-DSTs) after their commercial deployment. Key areas of innovation include continuous monitoring capabilities, degradation detection, root cause analysis, self-correction, and bidirectional communication with clinicians.

This program will establish an open-source repository of tools to autonomously maintain the performance of clinical AI-DSTs while enhancing the interpretability and actionability of AI model outputs. The program will test these innovations in real-world settings to demonstrate measurable improvements in clinical decision-making. This program addresses the pressing need for continuous monitoring and updating of clinical AI models to ensure they remain effective and trustworthy over time.

## Publications

- August 29, 2024: Presolicitation, due January 15, 2025 at 2:00 PM EST. Notice 30eb0096f4714ecb96d122e8dc869041. https://sam.gov/workspace/contract/opp/30eb0096f4714ecb96d122e8dc869041/view
- September 5, 2024: Presolicitation, due January 15, 2025 at 2:00 PM EST. Notice e2daa542a6ea493d8ff7002836090702. https://sam.gov/workspace/contract/opp/e2daa542a6ea493d8ff7002836090702/view
- October 28, 2024: Presolicitation, due January 15, 2025 at 2:00 PM EST. Notice 509b926524f940969c5483542fbc15e7. https://sam.gov/workspace/contract/opp/509b926524f940969c5483542fbc15e7/view
- December 16, 2024: Solicitation, due January 15, 2025 at 5:00 PM EST. Notice 5e0ce349b21641eba5169c42fd9a8d9e. https://sam.gov/workspace/contract/opp/5e0ce349b21641eba5169c42fd9a8d9e/view
- December 18, 2024: Solicitation, due January 15, 2025 at 5:00 PM EST. Notice 89a99518ba0c409582043a92a2b96a92. https://sam.gov/workspace/contract/opp/89a99518ba0c409582043a92a2b96a92/view

## Points of contact

- PRECISE-AI Coordinator, PRECISEAI@arpa-h.gov

---
Source: SAM.gov Contract Opportunities bulk extract. Confirm deadlines on SAM.gov before responding. Cite https://abierto.us/opportunities/arpahsol25113.