By law, we have a monitoring program in place for all AI tools defined as “high-impact” cases. High-Impact AI cases are those where AI outputs serve as a principal basis for decisions or actions with a legal, material, binding, or significant effect on any of these areas:
- Your civil rights, civil liberties, or privacy
- Your access to education, housing, insurance, credit, employment, or other programs
- Your access to critical government resources or services
- Human health and safety
- Critical infrastructure or public safety
- Strategic assets or resources, including high-value property and information marked sensitive or classified by the federal government
For these tools, we require an AI impact and risk mitigation plan that include testing, validation, and monitoring before being put into use. This plan defines what happens if the tool drops below an acceptable performance level. Depending on the case, we may take actions such as suspending use of the tool or removing it from service entirely until we can resolve the issue. We design these risk management practices to minimize the likelihood and impact of AI mistakes.
The regulation that covers high-impact cases is called “Accelerating Federal Use of AI through Innovation, Governance, and Public Trust (OMB-M-25-1).
Read OMB-M-25-1 on the White House website (PDF)