AI governance
AI governance is the framework of policies, processes, roles and controls an organisation uses to ensure its development and use of AI is safe, lawful, ethical and aligned with its goals. It covers tool approval, data protection, risk assessment, accountability, monitoring and compliance with regulation.
In practice, AI governance usually includes an inventory of AI systems and use cases, an acceptable use policy, risk assessments scaled to the stakes of each use, vendor due diligence, human oversight for consequential decisions, incident handling and regular review. Frameworks provide structure: the NIST AI Risk Management Framework 1.0, published in January 2023, organises the work into govern, map, measure and manage, and ISO/IEC 42001 specifies requirements for an AI management system.
Why it matters: regulation such as the EU AI Act (Regulation (EU) 2024/1689) sets obligations that depend on how AI is used, and customers may ask suppliers to show how they govern AI. For buyers, governance shapes which tools can be approved, which contract terms are required and what evidence vendors must provide, such as security certifications, data-processing terms and model documentation.
Example: before approving an AI note-taking tool, a governance group checks where recordings are stored, whether they are used for training, who can access them and how participants are notified.
Limits: governance documents only work if people can follow them. Overly restrictive rules can push employees toward unapproved tools (shadow AI), so effective programmes pair rules with approved options and training.
Related terms
Learn it step by step
Sources
- Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1. National Institute of Standards and Technology, January 2023
- ISO/IEC 42001:2023 Information technology — Artificial intelligence — Management system. ISO/IEC, December 2023
- Regulation (EU) 2024/1689 (Artificial Intelligence Act). Official Journal of the European Union, July 2024
Topic: AI governance
Last updated