Human-in-the-Loop
An oversight model where humans actively participate in every AI decision cycle, approving actions before execution.
How the laws define this
Frameworks universally agree that human-in-the-loop requires active human oversight, review, or intervention to ensure final accountability and prevent automated errors in AI decision-making. However, instruments diverge on whether the requirement functions as a broad operational standard across system lifecycles or a strict pre-approval gate for high-impact outcomes. General standards like ISO/IEC 22989:2022 and Responsible Artificial Intelligence guidance for businesses frame it as continuous oversight across operational stages. In contrast, domain-specific rules—such as the Draft Strategy for the Development and Integration of Artificial Intelligence in Bulgarian Education, the San Juan AI Judicial Protocol, and Proyecto 255/24—limit the requirement to reviewing outputs before they trigger enforceable, safety-critical, or evaluative actions. Furthermore, while the National Guidelines on AI Governance & Ethics (AIGE) defines the concept broadly to encompass related arrangements like human-on-the-loop, Proyecto 255/24 explicitly treats human-on-the-loop as a distinct alternative model.
Synthesised from the 14 statutory definitions below. Each one is quoted in full, with its source.
How jurisdictions differ
What is distinctive in each definition, binding law in force first. Showing 9 of the 14 instruments that define this term; all are listed under Definitions below.
| Jurisdiction | Instrument | Status | What is distinctive |
|---|---|---|---|
| Asturias, Spain | Asturias AI Public Administration Decree 2025 | In Force | Limits the term to a governance requirement for significant administrative decisions in public administration, emphasizing possibility of human review or intervention. |
| San Juan, Argentina | San Juan AI Judicial Protocol | In Force | Narrowed to judicial context where AI assists humans who retain final control and responsibility for decisions. |
| ISO | ISO/IEC 22989:2022 - Information technology — Artificial intelligence — Concepts and terminology | In Force | Specifies hands-on operational intervention, including direct actions to approve, modify or halt outputs during operation or lifecycle stages. |
| New Zealand | Responsible Artificial Intelligence guidance for businesses | In Force | Adds explicit oversight, validation, final decision authority, defined escalation paths and limits on automated high-impact decisions. |
| Saudi Arabia | Generative AI Guidelines for Government (SDAIA) | In Force | Describes controls for high-risk outputs in high-impact domains to mitigate harms from hallucinations or erroneous actions. |
| WHO | Ethics and governance of artificial intelligence for health: WHO guidance | In Force | Frames it as socio-technical design where AI is assistive and humans maintain control and responsibility for final decisions in health. |
| Malaysia | National Guidelines on AI Governance & Ethics (AIGE) | In Force | Encompasses related modalities like human-on-the-loop and human-in-control within the decision-making cycle including review, correction or approval. |
| Turkey | Artificial Intelligence and Education: Practical Prompt Engineering and Innovative Learning Strategies for Teachers | In Force | Applies to education where teachers review, moderate or validate AI outputs before dissemination to ensure pedagogical alignment and prevent harms. |
| Amsterdam, Netherlands | Amsterdam Algorithm Register | In Force | Describes human intervention or oversight in the decision-making process of automated systems to ensure accountability and prevent errors. |
What it triggers
- In the San Juan AI Judicial Protocol, it mandates human oversight and transparency for AI tools used by judges and judicial staff.source
- In the Georgia State AI Governance and Use Guidance, it sets out prior AI testing and ensures human judgment remains central in executive branch agencies.source
- In the Generative AI Guidelines for Government (SDAIA), it calls for human-in-the-loop controls for high-impact domains and high-risk outputs.source
Definitions (14)
A design requirement where a qualified educator retains meaningful intervention and override capability for system outputs that affect learning or assessment, ensuring that automated recommendations do not replace critical human judgment in pedagogical or evaluative contexts.
A human oversight role in which a person is actively involved in the AI system's decision process and can directly take actions, approve, modify or halt system outputs during operation or specific lifecycle stages. It denotes hands-on, operational human intervention as part of system control and governance.
A governance and operational control approach where a human provides explicit oversight, validation or retains final decision-making authority over outputs or actions of an AI system, including defined escalation paths and limits on automated decision-making for high-impact cases.
A control approach requiring human oversight, review, or intervention for AI outputs deemed high-risk, ensuring that final decisions impacting individuals or critical services involve accountable human decision-makers. The Guidelines mandate human-in-the-loop controls for high-impact domains and high-risk outputs to mitigate harms from hallucinations or erroneous automated actions.
An oversight model in which a human reviewer must intervene, authorize, or review AI-generated outputs before they result in enforceable outcomes or life-safety actions; the bill mandates this model (or human-on-the-loop alternatives) for systems with potentially enforceable or safety-critical outputs and requires escalation procedures and defined human roles.
A design and operational requirement ensuring that qualified human operators retain meaningful oversight, review, intervention capability or final decision authority over high‑risk automated functions to prevent, detect or mitigate harms.
Human-in-the-loop denotes mechanisms ensuring meaningful human oversight and decision-making at critical stages of AI use, including review and approval gates to prevent fully automated high-impact decisions and to validate AI outputs for accuracy and appropriateness.
Human-in-the-loop is an approach mandated by the guidance, ensuring that human judgment remains central to decision-making processes. It emphasizes that AI systems should support, rather than replace, human expertise and final accountability.
A requirement for human intervention or oversight in the decision-making process of an automated system to ensure accountability and prevent errors.
A governance requirement ensuring that significant administrative decisions are not made solely by machines without the possibility of human review or intervention.
A model of interaction where an AI system assists a human, but the human retains final control and responsibility for the decision.
A socio-technical system design where AI acts as an assistive tool and human operators maintain control and responsibility for final decisions.
A human oversight arrangement where a person is actively involved in the AI system’s decision‑making cycle (including review, correction, or approval), encompassing related modalities such as human‑on‑the‑loop and human‑in‑control to ensure appropriate oversight.
A governance practice where a teacher or school staff reviews, moderates, or validates AI-generated outputs prior to dissemination to learners, ensuring pedagogical alignment and preventing harms. The guide emphasizes this as a core mitigation for higher‑risk uses like assessment.
Not to be confused with
Human-on-the-loop allows AI to operate autonomously with humans monitoring and able to intervene, while human-in-the-loop requires active human participation in every decision cycle.
Human-out-of-the-loop involves fully autonomous AI without human intervention, contrasting with human-in-the-loop's active human involvement in decisions.
Questions and answers
What is required for AI use in San Juan courts?
The San Juan AI Judicial Protocol defines human-in-the-loop as a model where AI assists but humans retain final control and responsibility. It mandates oversight and transparency for judicial AI tools.
How does ISO define human-in-the-loop?
ISO/IEC 22989:2022 defines it as active human involvement to approve, modify or halt AI outputs during operation. It denotes hands-on intervention as part of system control.
What human role is needed in high-risk AI under Saudi guidelines?
The Generative AI Guidelines for Government (SDAIA) describe human oversight, review or intervention for high-risk outputs to ensure accountable human decisions in critical services.
Related Terms
Human-on-the-Loop
An oversight model where AI operates autonomously while humans monitor and retain the ability to intervene when needed....
Human-out-of-the-Loop
An operational model where AI systems function fully autonomously without human intervention in decision-making....
Human Oversight
Mechanisms enabling human control and intervention over AI system operations....
Meaningful Human Control
The principle that humans must retain sufficient understanding and authority over AI systems to be genuinely accountable for outcomes....