Emotion Recognition System

Official/legal definition: Under the EU Artificial Intelligence Act, an "emotion recognition system" is "an AI system for the purpose of identifying or inferring emotions or intentions of natural persons on the basis of their biometric data." Recital 18 gives examples (happiness, sadness, anger, surprise, disgust, embarrassment, excitement, shame, contempt, satisfaction, amusement), and explains exclusions (physical states such as pain or fatigue and the mere detection of readily apparent expressions or gestures unless used to infer emotions). ([eur-lex.europa.eu](https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX%3A32024R1689&utm_source=openai))

Meaning in technical and standards terms: In international technical terminology the task of "emotion recognition" is described as a computational task to identify and categorise emotions expressed in text, speech, video or images (or combinations thereof); ISO/IEC standards treat emotion recognition as a task/functional category within AI terminology and distinguish it from lower‑level detection of expressions or from other tasks such as sentiment analysis. This standards framing helps translate legal purpose‑based definitions into engineering requirements for datasets, labels and evaluation metrics. ([itsmf.ch](https://www.itsmf.ch/blogs/post/understanding-ai-terms-and-definitions-according-to-the-standard-iso-22989?utm_source=openai))

Jurisdictional variations (summary):

• European Union: The EU AI Act provides a purpose‑based legal definition (Article 3(39)) and clarifying recital text (Recital 18). Emotion recognition systems that infer emotions from biometric data are specifically regulated: certain uses (notably in workplaces and educational institutions) are prohibited and other uses are treated as high‑risk with compliance obligations. The EU text explicitly excludes physical states and mere detection of obvious expressions unless they are used to infer emotions. ([eur-lex.europa.eu](https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX%3A32024R1689&utm_source=openai))
• United States: U.S. federal frameworks (NIST AI RMF) do not define a statutory "emotion recognition system" term but treat affective/emotion detection as an AI use‑case with attendant risk management expectations; enforcement in the U.S. is driven by existing consumer‑protection and anti‑discrimination authorities (e.g., FTC guidance under Section 5) and by state laws (some state statutes and proposals expressly restrict workplace surveillance or profiling). In practice U.S. compliance requires risk assessment, documentation, bias testing and transparency consistent with NIST guidance and FTC warnings. ([nist.gov](https://www.nist.gov/publications/artificial-intelligence-risk-management-framework-ai-rmf-10?utm_source=openai))
• International/Standards and soft law: The OECD AI Principles and UNESCO Recommendation set high‑level values (human‑centred values, fairness, non‑manipulation, protection of privacy and mental integrity) that influence national regulation; ISO/IEC 22989 and related SC‑42 standards provide technical terminology and task definitions (e.g., emotion recognition as a computational task), which organisations use to operationalise compliance across borders. These instruments are non‑binding but shape regulatory expectations and technical best practice. ([aigovernance101.com](https://www.aigovernance101.com/courses/free-ai-governance-course/lessons/the-oecd-principles-on-artificial-intelligence/?utm_source=openai))

Context and scope: The EU’s legal definition is purpose‑based—it captures AI systems whose stated or actual purpose is to identify or infer emotions/intentions from biometric data (including facial images, voice characteristics, gait, physiological signals, or other signals treated as biometric). The definition therefore depends on (a) the system’s objective and (b) the data modality: systems that only perform generic sentiment analysis of text (not based on biometric signals) typically fall outside the EU prohibition, while multimodal systems that use biometric inputs to infer inner emotional states are within scope. The EU recital clarifies borderline cases (detection of a smile alone is not necessarily an emotion inference unless used to identify an emotional state). ([ai-act-service-desk.ec.europa.eu](https://ai-act-service-desk.ec.europa.eu/en/ai-act/recital-18?utm_source=openai))

Practical implications for businesses operating across jurisdictions:

• Under the EU AI Act, developers and deployers must determine whether their system’s purpose and inputs fall within the legal definition; if so, they must apply the Act’s obligations or face prohibitions (e.g., workplace/education bans) or high‑risk compliance regimes (impact assessments, data governance, human oversight, documentation, conformity assessments). ([eur-lex.europa.eu](https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX%3A32024R1689&utm_source=openai))
• In the U.S., firms should follow NIST’s AI RMF risk‑management guidance (governance, mapping, measuring, managing) and the FTC’s consumer‑protection expectations (no deceptive claims, mitigation of bias, transparency). Even where no federal ban exists, state laws and sectoral regulators may restrict particular uses (notably workplace surveillance). ([nist.gov](https://www.nist.gov/publications/artificial-intelligence-risk-management-framework-ai-rmf-10?utm_source=openai))
• Internationally, compliance programs should map local prohibitions and voluntary international standards (ISO/IEC and OECD/UNESCO principles) into product design, consent and contractual terms, and cross‑border data flows. Relying solely on «consent» or terms of service is risky where local law restricts uses in particular contexts (e.g., employment, education). ([itsmf.ch](https://www.itsmf.ch/blogs/post/understanding-ai-terms-and-definitions-according-to-the-standard-iso-22989?utm_source=openai))

Key requirements / criteria (practical checklist) (derived from legal texts and standards):

• The system’s purpose must be assessed: does it aim to identify or infer emotions/intentions? (EU Article 3/Recital 18). ([eur-lex.europa.eu](https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX%3A32024R1689&utm_source=openai))
• Does the system rely on biometric data (facial images, voice features, gait, physiological signals)? If yes, EU rules are likely engaged. ([ai-act-service-desk.ec.europa.eu](https://ai-act-service-desk.ec.europa.eu/en/ai-act/recital-18?utm_source=openai))
• Are the intended contexts restricted by law (e.g., workplace or education bans in the EU)? If so, check exceptions (narrow medical/safety carve‑outs). ([eur-lex.europa.eu](https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX%3A32024R1689&utm_source=openai))
• Technical controls and governance: data quality, representative datasets, bias testing, transparency/disclosure, human oversight, record‑keeping and conformity assessment where required. Follow ISO terminology and NIST RMF practices. ([itsmf.ch](https://www.itsmf.ch/blogs/post/understanding-ai-terms-and-definitions-according-to-the-standard-iso-22989?utm_source=openai))

Examples: (i) A camera system that analyses employee facial micro‑expressions to decide break schedules would meet the EU definition and be prohibited in the workplace absent a narrow safety/medical justification. (ii) A call‑centre tool that analyses caller tone to personalise service and does not infer a worker’s emotional state may fall outside the EU workplace prohibition but will still raise privacy and FTC enforcement risks in the U.S. (iii) A research‑only prototype that analyses facial expressions to study group reactions must still consider whether biometric data and purpose bring it within national rules and GDPR/data‑protection obligations. ([legalblogs-wolterskluwer-com.ezproxy.massey.ac.nz](https://legalblogs-wolterskluwer-com.ezproxy.massey.ac.nz/global-workplace-law-and-policy/the-prohibition-of-ai-emotion-recognition-technologies-in-the-workplace-under-the-ai-act/?utm_source=openai))

Cross‑references: Related legal/technical concepts include biometric data, biometric categorisation system, remote biometric identification system, AI system (OECD/NIST definitions), high‑risk AI system, and prohibited AI practices under the EU AI Act. For engineering practice, consult ISO/IEC 22989 (terminology) and NIST AI RMF (risk management). ([eur-lex.europa.eu](https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX%3A32024R1689&utm_source=openai))