The Quiet Ban on 'Engagement Detection': Emotion-Recognition AI in EU Classrooms
- Article 5(1)(f) of the EU AI Act has banned AI systems that infer emotion from biometric data in education institutions since 2 February 2025, closing off a category of "engagement" and "confusion" detection some proctoring and learning-analytics vendors were piloting.
- The ban rests on a scientific objection, not just a privacy one: the Act's own recitals cite limited reliability, limited specificity and a risk of discriminatory outcomes in emotion-inference systems.
- Exceptions are narrow, covering only approved medical or safety devices, not general wellbeing or attentiveness monitoring.
- Institutions with proctoring or learning-analytics tools already deployed need to check, tool by tool, whether an emotion-inference feature is present and switched off, rather than assume the question does not apply to them.
Our assessment of the EU AI Act’s impact on education covers the wider picture: high-risk classification for assessment and monitoring tools, the AI literacy duty, and the deadline the Digital Omnibus pushed back. One piece of that picture deserves its own look, because it is not a future obligation. It is already in force, and it closes down a specific category of product that had quietly been finding its way into classrooms and exam halls.
What “engagement detection” was supposed to do
Before the ban, a handful of EdTech vendors were piloting tools that claimed to read a student’s internal state from external signals. The pitch varied by product, but the underlying idea was consistent: point a camera or a keystroke logger at a learner, run the output through a model, and produce a live score for something like engagement, confusion, frustration or attentiveness.
Facial-expression analysis was the most visible version, feeding webcam footage from a proctoring session or a video lesson into a model trained to map expressions onto emotional categories. Keystroke-pattern analytics took a quieter route, treating hesitation, backspacing and typing rhythm as a proxy for a student struggling with a question. Some learning-analytics dashboards combined both, alongside eye-tracking or browser-activity signals, to generate an “engagement” score a teacher could watch in real time or a proctoring system could flag against.
The appeal to institutions was obvious: a tool that promised to surface the students quietly falling behind, or to catch confusion before it became a failed assessment, without waiting for a human to notice.
Why the underlying science did not hold up
The problem was never really the ambition. It was the claim that current AI can reliably do this at all. Recital 44 of the Act sets out the regulator’s reasoning plainly, pointing to the limited reliability, limited specificity and limited generalisability of emotion-recognition systems, and to the discriminatory outcomes that can follow when a model trained on one population is applied to another.
That is not a stray objection. Facial-expression research has repeatedly found that the mapping from expression to emotion is far less universal than early affective-computing products assumed. A furrowed brow can mean concentration, confusion, irritation or nothing in particular, and the mapping shifts by culture, neurodivergence, age and individual habit. Keystroke-pattern “confusion” scoring inherits the same weakness in a different form: hesitation before typing can mean a student is thinking carefully, struggling, distracted or simply typing on an unfamiliar keyboard. A model built to output a single confidence score papers over that ambiguity rather than resolving it, and a wrong score attached to a real student is not a harmless error. It can shape how a teacher intervenes, how an exam is proctored, or how a learning platform steers what a student sees next.
What Article 5 actually prohibits
Regulation (EU) 2024/1689, the AI Act, lists a small set of practices it prohibits outright rather than merely regulating, and Article 5(1)(f) is one of them: AI systems that infer a natural person’s emotions from biometric data are banned in workplaces and in education and training institutions. The prohibition has applied since 2 February 2025, alongside the Article 4 AI literacy duty, both arriving well ahead of the high-risk compliance timetable that governs most of the rest of the Act.
The exception is narrow by design. It covers AI systems put in place or placed on the market for medical or safety reasons, and only where that use is a genuine, approved medical application, such as detecting genuine physiological distress in a clinical context. A learning platform’s “engagement” dashboard, a proctoring tool’s “confusion” flag, or a wellbeing app inferring mood from a student’s webcam feed do not qualify. General attentiveness or wellbeing monitoring sits outside the exception entirely, however benign the stated purpose.
It is worth being precise about what the ban does not touch. It does not prohibit AI-text detectors, plagiarism checkers, or proctoring features that flag browser activity, screen behaviour or submission timing without claiming to read a student’s emotional state. Our companion piece on AI detectors and proctoring tools as high-risk systems covers that separate, still-permitted category and the accuracy obligations that come with it. Article 5 is about inference from biometric data specifically to determine an emotional state, not about detection or monitoring generally.
What institutions with tools already deployed should do
The practical starting point is an honest inventory, tool by tool, of anything touching student webcams, keystrokes, eye movement or other biometric signal during teaching or assessment. For each one, the question is not whether the vendor markets it as an “emotion recognition” product, since few will use that phrase directly, but whether any feature infers an emotional or attentional state from that biometric input, however the marketing describes it. “Engagement scoring,” “confusion detection” and “attentiveness analytics” are functionally the thing the Act bans, whatever label sits on the product page.
Where such a feature exists, the next question is whether it can be disabled at the institution’s end, and whether the vendor can confirm in writing that it has been. Assuming a feature is dormant because nobody asked for it is not the same as verifying that it is switched off, and an institution using a system with a live emotion-inference feature in an EU education setting carries the compliance risk regardless of whether staff actively rely on the output. For a fuller picture of how this sits alongside the Act’s other education-specific obligations, including the literacy duty already in force and the high-risk regime landing over the next eighteen months, our EU AI Act education assessment is the place to start, and our look at how AI-writing detection has evolved through mid-2026 covers the adjacent detection landscape this ban does not reach.
The wider lesson sits comfortably alongside the rest of the Act’s approach to education: where the underlying technology cannot support the claim being made for it, the regulation has stopped treating that as a marketing problem and started treating it as a legal one.