SmarterArticles

There is a particular species of modern embarrassment that did not exist twenty years ago. You are standing in a kitchen you have cooked in a hundred times, and you cannot remember the phone number of the person you married. You are walking down a street two blocks from your flat, and without the soft blue dot pulsing on your phone, you are not entirely sure which way is north. You are mid-sentence in a meeting, reaching for a word that used to arrive unbidden, and instead you feel the tiny silent reflex of your thumb wanting to tap a text box and ask a machine to finish the thought for you.

None of these moments feels like decline. Each feels like efficiency. Each is, in isolation, trivial. And that is precisely the argument advanced by a framework circulated on arXiv in early 2026, which gives this drift a name: gradual cognitive externalisation. The authors describe the phenomenon as the incremental migration of navigational, mnemonic, and reasoning tasks from human minds to ambient artificial intelligence systems, not through any single dramatic capitulation but through thousands of small, convenient substitutions distributed across the waking hours of ordinary life.

The framing matters because the public debate about AI and cognition has been stuck, for the better part of three years, in a classroom. It has been a debate about students, about essays, about whether a sixteen-year-old who asks a chatbot to summarise a novel has learned anything. That is a real argument, and worth having. But it has obscured a larger and stranger one. The people whose cognitive habits are being rewritten most thoroughly are not children. They are adults, in the middle of their working lives, who have quietly accepted ambient AI into the most intimate operations of memory, orientation, judgement, and speech. They did not sign up for an experiment. They pressed a button that said yes.

The uncomfortable question the arXiv authors pose is not whether this process is happening. The evidence for that is now overwhelming, and it predates large language models by at least a decade. The question is at what point the cumulative offloading of cognitive tasks stops being a productivity gain and becomes a structural reduction in human capability. And the more disturbing sub-question, the one that makes the whole framework feel like a small, cold hand pressed against the back of the neck, is this: how would we even know if it had already happened?

The Long Shadow of the Hippocampus

To understand why the new framework is treated with seriousness rather than dismissed as neo-Luddite hand-wringing, it helps to go back to the only sustained, longitudinal body of research we have on what happens to a human brain when it stops doing a cognitive task. That work was done not on smartphone users but on London cab drivers, and it is now more than two decades old.

Eleanor Maguire and her colleagues at University College London began publishing structural MRI studies of licensed London taxi drivers in 2000. The drivers, famously, must pass a qualifying examination known as The Knowledge, a years-long feat of memorisation in which they learn the labyrinthine street grid of central London by heart. Maguire's team found that the posterior hippocampi of these drivers, the region of the brain most closely associated with spatial navigation, were measurably larger than those of matched controls, and that the degree of enlargement correlated with the number of years spent driving a cab. A follow-up comparing taxi drivers with London bus drivers, who follow fixed routes, found the effect was specific to navigational complexity rather than to driving itself.

The Maguire studies were celebrated because they offered one of the cleanest demonstrations of adult neuroplasticity in the scientific literature. What went less remarked at the time was the corollary. Structure follows use. If the brain can thicken in response to navigational demand, it can presumably thin in response to navigational neglect. In 2010, researchers at McGill University led by Véronique Bohbot presented work suggesting that reliance on turn-by-turn GPS navigation was associated with reduced activity in the hippocampus, and that habitual GPS users tended to rely on a stimulus-response strategy rather than the spatial-cognitive-map strategy that builds hippocampal grey matter. Subsequent studies, including work published in Nature Communications in 2017 by Hugo Spiers and colleagues, found that when participants followed satnav directions, activity in the hippocampus and prefrontal cortex was effectively suppressed. The brain regions that would normally be lit up by wayfinding simply went quiet.

None of this proves that GPS has caused a generation-wide shrinkage of the hippocampus. The longitudinal data required to make that claim cleanly does not yet exist. What it does establish, beyond reasonable dispute, is a mechanism. When a cognitive task is persistently offloaded to an external system, the neural circuitry that performed it receives less exercise, and receives it in more impoverished form. The brain, being a metabolically expensive organ, does not maintain capacity it is not asked to use. This is not controversial neuroscience. It is the baseline model of how the adult brain adapts to its environment.

What the arXiv authors argue, and what makes their framework distinctive, is that the GPS case is no longer an isolated example. It is a template that has been quietly replicated across every cognitive domain in which an ambient AI service offers a more convenient alternative to internal effort. Spatial memory was first because satnav was first. Semantic memory followed with Google. Prospective memory went to the calendar app. Now, with the arrival of always-on conversational models embedded in phones, glasses, earbuds, and the operating systems of cars and fridges, reasoning and language production are beginning to follow the same path.

Betsy Sparrow and the First Warning

The second piece of foundational evidence for the externalisation framework is a paper published in Science in 2011 by Betsy Sparrow, then at Columbia University, together with Jenny Liu and the late Daniel Wegner of Harvard. The paper was titled Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips, and it became the seed for what is now routinely called digital amnesia.

Across four experiments, Sparrow and her co-authors showed that when people expected they would be able to look information up later, they remembered the information itself less well, and instead remembered where to find it. The effect was robust and small and quietly unnerving. Participants were not choosing to forget. They were not being lazy. Their memory systems were making an unconscious economic calculation about what was worth storing, and the calculation was being influenced by the presence of a search engine in their pocket.

Wegner, who had spent the earlier part of his career developing the theory of transactive memory, the way couples and close colleagues offload knowledge onto one another so that each person holds only part of the shared pool, argued that what Sparrow was documenting was transactive memory extended to machines. The human brain had always outsourced memory to other brains. It was now outsourcing memory to silicon, and the silicon was a less reciprocal partner.

Not everyone accepted the transactive framing. Subsequent researchers pointed out that a search engine is not really a partner in the way a spouse is, because the information is not lost when the connection goes down, merely harder to retrieve. A 2024 meta-analysis published in the journal Memory reviewed the literature on the Google effect and concluded that the phenomenon was real but more modest than early coverage suggested, and heavily dependent on task type and the perceived availability of the external source.

The arXiv framework takes this sceptical literature seriously. Its authors are not claiming that every study of digital memory is an alarm bell. They are claiming something narrower and more consequential. They argue that the sceptical findings were generated in a world where the external source was a deliberate act of retrieval. You had to decide to type a query. You had to open a tab. You had to formulate a question. That small layer of friction, the authors write, was doing enormous cognitive work. It forced a moment of metacognitive reflection in which the mind registered that it was offloading, and in registering that, retained some awareness of what it still held internally.

Ambient AI dissolves that layer of friction. When the machine is listening continuously, when it completes your sentence before you have finished thinking it, when it books the restaurant before you have consciously decided to eat out, the deliberate act of retrieval disappears. There is no query. There is no tab. There is, increasingly, no question. And without the question, there is no metacognitive audit, no moment in which the mind takes stock of what it has and has not done for itself.

The Friction Tax, Abolished

To see what the loss of friction means in practice, consider how a typical professional now moves through a morning in 2026. The alarm sounds. The phone offers a summary of overnight emails, pre-triaged by urgency, with draft replies already composed for the simpler ones. Walking to the station, the earbuds read out a briefing stitched together from three news sources, reordered to match previously observed reading habits. On the train, a report that would once have required an hour of reading arrives as a three-hundred-word précis with the relevant passages highlighted. A meeting invitation pings in, and the calendar assistant has already checked availability, proposed a time, and drafted an acceptance.

At the office, a document needs writing. The cursor blinks in a blank field for perhaps two seconds before a ghostly grey completion offers the first sentence. It is a good sentence. It is, in fact, better than the sentence the writer would have produced on a tired Monday. The writer presses tab. The second sentence appears. By the end of the paragraph, the writer has written nothing and approved everything, and the document sounds exactly like them, because the model has been trained on two years of their prior output.

Lunch. A colleague mentions a book. The name of the author is on the tip of the tongue, and rather than dwell in the small, uncomfortable pause of trying to retrieve it, the reflex is immediate and invisible. The phone, listening through its always-on transcription, has already surfaced the name in a notification. The pause never happens. The retrieval circuitry never fires.

None of this is dystopian. Most of it is delightful. The professional in question is, by any conventional measure, more productive than their 2015 counterpart. They process more email, attend more meetings, produce more documents, remember more names, arrive at more correct destinations, and make fewer small logistical errors. On the productivity dashboards their employer monitors, the line goes up.

What the arXiv framework asks is what the dashboards are not measuring. The friction that has been abolished was not only an inconvenience. It was also the mechanism by which the brain exercised the faculties in question. The two-second pause before retrieving a name is where retrieval happens. The blank page is where sentence construction lives. The fumbled search for a route is where spatial reasoning gets its reps. Remove the pause, the blank page, the fumble, and you have removed the gym in which the relevant mental muscles were being worked. You have not made those muscles stronger. You have, in the most literal biomechanical sense available to a metaphor about cognition, made them weaker.

The Measurement Problem

The deepest difficulty the framework surfaces is that we have almost no good tools to measure what is happening. Productivity metrics, which are what employers and economists mostly track, will show the opposite of decline. A knowledge worker augmented by ambient AI produces more output per hour than the same worker unaided. This is true whether or not that worker's unaided capability is rising, steady, or falling. The metric cannot distinguish between a human who has become more skilled and a human who has become more dependent, because from the outside, the two look identical. Both ship more work.

Traditional cognitive assessment is not much better. The standardised tests that psychologists have used for decades to measure memory, reasoning, verbal fluency, and spatial ability were designed for a world in which the only thing in the testing room was the subject and the examiner. They are administered in conditions of deliberate cognitive isolation. The results they produce tell you what a person can do when they are forced to work without tools. That is a valid and important thing to know, but it is increasingly disconnected from how cognition actually operates in daily life.

The arXiv authors propose, as a partial remedy, a class of measures they call unaided baseline assessments, in which subjects are asked to perform everyday cognitive tasks without access to their usual ambient AI supports, and their performance is compared both to their own augmented performance and to age-matched historical baselines. Early pilot data from such assessments, conducted in late 2025 by research groups at several European universities and reported in preprint form, are suggestive rather than conclusive, but they point in a uncomfortable direction. On tasks like recalling the phone numbers of immediate family members, navigating between two familiar locations without map assistance, composing a short persuasive letter without autocomplete, and summarising the argument of a news article read the previous day, adults in their thirties and forties perform noticeably worse than equivalent cohorts tested in the early 2010s on comparable tasks.

It is important to be careful about what these findings do and do not show. They do not demonstrate that the underlying neural hardware has deteriorated. They show that the software, the practised habit of doing these tasks, has atrophied through disuse. In principle, the habit can be relearned. The capacity is dormant rather than destroyed. But the practical distinction is thin. A capacity you no longer know how to access, and no longer remember you once had, is functionally indistinguishable from a capacity you have lost.

There is a further measurement problem that the framework identifies, and it is the subtlest of all. Human beings are notoriously bad at noticing the absence of something they are not currently using. The researcher Daniel Kahneman described a related effect as the illusion of validity, the way that confidence in a judgement tracks the coherence of the available evidence rather than its completeness. When ambient AI fills in the gaps in memory, navigation, or language, the resulting experience is seamless and coherent. There is nothing in the subjective texture of the moment to alert the user that a gap has been filled. The user simply experiences the arrival of the word, the route, the fact. They do not experience the prior pause that would have been the site of internal effort, because the pause has been removed.

This is the mechanism by which a structural reduction in capability could have already occurred without anyone noticing. The subjective signal that would alert a person to their own decline, the experience of reaching for something and finding it not there, has been engineered out of daily life.

The Thresholds Question

If the framework is right that externalisation is ongoing, continuous, and largely invisible to the people undergoing it, the next question is the threshold one. At what point does cumulative offloading cross from useful augmentation into something more worrying? The arXiv authors sketch, tentatively, three candidate thresholds, and admit that none of them is fully satisfactory.

The first is the reversibility threshold. Offloading is benign, on this view, as long as the underlying capacity can be reactivated at reasonable cost when the external support is unavailable. A satnav user who can, with a few minutes of concentration, find their way home using landmarks has merely outsourced a task. A satnav user who is lost the moment the battery dies has lost a capacity. The trouble with reversibility as a threshold is that it is rarely tested. Most people never find out where they sit on the continuum until a crisis forces the test, and by then the answer is not the one they were hoping for.

The second is the transmission threshold. Cognitive skills, unlike physical ones, are largely transmitted through deliberate practice between generations. Parents teach children to remember phone numbers, to read maps, to write a coherent paragraph, by modelling these activities and by expecting the child to practise them. If a generation of parents no longer performs these activities themselves, either because they cannot or because they cannot be bothered, the modelling stops and the expectation erodes. The capacity then fails to transmit, not because any individual has lost it but because the intergenerational conveyor belt has stalled. By this criterion, the threshold may already have been crossed for spatial navigation in several high-income countries, where children raised since 2015 report almost no experience of unaided wayfinding.

The third is the dependency threshold, which is really a political and economic criterion rather than a cognitive one. A society whose daily functioning requires the continuous presence of ambient AI has ceded a form of autonomy that is difficult to recover. The point is not that the AI will necessarily fail, although the history of infrastructure suggests it eventually will. The point is that the option of doing without it has been structurally removed. When the option is gone, the capacity that would have exercised the option withers, and when the capacity has withered, the option cannot be restored by decree. You cannot legislate a population back into remembering how to navigate.

Each of these thresholds is contested. Each is difficult to measure. Each is, the arXiv authors concede, probably insufficient on its own. What they argue collectively, though, is that the absence of a clean threshold should not be mistaken for the absence of a problem. The thresholds are fuzzy because the process is gradual. That is the point. Gradual externalisation is not the kind of phenomenon that delivers a warning alarm. It is the kind that is only visible in retrospect, when some event, a blackout, a generational transition, a crisis of some other kind, forces an unaided comparison and the comparison returns a number that nobody expected.

What the Debate Has Missed

The arXiv framework is useful not because it introduces a wholly new concept. Cognitive offloading has been discussed in cognitive psychology since at least the 1990s, and the distributed cognition literature goes back to Edwin Hutchins's work on ship navigation in the 1980s. The framework is useful because it repositions a conversation that had become narrow and moralistic.

The narrow version of the conversation, the one dominating opinion pages and education conferences since 2023, is about whether AI is making students worse at learning. That version has a clear protagonist, the student, a clear antagonist, the chatbot, and a clear institutional setting, the school. It is relatively easy to have opinions about, and relatively easy to legislate around. Several jurisdictions have introduced AI-use policies in secondary and tertiary education. These are reasonable measures and they are not what the arXiv authors are talking about.

The wider version, the one the framework tries to open up, has no clear protagonist because the protagonist is everyone who owns a smartphone. It has no clear antagonist because the ambient AI is not an invader but a series of features that users opted into one at a time over fifteen years. And it has no clear institutional setting, because the offloading happens in kitchens, on pavements, in cars, in bed, in the bath. There is no regulator whose remit covers the hippocampus of a middle-aged accountant walking to the tube.

This is why the framework's authors are careful to describe externalisation as structural rather than individual. The instinct when faced with a story about declining capacity is to reach for a personal remedy, to suggest that people should simply use AI less, exercise their memories more, put the phone down during dinner. These suggestions are not wrong, but they misunderstand the nature of the problem. The defaults have been changed. The environment in which cognition happens has been retuned. Asking an individual to opt out of ambient AI in 2026 is like asking them, in 1996, to opt out of refrigeration. It is possible in principle. It would also reorganise their life around the absence.

A structural problem requires a structural response. The framework does not pretend to know what that response should look like, but it sketches several possibilities that are worth taking seriously. One is the preservation of deliberate friction in ambient AI interfaces, an idea sometimes called cognitive scaffolding, in which the system is designed not to produce the answer instantly but to prompt the user through the steps of producing it themselves, surrendering speed in exchange for retained capacity. Several research groups have been prototyping such interfaces, and some early work suggests users find them irritating at first and valuable over longer horizons, in much the way that resistance training is irritating and valuable.

Another is the notion of periodic unaided audits, whether individual or population-level, in which users are encouraged or required to perform cognitive tasks without AI support at regular intervals, as a way of maintaining both the capacity and the awareness of the capacity. This is the cognitive equivalent of a fire drill. It would feel silly. It might also be the only way to preserve the subjective signal that the framework identifies as having been engineered out.

A third is regulatory, and here the framework is tentative. It notes that the competition between ambient AI providers is currently structured to maximise engagement and perceived usefulness, which translates directly into maximising the offloading of cognitive tasks. A provider that offered a more frictional, less absorbing experience would lose to one that offered a more seamless one, because the user in the moment always prefers the seamless option. This is a collective action problem of a familiar kind, and collective action problems are what regulators exist to solve. What a regulation aimed at cognitive sustainability would actually look like is not yet clear, and the framework declines to pretend otherwise.

The Asymmetry That Matters

Underneath all of this sits an asymmetry that the arXiv authors return to repeatedly, and which is worth stating plainly. Acquiring a cognitive capacity is slow, effortful, and requires the accumulation of many small, often frustrating experiences over years. Losing a cognitive capacity is fast, painless, and requires only the consistent availability of a more convenient alternative.

This asymmetry is not new. It is true of physical skills, of languages learned and not spoken, of instruments taken up and put down. What is new is the scale and ambient continuity of the alternative. A person who learned French in school and stopped speaking it at twenty-five will, at forty-five, still recognise the language, still be able to read a menu, still remember the shape of the grammar even if the vocabulary has gone fuzzy. The decay is partial and graceful. A person whose navigational practice has been continuously supplanted by turn-by-turn directions for the entirety of their adult life may have no equivalent residual competence. They did not stop navigating at twenty-five. They stopped at seventeen, and the replacement was so smooth that they never noticed the cessation.

The same asymmetry applies, the framework argues, to the capacities now being externalised by large language models: composition, summarisation, argument construction, the patient search for the right word. These are not capacities acquired in a single course at a single age. They are built across decades, through millions of small private acts of thinking-in-language. If those acts are now being performed, continuously and invisibly, by a system that finishes sentences before the thinker has started them, the accretion stops. Not dramatically. Not all at once. Just incrementally, quietly, in the way all the other externalisations have happened, until someone tries one day to write a paragraph without help and discovers that the paragraph does not come.

How Would We Know?

The question the framework leaves open, and which it treats as the most important question of all, is whether there is any reliable way to detect that the threshold has been crossed. The honest answer, and the one the authors give, is that there probably is not, at least not using the tools currently in widespread use.

Productivity will keep rising, because ambient AI is a productivity technology and productivity is what it measures. Subjective experience will remain seamless, because seamlessness is the design goal. Aggregate cognitive test scores may drift, but they are noisy enough at the population level that a drift of a few points over a decade can be explained in any number of ways, and will be. The individual signal, the experience of reaching for something and finding it not there, has been engineered out by the very technology whose effects it would be measuring.

What might work, the authors suggest, is something closer to longitudinal auto-ethnography at scale. Ask large, stable panels of users to report, in their own words, what they did today without AI assistance, what they noticed themselves unable to do, what they felt the shape of their own thinking to be. Do this for years. Build the time series. Watch, not for sudden declines, but for the slow disappearance of entire categories of experience, the way people in 2015 could describe the feeling of being lost in an unfamiliar city and people in 2025 increasingly cannot, because they no longer have the referent.

This is a modest proposal, and it will not settle the question on its own. But it at least acknowledges the nature of the problem. The thing the framework is trying to detect is not a drop in a number. It is the absence of an experience, the quiet dropping-out of a whole category of inner effort from the background of daily life, and the only instruments sensitive enough to register such an absence are the humans who once had the experience and may or may not still remember that they did.

What the arXiv framework ultimately offers is not an alarm and not a prediction but a frame. It asks us to treat the gradual externalisation of cognition as a legitimate topic of serious inquiry, rather than as either a technophobic panic or an inevitable feature of progress to be waved through. It asks us to notice that the debate about AI and critical thinking has been happening in the wrong rooms, focused on the wrong people, measuring the wrong things. It asks, most importantly, whether the convenience we have accepted, one small substitution at a time, is of a kind that can be reversed if we change our minds, or of a kind that changes our minds in ways we cannot reverse.

The answer to that question may already exist, inside the heads of several billion people who have spent the last fifteen years quietly letting their machines do the remembering. If it does, we do not yet have the instruments to read it. And one of the things we have externalised, perhaps, is the instinct to build those instruments in the first place.

---

References and Sources

1. Maguire, E. A., Gadian, D. G., Johnsrude, I. S., Good, C. D., Ashburner, J., Frackowiak, R. S. J., and Frith, C. D. (2000). Navigation-related structural change in the hippocampi of taxi drivers. Proceedings of the National Academy of Sciences, 97(8), 4398 to 4403. https://www.pnas.org/doi/10.1073/pnas.070039597
2. Maguire, E. A., Woollett, K., and Spiers, H. J. (2006). London taxi drivers and bus drivers: a structural MRI and neuropsychological analysis. Hippocampus, 16(12), 1091 to 1101. https://pubmed.ncbi.nlm.nih.gov/17024677/
3. Woollett, K., and Maguire, E. A. (2011). Acquiring the Knowledge of London's layout drives structural brain changes. Current Biology, 21(24), 2109 to 2114.
4. Sparrow, B., Liu, J., and Wegner, D. M. (2011). Google effects on memory: cognitive consequences of having information at our fingertips. Science, 333(6043), 776 to 778. https://www.science.org/doi/10.1126/science.1207745
5. Wegner, D. M. (1987). Transactive memory: a contemporary analysis of the group mind. In B. Mullen and G. R. Goethals (Eds.), Theories of Group Behavior. Springer-Verlag.
6. Javadi, A. H., Emo, B., Howard, L. R., Zisch, F. E., Yu, Y., Knight, R., Pinelo Silva, J., and Spiers, H. J. (2017). Hippocampal and prefrontal processing of network topology to simulate the future. Nature Communications, 8, 14652.
7. Dahmani, L., and Bohbot, V. D. (2020). Habitual use of GPS negatively impacts spatial memory during self-guided navigation. Scientific Reports, 10, 6310.
8. Hutchins, E. (1995). Cognition in the Wild. MIT Press.
9. Risko, E. F., and Gilbert, S. J. (2016). Cognitive offloading. Trends in Cognitive Sciences, 20(9), 676 to 688.
10. Kahneman, D. (2011). Thinking, Fast and Slow. Farrar, Straus and Giroux.
11. Singh, A., et al. (2025). Protecting Human Cognition in the Age of AI. arXiv preprint 2502.12447. https://arxiv.org/abs/2502.12447
12. Cognitive Agency Surrender: Defending Epistemic Sovereignty via Scaffolded AI Friction (2026). arXiv preprint 2603.21735. https://arxiv.org/abs/2603.21735
13. The Cognitive Divergence: AI Context Windows, Human Attention Decline, and the Delegation Feedback Loop (2026). arXiv preprint 2603.26707. https://arxiv.org/html/2603.26707
14. Gerlich, M. (2025). AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking. Societies, 15(1), 6. https://www.mdpi.com/2075-4698/15/1/6
15. Storm, B. C., and Stone, S. M. (2024). Google effects on memory: a meta-analytical review of the media effects of intensive Internet search behavior. https://pmc.ncbi.nlm.nih.gov/articles/PMC10830778/
16. Grinschgl, S., and Neubauer, A. C. (2022). Supporting cognition with modern technology: distributed cognition today and in an AI-enhanced future. Frontiers in Artificial Intelligence. https://pmc.ncbi.nlm.nih.gov/articles/PMC9329671/
17. Salomon, G. (Ed.) (1993). Distributed Cognitions: Psychological and Educational Considerations. Cambridge University Press.
18. Carr, N. (2010). The Shallows: What the Internet Is Doing to Our Brains. W. W. Norton.
19. Spiers, H. J., and Maguire, E. A. (2006). Thoughts, behaviour, and brain dynamics during navigation in the real world. NeuroImage, 31(4), 1826 to 1840.
20. Medical Xpress (2010). Study suggests reliance on GPS may reduce hippocampus function as we age. https://medicalxpress.com/news/2010-11-reliance-gps-hippocampus-function-age.html

---

Tim Green UK-based Systems Theorist & Independent Technology Writer

Tim explores the intersections of artificial intelligence, decentralised cognition, and posthuman ethics. His work, published at smarterarticles.co.uk, challenges dominant narratives of technological progress while proposing interdisciplinary frameworks for collective intelligence and digital stewardship.

His writing has been featured on Ground News and shared by independent researchers across both academic and technological communities.

ORCID: 0009-0002-0156-9795 Email: tim@smarterarticles.co.uk

Discuss...

On 6 April 2026, OpenAI dropped a thirteen-page document into the middle of an already feverish policy conversation and called it a starting point. Its title, “Industrial Policy for the Intelligence Age: Ideas to keep people first,” carried the hush of something self-consciously historic. Sam Altman, the company's chief executive, took to the airwaves and to his preferred medium of long, declarative blog posts to argue that the moment now demanded a new social contract on the scale of the Progressive Era and the New Deal. The proposals inside were the kind of ideas that, only a few years ago, would have made any Silicon Valley boardroom shudder. Robot taxes. A nationally managed public wealth fund seeded in part by AI companies themselves. Auto-triggering safety nets that activate when displacement metrics cross preset thresholds. A four-day work week financed by efficiency dividends. A reorientation of the federal tax base away from payroll and toward capital gains and corporate income, on the grounds that AI will hollow out the wages that fund Social Security.

It is, on its face, an extraordinary set of admissions. The company that has done more than any other to accelerate the present wave of labour disruption is now publicly conceding that the disruption is real, that it is large, that it cannot be left to the market to absorb, and that the welfare state as currently constituted will not survive the next decade without significant intervention. Coming from a firm valued at multiples that depend on continuing to deploy precisely the systems causing the disruption, the document reads less like a policy white paper and more like a confession with a list of conditions attached.

The Axios newsletter that broke the story gave it a fitting name. Behind the curtain, this was Sam's superintelligence New Deal. The framing matters. Franklin Roosevelt's New Deal was negotiated by an elected president and a Congress responding to a Great Depression that no private actor had volunteered to fix. The terms were set by the public, through its representatives, and imposed upon capital. Altman's New Deal arrives in a different order. Capital is at the table first. The terms are being drafted by the entity with the most to gain from a particular shape of settlement. The public, in this telling, is invited to refine, challenge, or choose among the proposals through what OpenAI describes as the democratic process.

Which raises the question that the document itself cannot answer. When the company engineering the disruption is also authoring the response, is the social contract that emerges meaningfully different from one negotiated by the public it affects? And if it is different, in what direction does the difference run?

The Document Itself

The blueprint sets out three stated goals. Distributing the prosperity of AI-driven growth broadly. Mitigating the risks associated with superintelligence. Democratising access to AI systems and to the broader AI economy. Each is the kind of phrase that has appeared in industry governance literature since ChatGPT's launch in November 2022, and each has the soft, familiar texture of a press release that has been workshopped through several rounds of communications review.

The mechanisms proposed underneath are sharper. The public wealth fund would give every American citizen a direct stake in AI-driven economic growth through a nationally managed vehicle that could invest in diversified, long-term assets capturing growth in both AI companies and the broader set of firms adopting and deploying AI. Seed capital would come, in part, from AI companies themselves. The automation taxes are described as taxes related to automated labour, with the explicit acknowledgement that the existing payroll-based revenue base cannot survive a transition to capital-intensive production. The auto-triggering safety net would scale unemployment benefits, wage insurance, and cash assistance upward as displacement indicators worsen, then phase the supports out as conditions stabilise. The four-day work week is presented not as a mandate but as a framework for employers and unions to use efficiency dividends to compress hours without compressing pay.

There are also sections on cyber and biological risks, which Altman has cited as the two most immediate threats from advanced systems, and on the need for a national industrial strategy to keep frontier model development inside the United States. These sit slightly oddly next to the labour and welfare proposals, although they share a common architecture. They are framed as urgent, as inevitable, and as requiring significant public investment in a direction that happens to align with OpenAI's commercial interests.

That alignment is not necessarily a mark against the substance of any individual proposal. A public wealth fund is a serious idea with a long intellectual history, from Norway's sovereign wealth model to the Alaska Permanent Fund to the academic work of economists like Anthony Atkinson. A four-day work week has been trialled in the United Kingdom, Iceland, and Spain with broadly positive results on productivity and worker wellbeing. Robot taxes have been debated since Bill Gates floated the idea in a 2017 interview with Quartz. Auto-triggering fiscal supports were a central feature of pandemic-era proposals from economists across the political spectrum. None of this is invented from nothing, and the document is careful to nod toward the lineage.

What is new is the source. These ideas, when they have appeared in the policy literature before, have come from think tanks, academics, trade unions, and the political left. They have not, as a rule, come from the firms whose business models would be most directly taxed by them. The sight of OpenAI publishing a blueprint that asks for higher capital gains taxes on people like Altman himself is genuinely unusual. Fortune drew the obvious comparison to JPMorgan Chase chief executive Jamie Dimon, who has periodically called for higher taxes on the wealthy as part of a broader argument about social stability. The intellectual honesty in both cases is real. So is the strategic logic.

The Strategic Logic of Pre-emptive Reform

There is a long tradition in political economy of capital-intensive industries authoring the rules that govern them. Standard Oil did it with the Interstate Commerce Commission. The major broadcasters did it with the Federal Communications Commission. Wall Street did it with vast tracts of the Dodd-Frank legislation. The pattern is well documented in the regulatory capture literature, most influentially by the late economist George Stigler in the 1970s, and the rationale is straightforward. When disruption is coming for an industry, or when the industry is causing disruption that threatens to provoke a public backlash, it is far better to be inside the room where the response is being drafted than to be the subject of someone else's draft.

OpenAI's blueprint fits this pattern with unusual precision. The labour disruption that Altman is now publicly acknowledging is not a hypothetical. It is already showing up in entry-level white-collar hiring data, in the contraction of contract translation work, in the restructuring of customer service operations, in the visible distress of junior coders and graphic designers and copywriters whose work has been automated faster than the labour market can absorb the displacement. By 2026 the political pressure for some form of response was already building. Unions had begun organising around AI displacement clauses in collective agreements. State legislatures had introduced bills targeting automated decision systems in hiring, lending, and benefits adjudication. The European Union had passed and then partially walked back, through the Digital Omnibus, several sections of the AI Act under industry pressure. The political ground was moving, and the question for any frontier AI lab was no longer whether there would be a regulatory response but what shape it would take.

In that context, getting in front of the conversation with a comprehensive blueprint is exactly what a sophisticated political operator would do. The document does several things at once. It signals seriousness, which inoculates against accusations of indifference. It frames the problem in terms that the company can live with, particularly the assumption that the underlying technology will continue to be developed and deployed at the current pace by the current players. It offers concessions on tax and welfare that are real but bounded, and that can be negotiated downward as the legislative process unfolds. It positions Altman personally as a statesman rather than a technologist, which has been a consistent feature of his public posture since the Senate testimony of May 2023. And it shifts the burden of proof onto critics who must now explain why the company's preferred solutions are insufficient, rather than arguing from scratch about whether any solutions are needed at all.

The critics noticed. Within hours of the blueprint's release, several prominent voices in AI policy were arguing that the document was a sophisticated exercise in what one called regulatory nihilism. The phrase, picked up by Fortune in its coverage, captures a particular concern. By proposing a vast and ambitious package of reforms that would require years of political work to enact, OpenAI was effectively pushing the response off into the indefinite future while continuing to deploy systems whose effects would compound in the meantime. The blueprint's own language about being a starting point for discussion was, in this reading, a way of ensuring that the discussion never quite reached a conclusion.

There is a more charitable interpretation, and it deserves to be taken seriously. Altman and his colleagues may genuinely believe that the labour transition ahead is severe enough to require something like the New Deal, and that the political system as currently constituted is unlikely to produce such a response without significant prompting from the companies closest to the technology. On this reading, the blueprint is an attempt to use the company's platform and credibility to move a conversation that would otherwise drift. That this also happens to align with OpenAI's commercial interests is a feature, not a bug, because the alignment is what makes the proposal credible to other actors in the room. A blueprint authored by a hostile party could be dismissed. A blueprint authored by the company being asked to pay the new taxes is harder to ignore.

Both interpretations can be true at the same time. The history of progressive reform is full of cases where commercial self-interest and public interest converged on the same policy, and where the resulting legislation was better than either could have produced alone. The New Deal itself was negotiated with significant input from sympathetic capitalists who saw stabilisation as essential to their long-term interests. The question is not whether private interest is involved in public policy, because it always is, but whether the structure of the conversation allows other interests to enter on equal terms.

Who Is Not in the Room

This is where the analogy to the historical New Deal begins to strain. Roosevelt's coalition was assembled from organised labour, urban political machines, agrarian populists, civil rights activists, social workers, and reform-minded intellectuals as well as sympathetic business figures. The Wagner Act, which guaranteed the right to organise, was fought through Congress over the explicit objections of most of American industry. The Social Security Act was drafted by a committee that included the labour secretary Frances Perkins, the first woman to hold a cabinet position, and her staff of social insurance experts, many of whom had spent their careers studying European welfare systems. The terms were set by the public side of the negotiation and the private side accepted them because the alternative, in the depths of the Depression, was worse.

The OpenAI blueprint enters a very different room. There is no equivalent labour movement at the table, because the workers most affected by AI displacement are scattered across freelance markets and white-collar professions that have historically been weakly organised. There is no equivalent agrarian populism, although there are stirrings of an anti-AI politics in rural and small-town America driven by data centre siting disputes and energy costs. There is no Frances Perkins, no figure inside the federal government with both the expertise and the political authority to draft an alternative blueprint from the public side. The Biden-era executive order on AI was rescinded in January 2025. The current administration's approach has been characterised by a mix of industrial policy support for domestic frontier labs and a general scepticism of regulation. State-level initiatives like California's SB 53 have faced what critics have described as intimidation campaigns from industry, including, by some accounts, from OpenAI itself.

Into that vacuum, the blueprint arrives with the structural advantage of being the only fully developed document in the room. Other actors will respond, and the response will shape the eventual outcome, but they will be responding to a frame that OpenAI has already set. The choice of which proposals to discuss, which mechanisms to specify, which thresholds to use for the auto-triggering safety net, which assets to include in the public wealth fund, all of these have been pre-decided in ways that will be very difficult to undo as the conversation moves forward. This is the agenda-setting power that political scientists have studied for decades, and it is one of the most consequential forms of influence in any policy debate. The party that writes the first draft almost always wins more than the party that responds to it.

The democratic process to which OpenAI defers is not, in this context, a neutral arbiter. It is a political system in which lobbying spending by AI firms has roughly tripled since 2023, in which several former OpenAI employees now hold senior positions at the National Institute of Standards and Technology and the AI Safety Institute, in which the trade press is heavily dependent on access to frontier labs for the scoops that drive its business model, and in which the public's attention is fragmented across a hundred competing crises. In such a system, the actor with the most resources, the clearest message, and the earliest draft will tend to win, regardless of the merits of the underlying proposals. The blueprint's appeal to democratic deliberation is sincere in tone and structurally favourable to its author in effect.

The Substance of the Proposals

It is worth pausing on the proposals themselves, because the tendency to focus on the politics of who is speaking can obscure the question of whether what is being said is any good. Taken individually, the elements of the blueprint range from reasonable to genuinely impressive.

The public wealth fund is the most interesting. The Norwegian Government Pension Fund Global, often cited as the model, was built from oil revenues and now owns roughly 1.5 per cent of every listed company in the world, generating dividends that fund a significant portion of Norwegian public spending. The Alaska Permanent Fund pays an annual dividend to every Alaskan resident from the state's oil and mineral revenues. Both have endured across multiple political cycles and across changes of government. A US version seeded by AI companies would face significant constitutional and structural questions about taxing authority, about how the fund's investments would be governed, about whether the dividends would be paid as cash or held in trust, and about how the fund would avoid becoming a vehicle for political patronage. None of these questions is unanswerable, and the existence of working models elsewhere demonstrates that the basic concept is feasible. The blueprint is vague on the specifics, which is both a weakness and a strength. The vagueness leaves room for negotiation, and it also leaves room for the proposal to be hollowed out in implementation.

The automation tax is more contested. Economists are divided on whether taxing capital substitution for labour is an efficient way to fund welfare or whether it distorts investment in counterproductive ways. A 2017 analysis by the European Parliament's legal affairs committee proposed and then dropped a robot tax after concluding that it would be administratively complex and economically uncertain. The South Korean government has effectively implemented a soft version by reducing tax incentives for automation investment. The blueprint's framing in terms of taxes related to automated labour is loose enough to encompass several possible designs, from a direct levy on revenue produced by automated systems to a broader shift in the tax base toward capital gains. The latter is the more economically defensible approach and the one that several mainstream economists, including the late Atkinson and the more recent work of Daron Acemoglu and Pascual Restrepo at MIT, have argued for in the context of AI displacement.

The auto-triggering safety net is the proposal closest to existing welfare state design. Several countries already have automatic stabilisers that scale unemployment benefits with macroeconomic conditions. The novelty in the blueprint is the proposal to use AI displacement metrics, rather than general unemployment, as the trigger. This raises a thorny measurement problem. There is no agreed-upon way to attribute job losses to AI specifically, as opposed to broader economic conditions, offshoring, demographic change, or business cycle effects. The Bureau of Labor Statistics has been working on improved measures, and academic work by economists at the Brookings Institution and the International Labour Organization has proposed several methodologies, but none is yet robust enough to serve as a legal trigger for benefit increases. The blueprint glosses over this difficulty.

The four-day work week is the most popular proposal in opinion polling and the most difficult to implement in practice. The 4 Day Week Global trials run in the United Kingdom in 2022 and 2023 reported productivity gains and worker satisfaction improvements, and similar pilots in Iceland from 2015 to 2019 produced comparable results. The challenge is that compressing hours without compressing pay requires either productivity gains large enough to absorb the cost or employer willingness to accept lower margins. The blueprint's framing in terms of efficiency dividends is a bet that AI productivity gains will be large enough to make the math work. Whether they are, and whether the gains will be shared with workers rather than captured by capital, is precisely the question that the rest of the blueprint is trying to address. There is a circularity here that the document does not quite acknowledge.

Taken together, the substance is serious. A version of this blueprint produced by a left-leaning think tank would be celebrated as a comprehensive progressive vision. The fact that it is being produced by OpenAI does not make the substance worse. It does, however, change what the substance means.

The Meaning of a Privately Authored Social Contract

A social contract, in the tradition that runs from Hobbes through Locke and Rousseau to John Rawls, is not primarily a set of policies. It is a story about legitimacy. It explains why the people governed by a particular set of institutions accept those institutions as binding upon them. The classical answer is that they accept the institutions because they would have agreed to them under fair conditions of deliberation, behind what Rawls called the veil of ignorance, where no one knew in advance which position they would occupy in the resulting society. The legitimacy of the contract depends on the fairness of the process by which it was negotiated.

A blueprint authored by a private company and offered for public ratification is a different kind of object. It may contain perfectly sensible policies. It may even be more progressive than what the political system would produce on its own. But it cannot, by its nature, satisfy the legitimacy criterion that the social contract tradition requires, because the process by which it was produced was not one of fair deliberation among equals. It was one in which a single actor, with enormous resources and a direct stake in the outcome, sat down and wrote what it thought the response should be, and then invited everyone else to react.

This matters even if the resulting policies are good. The legitimacy of welfare state institutions in the twentieth century rested in significant part on the fact that they were won through political struggle by the people who would benefit from them. The Wagner Act was legitimate because workers fought for it. The National Health Service in the United Kingdom was legitimate because it was the product of a Labour government elected on a manifesto that promised it. Social Security was legitimate because it was passed by a Congress responding to mass unemployment and political mobilisation. When the beneficiaries are the authors, the institutions feel like theirs. When they are the recipients of someone else's plan, even a generous one, the relationship is different. It is closer to charity than to right.

There is also a more practical concern. A social contract written by a private company can be revised by that company at will. It is not embedded in democratic institutions in a way that constrains future behaviour. If OpenAI's commercial interests change, or if the political climate shifts, the blueprint can be quietly walked back, the proposed taxes can be diluted, the safety nets can be conditioned on requirements that the company finds acceptable. The history of corporate social responsibility commitments is full of such revisions. The Business Roundtable's 2019 statement on the purpose of the corporation, which committed signatory chief executives to consider stakeholders beyond shareholders, has been studied extensively in the years since, and a 2022 paper by law professors Lucian Bebchuk and Roberto Tallarita at Harvard found little evidence that the signatories had actually changed their behaviour. Voluntary commitments from powerful actors tend to remain voluntary in practice, even when they are framed as binding in principle.

The OpenAI blueprint is not, formally speaking, a commitment at all. It is a set of recommendations addressed to policymakers. But the framing is such that the company gets credit for the proposals regardless of whether they are enacted. If they are enacted, OpenAI can claim authorship. If they are not enacted, OpenAI can claim that it tried, and that the failure lies with the political system. Either way, the company has shifted the moral terrain in its favour without taking on any actual obligation. The asymmetry is structural and difficult to reverse.

What a Public-Side Response Would Look Like

It is easy to criticise the blueprint and harder to say what a more legitimate process would produce. But the outlines are not impossible to sketch. A public-side response would begin with the question of who should be at the table and would expand the conversation accordingly. It would include trade unions, particularly the new generation of unions organising in tech, retail, and platform-mediated work. It would include civil society organisations that have been working on welfare state reform for decades. It would include academic economists across the ideological spectrum, not just those whose work is congenial to the AI industry. It would include representatives of the workers whose labour is being displaced, in forums designed to give them meaningful voice rather than ceremonial input. It would include international perspectives, given that the labour disruption is global and the policy responses in Europe and Asia are already further developed than in the United States.

It would also start from a different question. Rather than asking how to manage the transition that the AI companies are creating, it would ask what kind of transition the public actually wants, and at what pace, and with what safeguards. The answers might converge on some of the same proposals that the OpenAI blueprint contains. Or they might not. They might include more restrictive measures, such as mandatory disclosure of AI use in employment decisions, or moratoria on the deployment of certain systems in sensitive sectors, or stronger collective bargaining rights for workers in AI-exposed industries. They might include proposals that the blueprint does not contain, such as public ownership of frontier model training infrastructure, or mandatory licensing of foundation models on terms set by public authorities, or international treaties on the labour effects of AI deployment.

The point is not that any particular alternative is necessarily better. The point is that the deliberative process matters, and that a process in which the affected parties have genuine power to shape the outcome produces different results than one in which they are presented with a finished document and asked to react. Democratic legitimacy is not a property of policies. It is a property of the process by which policies are made.

The OpenAI blueprint, for all its sophistication and all its substantive merits, is the product of a process that does not meet that standard. It is closer to a corporate prospectus than to a constitutional moment. The use of New Deal language is not accidental. It is an attempt to borrow the legitimacy of a historical settlement that was won by very different means, and to apply it to a present settlement that is being authored on very different terms.

The Asymmetry That Will Not Resolve Itself

None of this is to say that OpenAI should not have published the blueprint, or that Altman is wrong to argue for the proposals it contains, or that the substance is not worth taking seriously. The document is a meaningful contribution to a conversation that needed to happen, and the company deserves some credit for being willing to put taxation of itself on the agenda. The criticism is not about intent. It is about structure.

The structural problem is that the actors who have the most information about what AI systems can do, the most capacity to model their effects, and the most resources to shape the policy response are the same actors whose commercial success depends on a particular shape of that response. There is no way to remove this conflict of interest without either nationalising the industry, which is not on the political horizon in any major economy, or building public capacity to match the private capacity, which would require sustained investment in regulatory expertise, academic research, and civil society infrastructure of a kind that has not been seen in the United States since the 1970s. Neither option is immediately available, which means that the conversation will continue to be shaped, for the foreseeable future, by documents like the OpenAI blueprint.

What can be done in the meantime is to be honest about what is happening. The blueprint is not a neutral contribution to a deliberative process. It is a strategic intervention by a powerful actor with a direct stake in the outcome. Treating it with the seriousness its substance deserves does not require pretending that the politics are anything other than what they are. A social contract negotiated by a private company is meaningfully different from one negotiated by the public it affects, not because the private actor is necessarily acting in bad faith, but because the conditions of fair deliberation are not met when one party writes the first draft and the others are asked to react.

The question, then, is not whether to engage with the blueprint. It is whether to engage with it as a final document or as a provocation. Treated as a final document, it threatens to lock in a particular framing of the AI labour transition that will be very difficult to revise later. Treated as a provocation, it could be the starting point for a much broader conversation in which the affected parties get a real seat at the table and the policies that emerge carry the legitimacy that comes from genuine democratic authorship. Which of these two things it becomes will depend less on the content of the blueprint itself than on whether other actors have the capacity and the will to mount a serious response.

So far, the signs are mixed. Trade unions have begun to organise around AI displacement, but they are starting from a weak position in the white-collar sectors most affected. Academic economists are producing important work, but it is fragmented and underfunded relative to industry-sponsored research. State legislatures are experimenting, but they are vulnerable to pre-emption by federal law. Civil society organisations are engaged, but their resources are tiny compared to the lobbying capacity of the major AI firms. The European Union has the regulatory capacity, but the Digital Omnibus has shown that even that capacity can be rolled back under sufficient industry pressure.

The blueprint, in this context, looks less like a New Deal and more like a new equilibrium. It is the moment at which the AI industry, having produced a labour disruption that it could not deny, moved to author the terms of the response. Whether that response becomes a genuine social contract or a managed concession will depend on whether the rest of the political system can rouse itself to insist on something more. The democratic process to which OpenAI defers is the only mechanism that can produce a different outcome, and it is precisely the mechanism that has been weakened by decades of corporate consolidation, declining union membership, regulatory capture, and the fragmentation of public attention. The blueprint is an artefact of that weakness as much as it is a response to the technology it describes.

History will record what happens next. The current moment may be remembered as the beginning of a new social settlement, comparable in scale to the one Altman invokes. Or it may be remembered as the moment when the language of the New Deal was borrowed by the very actors that the original New Deal was designed to constrain, and used to legitimate a settlement that the public had no real hand in writing. The difference between these two outcomes is not a matter of policy substance. It is a matter of who is in the room, who holds the pen, and whether the process by which the contract is negotiated is one that the people governed by it can recognise as their own.

For now, the pen is in Altman's hand. The room is the one that OpenAI has built. And the contract on the table is the one the company has written. The democratic process is being invited to refine, challenge, or choose among the options provided. Whether it will do anything more than that is the question that the next several years will answer.

---

References & Sources

1. Altman, S. and OpenAI. “Industrial Policy for the Intelligence Age: Ideas to Keep People First.” OpenAI, 6 April 2026. https://openai.com/index/industrial-policy-for-the-intelligence-age/
2. OpenAI. “Industrial Policy for the Intelligence Age” (full PDF). https://cdn.openai.com/pdf/561e7512-253e-424b-9734-ef4098440601/Industrial%20Policy%20for%20the%20Intelligence%20Age.pdf
3. Allen, M. “Behind the Curtain: Sam's Superintelligence New Deal.” Axios, 6 April 2026. https://www.axios.com/2026/04/06/behind-the-curtain-sams-superintelligence-new-deal
4. The Hill. “OpenAI's Sam Altman Releases Blueprint for Taxing, Regulating Artificial Intelligence.” 6 April 2026. https://thehill.com/policy/technology/5817906-openai-ai-policy-recommendations/
5. TechCrunch. “OpenAI's Vision for the AI Economy: Public Wealth Funds, Robot Taxes, and a Four-Day Workweek.” 6 April 2026. https://techcrunch.com/2026/04/06/openais-vision-for-the-ai-economy-public-wealth-funds-robot-taxes-and-a-four-day-work-week/
6. Fortune. “Sam Altman Says AI Superintelligence Is So Big That We Need a 'New Deal.' Critics Say OpenAI's Policy Ideas Are a Cover for 'Regulatory Nihilism.'” 6 April 2026. https://fortune.com/2026/04/06/sam-altman-says-ai-superintelligence-is-so-big-that-we-need-a-new-deal-critics-say-openais-policy-ideas-are-a-cover-for-regulatory-nihilism/
7. Fortune. “Sam Altman's Big Pitch to Fix the Big AI Mess Sounds Like Jamie Dimon's.” 6 April 2026. https://fortune.com/2026/04/06/sam-altmans-capital-gains-taxes-4-day-workweek/
8. Newsweek. “Sam Altman Proposes Robot Tax as American Economy Transforms.” 6 April 2026. https://www.newsweek.com/sam-altman-proposes-robot-tax-as-american-economy-transforms-11788200
9. Decrypt. “OpenAI Calls for Global Shift in Taxation, Labor Policy as AI Takes Over.” 6 April 2026. https://decrypt.co/363431/openai-global-shift-labor-taxation-ai-sam-altman
10. The Next Web. “OpenAI Calls for Robot Taxes, a Public Wealth Fund, and a Four-Day Week.” 6 April 2026. https://thenextweb.com/news/openai-robot-taxes-wealth-fund-superintelligence-policy
11. The Tech Portal. “OpenAI Proposes AI Driven Economic Change Including Robot Taxes, Public Wealth Funds and a Four Day Work Week.” 6 April 2026. https://thetechportal.com/2026/04/06/openai-proposes-ai-driven-economic-change-including-robot-taxes-public-wealth-funds-and-a-four-day-work-week
12. eMarketer. “OpenAI Moves to Shape AI Policy Debate.” 6 April 2026. https://www.emarketer.com/content/openai-moves-shape-ai-policy-debate
13. Stigler, G. J. “The Theory of Economic Regulation.” Bell Journal of Economics and Management Science, 1971.
14. Bebchuk, L. A. and Tallarita, R. “The Illusory Promise of Stakeholder Governance.” Cornell Law Review, 2020, with follow-up empirical work published 2022.
15. Acemoglu, D. and Restrepo, P. “Robots and Jobs: Evidence from US Labor Markets.” Journal of Political Economy, 2020.
16. Atkinson, A. B. “Inequality: What Can Be Done?” Harvard University Press, 2015.
17. 4 Day Week Global. UK Pilot Programme Results, 2023. https://www.4dayweek.com/
18. Norwegian Government Pension Fund Global, Norges Bank Investment Management public reporting. https://www.nbim.no/
19. Alaska Permanent Fund Corporation public reporting. https://apfc.org/
20. European Parliament Committee on Legal Affairs. Report on Civil Law Rules on Robotics, 2017.
21. Gates, B. Interview with Quartz on robot taxation, February 2017.

---

Tim Green UK-based Systems Theorist & Independent Technology Writer

Tim explores the intersections of artificial intelligence, decentralised cognition, and posthuman ethics. His work, published at smarterarticles.co.uk, challenges dominant narratives of technological progress while proposing interdisciplinary frameworks for collective intelligence and digital stewardship.

His writing has been featured on Ground News and shared by independent researchers across both academic and technological communities.

ORCID: 0009-0002-0156-9795 Email: tim@smarterarticles.co.uk

Discuss...

There is a particular kind of dread that does not show up in any labour market report. It is not the fear of being fired. It is the slow, creeping realisation that the thing you spent a decade learning to do well is now being done, competently enough, by a system that learned it in seconds. You still have your job. You still get paid. But something has shifted beneath you, something that the economists measuring unemployment rates and GDP growth have no instrument to detect.

In the March/April 2026 issue of the Harvard Business Review, researchers Erik Hermann of the European University Viadrina, Stefano Puntoni of the Wharton School at the University of Pennsylvania, and Carey K. Morewedge of Boston University's Questrom School of Business published a study that gave this dread a framework. Their paper, “Why Gen AI Feels So Threatening to Workers,” argued that the primary psychological threat of generative AI is not job displacement. It is something more intimate and harder to measure: the erosion of competence, autonomy, and relatedness, the three psychological needs that, according to decades of motivation research, make work feel meaningful in the first place. When those needs are satisfied, the authors found, employees embrace AI as a helpful tool. When they are frustrated, employees resist, disengage, and in some cases actively sabotage their organisation's AI initiatives.

The numbers are striking. A 2025 survey by Kyndryl, spanning 25 industries and eight countries, found that 45 per cent of CEOs report employees who are resistant or openly hostile to workplace generative AI. A separate cross-industry survey of 1,600 American knowledge workers found that 31 per cent admit to actively working against their company's AI strategy. Among Generation Z workers, that figure rises to 41 per cent. Meanwhile, according to a BCG survey published in 2025, 85 per cent of leaders and 78 per cent of managers regularly use generative AI, compared with only 51 per cent of frontline workers, a gap that reveals how differently the technology is experienced depending on where you sit in an organisation. This is not Luddism. This is something more psychologically complex: a workforce that senses, even if it cannot always articulate, that the introduction of AI is not merely changing what they do but hollowing out why it mattered.

The Competence Trap

To understand why AI feels so destabilising, even to workers whose jobs are ostensibly secure, you need to understand what competence actually means in the context of professional identity.

Self-determination theory, the psychological framework underpinning the Harvard Business Review study, holds that human beings have three basic psychological needs: competence (the feeling of being effective and capable), autonomy (the feeling of being in control of one's actions), and relatedness (the feeling of having meaningful interpersonal connections). These are not luxuries. They are the bedrock of intrinsic motivation, the internal drive that makes people voluntarily invest effort, pursue mastery, and find satisfaction in their work. When these needs are met, people thrive. When they are frustrated, the consequences ripple outward into disengagement, anxiety, and what psychologists call “controlled motivation,” where people continue to work but only because they feel they have to rather than because they want to.

Generative AI strikes at all three needs simultaneously, but the blow to competence is perhaps the most disorienting. For most knowledge workers, professional identity is inseparable from professional skill. A lawyer's sense of self is bound up in their ability to parse a complex contract. A writer's identity is entangled with their capacity to find the right word. A financial analyst's confidence rests on their ability to spot patterns in messy data. These are not just tasks. They are the cognitive and creative activities through which people develop, demonstrate, and maintain their sense of being good at something.

When a generative AI system can draft that contract, write that paragraph, or analyse that dataset in a fraction of the time and at a fraction of the cost, something happens to the person who used to do it. They may still be employed. They may even be more productive. But the specific activities that gave them a feeling of mastery, the activities that made them feel like skilled professionals rather than warm bodies occupying desks, are being absorbed by a machine. The Harvard Business Review authors found that this dynamic is particularly acute for younger workers, whose entry-level tasks (document review, data compilation, first drafts) are precisely the tasks most susceptible to automation. These are the assignments that, while unglamorous, constitute the learning curve itself. Remove them, and you remove the mechanism through which junior professionals develop expertise.

The autonomy dimension cuts equally deep. Hermann, Puntoni, and Morewedge described how mandatory AI use creates what they call “algorithmic cages,” standardised procedures that limit task customisation and strip workers of agency over their own cognitive process. Workers find themselves held responsible for AI-generated output they did not truly author, cast in a supporting role to a technology rather than functioning as drivers of their own work. The Ivanti Tech at Work report found that 32 per cent of generative AI users keep their usage hidden from employers, with reasons ranging from wanting a “secret advantage” (36 per cent) to fear of being fired (30 per cent) to concerns about impostor syndrome (27 per cent). When a third of workers feel they must hide their relationship with the primary tool of their profession, something has gone badly wrong with how that tool is being introduced.

A Stanford study published in 2025 found that hiring for entry-level, AI-impacted positions such as junior accounting roles fell by 16 per cent over roughly two years. In the United Kingdom, technology graduate roles fell by 46 per cent in 2024. The share of technology job postings requiring at least five years of experience jumped from 37 per cent to 42 per cent between mid-2022 and mid-2025, while the share open to candidates with two to four years of experience dropped from 46 per cent to 40 per cent over the same period. The bottom rung of the career ladder is not merely being restructured. It is being removed.

When the Tool Becomes the Crutch

The competence problem extends beyond entry-level workers. There is growing evidence that even experienced professionals are losing skills as they increasingly delegate cognitive work to AI systems.

In August 2025, The Lancet Gastroenterology and Hepatology published a multicentre observational study examining what happened to endoscopists at four Polish clinics that had introduced AI-assisted colonoscopy as part of the ACCEPT trial. The AI system helped doctors detect adenomas, a precancerous growth, with impressive accuracy. But when the AI assistance was later removed, the doctors' own detection rates had measurably declined. Average adenoma detection at non-AI-assisted colonoscopies fell from 28.4 per cent before AI exposure to 22.4 per cent after AI exposure, a 6 percentage point absolute reduction. The researchers attributed the decline to a natural human tendency to over-rely on the recommendations of decision support systems. The doctors had not become incompetent. They had simply stopped practising the skill, and, as with any unpractised skill, it had atrophied. This was, as the study's authors noted, the first research to suggest AI exposure might have a negative impact on patient-relevant endpoints in medicine.

This is not an isolated finding. Advait Sarkar, an AI and design researcher at Microsoft Research who delivered a TED talk at TEDAI Vienna in November 2025, coined a phrase that captures the dynamic with uncomfortable precision: when we outsource our reasoning to artificial intelligence, he argued, we reduce ourselves to “middle managers for our own thoughts.” Sarkar pointed to research showing that knowledge workers using AI assistants produce a smaller range of ideas than groups working without AI. People who rely on AI to write for them remember less of what they wrote. People who read AI-generated summaries remember less than if they had read the original document. The cognitive effects are measurable: fewer ideas, less critical examination of those ideas, weaker memory retention, and diminished capacity to perform the task independently.

A separate analysis published in the Harvard Gazette in November 2025, featuring perspectives from researchers at the Harvard Graduate School of Education and the Harvard Kennedy School, reinforced the concern. Tina Grotzer, a principal research scientist in education at Harvard, noted that overreliance on AI can reduce engagement with challenging mental skills, while users may avoid developing critical capacities like analysis and reflection. The researchers emphasised that the outcome depends entirely on how users engage with AI: as a thinking tool or as a cognitive shortcut. The evidence so far suggests most workplaces are optimising for the shortcut.

The philosopher Avigail Ferdman of the Technion, Israel Institute of Technology, published a paper in the journal AI and Society in 2025 that frames this dynamic as a structural problem rather than an individual failing. Ferdman introduced the concept of “capacity-hostile environments” to describe conditions in which AI mediation actively impedes the cultivation of human capacities. The argument is philosophically precise: humans develop and exercise their epistemic, moral, social, and creative capacities through a long, gradual process of habituation. We get better at things by doing them repeatedly, by failing, by adjusting, by trying again. When AI absorbs those activities, the environment in which capacity development occurs is fundamentally altered. Deskilling, in Ferdman's framing, is harmful not merely because it reduces economic productivity but because it “diminishes us as human beings, undermining the epistemic, social, moral and creative capacities required for practical reason, self-worth, as well as mutual respect between persons.”

Critically, Ferdman argues that expecting individuals to simply resist deskilling through personal discipline is naive. To a large extent, she writes, we develop and exercise our capacities in response to our social and material environment. If that environment is structured to reward cognitive offloading and penalise the slower, messier process of independent thought, then deskilling is not a failure of individual willpower. It is the predictable result of structural conditions. This is not a problem that a training programme can fix.

The Illusion of Competence

Perhaps the most insidious dimension of AI-mediated deskilling is that its victims often do not recognise it is happening.

A 2025 study published in the International Journal of Research and Scientific Innovation by researchers at Mount Kenya University examined what they called the “illusion of competence,” a misleading perception of mastery created by AI-generated outputs that mask underlying cognitive deficits. The researchers found that as AI tools take over cognitive tasks, users develop an inflated sense of their own ability. They confuse their skill at operating the tool with genuine expertise in the underlying domain. A junior lawyer who uses an AI system to draft a motion may feel confident in the output without having developed the legal reasoning to evaluate whether the motion is actually sound. A financial analyst who relies on AI to build models may not notice when the model rests on flawed assumptions, because they never developed the intuition that comes from building hundreds of models by hand. The study identified specific risks including academic underperformance, reduced originality, erosion of self-efficacy, and the devaluation of human expertise across professional contexts.

The 2025 Microsoft New Future of Work report reinforced this finding, observing that knowledge workers reported generative AI made tasks seem cognitively easier while researchers found the workers were ceding problem-solving expertise to the system. The report noted that junior workers aged 22 to 25 in high-AI-exposure jobs have seen employment drop by approximately 13 per cent, and warned that organisations risk “eroding collaboration and mutual support if AI is used to replace social engagement.” The Microsoft report also found that 52 per cent of surveyed employees report moderate to high workplace loneliness, a finding that speaks directly to the relatedness dimension of the psychological threat identified by the Harvard Business Review authors.

This illusion of competence creates a dangerous feedback loop. Workers feel more capable because their AI-assisted output is better. Organisations see improved productivity metrics. Everyone appears to be benefiting. But beneath the surface, the actual human skill base is eroding. And the erosion only becomes visible when something goes wrong: when the AI system fails, when it hallucinates, when the situation requires precisely the kind of independent judgement that the worker no longer possesses because they stopped practising it years ago. The Wharton/GBK Collective annual survey captured this paradox neatly: 89 per cent of senior decision-makers say generative AI enhances employee skills, while 71 per cent simultaneously believe it will cause skill atrophy and job replacement. Both things, it turns out, can be true at the same time.

The Identity Crisis Nobody Measured

The psychological damage of competence erosion extends well beyond the workplace. For most adults in industrialised societies, professional identity is a core component of personal identity. What you do for a living is, for better or worse, a significant part of who you are. When the substance of that work is hollowed out, the identity built around it becomes unstable.

Maha Hosain Aziz, a professor at New York University's MA International Relations programme and a risk and foresight adviser to the World Economic Forum, published an essay on the Forum's platform in August 2025 describing what she calls the “AI precariat,” borrowing the term coined by economist Guy Standing in 2011 to describe a class defined by insecurity, exclusion, and anxiety. Aziz's argument is that the AI version of this precariat will face not just economic hardship but an occupational identity crisis: “the loss of purpose, structure and social belonging that comes when work disappears.” She points to historical precedents from post-coal Britain to post-industrial American towns, where the disappearance of livelihoods led to deteriorating mental health, rising addiction, and fertile ground for political extremism. The AI wave, Aziz warns, could replicate those dynamics on a global scale and at a far faster pace. Her proposed solutions include “precariat labs,” cross-sector hubs where governments, companies, and civil society test interventions for at-risk workers, integrating mental health care, retraining, and community-building to preserve both livelihoods and identity.

The data on worker engagement suggests this identity crisis is already underway. According to Gallup's State of the Global Workplace reports, global employee engagement fell from 23 per cent to 21 per cent in 2025, the sharpest decline since the early days of the pandemic. Fewer than one in three employees feel strongly connected to their company's mission. Less than half of employees (47 per cent) strongly agree they know what is expected of them at work, which Gallup identifies as a foundational element of engagement. In 2026, 52 per cent of workers reported that burnout was dragging down their engagement, up from 34 per cent the previous year, with 83 per cent of workers experiencing some degree of burnout. These are broad trends with multiple causes, but the timing is difficult to separate from the rapid deployment of generative AI across knowledge work. When the tasks that gave work meaning are automated, and the remaining tasks feel like supervisory busywork, disengagement is not a mystery. It is a predictable consequence.

The ManpowerGroup's Global Talent Barometer 2026 captured this dynamic with unusual clarity: regular AI usage among workers jumped 13 per cent in 2025, while confidence in the technology's use plummeted 18 per cent. The confidence gap was most pronounced among older workers, with a 35 per cent decrease in confidence among baby boomers and a 25 per cent drop among Generation X workers. Nearly nine in ten workers (89 per cent) are confident they have the skills to succeed in their current roles, but 43 per cent fear automation may replace their job within the next two years. Workers are using AI more and trusting it less. They are becoming more productive by measures that appear on dashboards while feeling less capable and less purposeful by measures that do not. This is the gap that no employment statistic can capture.

The Organisational Blind Spot

Most organisations have responded to AI's disruption of work with a familiar playbook: skills training, upskilling programmes, change management initiatives. These are not inherently misguided, but they systematically miss the psychological dimension of the problem.

The Harvard Business Review study found that only 36 per cent of employees felt properly trained for generative AI tools. An Amazon Web Services survey found that 52 per cent of IT decision-makers did not understand their employees' training requirements. But training, even when well-executed, addresses only one dimension of the threat. It addresses competence in the narrow sense of knowing how to use the tool. It does not address the deeper issue: the feeling of being deskilled, the loss of autonomy over one's own cognitive process, the erosion of the interpersonal connections that emerge when people collaborate on intellectually demanding work. Only 44 per cent of business leaders involve workers in AI implementation decisions, according to the Harvard Business Review authors, a figure that reveals how little most organisations understand about what is actually at stake.

Hermann, Puntoni, and Morewedge proposed a framework they call AWARE: acknowledge employee concerns, watch for adaptive and maladaptive coping behaviours, align support systems with psychological needs, redesign workflows around human-AI synergies, and empower workers through transparency and inclusion. The framework is sensible. But it is also demanding, requiring a level of psychological literacy and organisational intentionality that most companies have not demonstrated.

The contrast between organisations that get this right and those that do not is instructive. Duolingo's CEO Luis von Ahn publicly shared a memo in April 2025 detailing an “AI-first” approach that included reducing reliance on contractors and a policy of hiring only when automation could not handle the work. The company had already cut around 10 per cent of its contractor workforce at the end of 2023, with further cuts in October 2024, replacing first translators and then writers with AI systems. The backlash to the memo was immediate and fierce, with users flooding the company's social media pages with criticism. Von Ahn later admitted the memo “did not give enough context” and clarified that no full-time employees would be laid off. The damage, however, was done. The message received by workers and the public was clear: human skill is a cost centre to be minimised.

Compare this with PwC, which created a dedicated AI “playground” for employees, ran “prompting parties” to build collective AI literacy, and designated peer “activators” to support adoption. Or BNY, which achieved 60 per cent employee adoption by emphasising universal access and encouraging 5,000 employees to build their own custom AI agents. Or Moderna, which merged its technology and human resources departments to design collaborative AI workflows from the ground up. These approaches treat workers as co-creators of the AI-augmented workplace rather than passive recipients of a technology imposed upon them.

The difference is not merely strategic. It is psychological. When workers participate in shaping how AI is integrated into their roles, their sense of autonomy is preserved. When they develop new skills alongside AI rather than watching AI absorb their existing skills, their sense of competence is maintained. When AI adoption is a collective endeavour rather than a top-down mandate, relatedness survives.

What Policymakers Cannot See

The policy conversation about AI and work remains overwhelmingly focused on employment numbers. Will AI create more jobs than it destroys? How fast will displacement occur? What retraining programmes should governments fund? These are important questions. But they are the wrong questions if the primary harm is not unemployment but the psychological hollowing out of work that continues to exist.

There is no government metric for “the feeling of being good at something.” There is no Bureau of Labour Statistics category for “work that still feels meaningful.” The entire apparatus of labour market policy is designed to measure and respond to job loss, not to the subtler and potentially more corrosive phenomenon of job degradation, where employment persists but its psychological substance is drained.

Aziz proposed the creation of an “AI Anxiety Index” to track how occupational displacement affects mental well-being across societies. The American Enterprise Institute published a 2025 report on deskilling the knowledge economy that argued the workers best positioned to thrive would be those combining legacy technical skills with AI literacy and broader capabilities such as critical thinking, communication, and adaptability. The AEI report noted that as AI platforms absorb routine tasks, entry-level and mid-level knowledge workers in finance, business services, government, and health care face growing vulnerability. These are useful contributions, but they remain at the margins of policy discourse. The dominant conversation is still about headcounts.

This is a structural failure of imagination. If AI's primary harm to workers is not economic but psychological, then the response cannot be purely economic. Policies that address only unemployment and retraining will miss the damage being done to workers who remain employed but whose professional identities are being systematically undermined. What is needed is a framework that recognises work as a source of meaning and not merely income, and that treats the erosion of that meaning as a harm worthy of policy attention.

Reclaiming Craft in an Age of Automation

The question, then, is whether it is possible to preserve the psychological substance of work in an era when the cognitive and creative tasks that gave work its substance are increasingly performed by machines.

The answer is not obvious, and anyone who tells you it is should be treated with suspicion. But there are starting points.

First, at the individual level, there is Sarkar's argument that AI should function as a “tool for thought” that challenges rather than obeys. The distinction matters. An AI system that generates a first draft and presents it as a finished product encourages cognitive offloading. An AI system that generates competing hypotheses, flags weaknesses in the user's reasoning, or refuses to provide an answer until the user has articulated their own position first encourages deeper engagement. The technology exists to build either kind of system. The question is which kind organisations choose to deploy.

Second, at the organisational level, the AWARE framework and similar approaches point toward a principle that should be obvious but apparently is not: the goal of AI integration should be to augment human capability, not merely to reduce headcount or increase throughput. This means deliberately preserving the tasks that build and maintain expertise, even when AI could perform them more efficiently. A law firm that automates all document review for junior associates may save money in the short term, but it will find itself, within a decade, with a generation of senior lawyers who never developed the foundational skills on which legal judgement depends. The short-term efficiency gain produces a long-term competence deficit.

Third, at the policy level, governments need to develop new metrics and new categories of harm. The Gallup engagement data, the ManpowerGroup confidence data, and the Harvard Business Review psychological needs framework all point toward measurable indicators of work quality that exist outside traditional employment statistics. Integrating these indicators into policy-making would at least begin to make visible the damage that current metrics cannot see. Aziz's proposed precariat labs offer a model for what this might look like in practice: cross-sector interventions that treat AI-driven disruption not merely as an employment problem but as a crisis of identity, mental health, and social cohesion.

Fourth, at the philosophical level, there is a conversation that the technology industry has been remarkably reluctant to have: about what work is for. The dominant framing treats work as a production function, an input-output equation in which the goal is to maximise output per unit of input. Within this framing, any technology that increases productivity is unambiguously good. But if work is also a site of human development, a context in which people cultivate skill, exercise judgement, and build identity, then a technology that increases output while eroding the human experience of producing it is not unambiguously good at all. It is, at best, a trade-off that deserves honest acknowledgement.

Ferdman's concept of “capacity-conducive environments” offers a useful compass here. The question to ask of any AI deployment is not simply “Does this increase productivity?” but “Does this create conditions in which human capacities can develop, or conditions in which they atrophy?” The answers will not always be comfortable. They will sometimes point toward deliberately choosing less efficient arrangements because those arrangements better serve the humans within them. But that discomfort is the price of taking seriously the idea that work is more than a transaction.

The Unasked Question

The conversation about AI and work has, for the better part of a decade, been dominated by a single question: will the robots take our jobs? It is the wrong question, or at least an incomplete one. The more urgent question, the one that the Harvard Business Review research and a growing body of psychological, philosophical, and medical evidence points toward, is this: what happens when the robots take the part of our jobs that made us who we are?

The employment statistics will not tell you. The productivity dashboards will not tell you. The quarterly earnings calls, with their triumphant announcements of AI-driven efficiency gains, will certainly not tell you. You will have to look elsewhere: at the endoscopist whose diagnostic eye has dulled, at the junior lawyer who never learned to think like a lawyer, at the writer who can no longer find the sentence without asking a machine for it first, at the 31 per cent of knowledge workers who are quietly sabotaging their company's AI strategy not because they are afraid of unemployment but because they sense, at some level beneath articulation, that something essential is being taken from them.

That something is competence. It is craft. It is the hard-won, slowly-built, deeply personal experience of being good at something. And no algorithm, however sophisticated, has figured out how to give it back.

References

1. Hermann, E., Puntoni, S., and Morewedge, C.K. “Why Gen AI Feels So Threatening to Workers.” Harvard Business Review, March/April 2026.
2. Kyndryl. CEO Survey on AI Adoption and Employee Resistance, 2025. Spanning 25 industries and eight countries.
3. Writer/Workplace Intelligence. Enterprise AI Adoption Survey: Knowledge Worker Resistance to AI Initiatives, 2025. Survey of 1,600 U.S. knowledge workers.
4. BCG. “AI at Work 2025: Momentum Builds, but Gaps Remain.” Boston Consulting Group, 2025.
5. Budzyn, K., Romanczyk, M., Kitala, D., Kolodziej, P., Bugajski, M., et al. “Endoscopist deskilling risk after exposure to artificial intelligence in colonoscopy: a multicentre, observational study.” The Lancet Gastroenterology and Hepatology, vol. 10, no. 10, October 2025, pp. 896-903.
6. Sarkar, A. “How to stop AI from killing your critical thinking.” TED Talk, TEDAI Vienna, November 2025.
7. Ferdman, A. “AI deskilling is a structural problem.” AI and Society, Springer Nature, 2025.
8. Matueny, R.M. and Nyamai, J.J. “Illusion of Competence and Skill Degradation in Artificial Intelligence Dependency among Users.” International Journal of Research and Scientific Innovation, vol. 12, no. 5, 2025.
9. Microsoft Research. New Future of Work Report 2025, published December 2025.
10. Grotzer, T. et al. “Is AI dulling our minds?” Harvard Gazette, November 2025.
11. Aziz, M.H. “The overlooked global risk of the AI precariat.” World Economic Forum, August 2025.
12. Standing, G. The Precariat: The New Dangerous Class. Bloomsbury Academic, 2011.
13. Gallup. State of the Global Workplace Report, 2025.
14. ManpowerGroup. Global Talent Barometer, 2026.
15. Amazon Web Services. Gen AI Adoption Index: Survey of IT Decision-Makers, 2025.
16. Stanford University. Study on entry-level hiring declines in AI-impacted positions, 2025.
17. American Enterprise Institute. “De-Skilling the Knowledge Economy.” AEI Report, 2025.
18. Ivanti. Tech at Work Report: Survey on hidden AI usage among workers, 2025.
19. Wharton/GBK Collective. Annual Survey on AI and Employee Skills, 2025.
20. Duolingo. CEO Luis von Ahn's “AI-first” memo and subsequent clarification, April-August 2025. Reported by Fortune, CNBC, and HR Grapevine.
21. Hermann, E., Puntoni, S., and Morewedge, C.K. “GenAI and the psychology of work.” Trends in Cognitive Sciences, 2025.

---

Tim Green UK-based Systems Theorist & Independent Technology Writer

Tim explores the intersections of artificial intelligence, decentralised cognition, and posthuman ethics. His work, published at smarterarticles.co.uk, challenges dominant narratives of technological progress while proposing interdisciplinary frameworks for collective intelligence and digital stewardship.

His writing has been featured on Ground News and shared by independent researchers across both academic and technological communities.

ORCID: 0009-0002-0156-9795 Email: tim@smarterarticles.co.uk

Discuss...

For the better part of a decade, Brussels was the city that Big Tech feared. The General Data Protection Regulation, adopted in 2016 and enforced from 2018, became the gold standard for privacy law worldwide, inspiring more than 150 countries to craft their own versions. The AI Act, finalised in 2024, was the planet's first comprehensive attempt to regulate artificial intelligence by risk category. Together, these two landmark laws positioned the European Union as the undisputed global standard-bearer for rights-based digital governance, a regulatory superpower wielding what scholars call the “Brussels Effect” to shape corporate behaviour far beyond its borders.

That era may be ending. On 19 November 2025, the European Commission published its Digital Omnibus Package, a sweeping legislative proposal that amends the GDPR, the ePrivacy Directive, the AI Act, the Data Act, the Data Governance Act, and the NIS2 Directive in a single stroke. Framed as a necessary exercise in “simplification” and “competitiveness,” the package has drawn fierce opposition from an extraordinary coalition of civil society organisations, data protection authorities, privacy advocates, and digital rights groups who see it as something altogether different: a systematic dismantling of the very protections that made European digital law the envy of democracies everywhere.

Amnesty International has called it a threat to produce “the biggest rollback of digital fundamental rights in EU history.” European Digital Rights (EDRi), the continent's leading digital rights network, has labelled the proposals “a major rollback of EU digital protections.” A coalition of 127 civil society organisations, trade unions, and public interest defenders has issued an open letter demanding the Commission halt the Digital Omnibus entirely. And Corporate Europe Observatory, working alongside LobbyControl, has published a granular, article-by-article analysis tracing many of the most consequential changes directly to lobbying documents submitted by Google, Meta, Microsoft, and their trade associations.

The question is no longer whether Europe's digital rights framework is under pressure. It is whether rights-based AI governance can survive anywhere if the jurisdiction that invented it decides the cost of leadership is too high.

The Competitiveness Argument and the Draghi Shadow

To understand the Digital Omnibus, you first need to understand the political climate that produced it. The European Commission did not wake up one morning and decide to rewrite its own landmark legislation on a whim. The proposals emerged from a sustained campaign, years in the making, to reframe European regulation as an obstacle to economic growth rather than a democratic achievement worth preserving.

The intellectual foundation was laid in September 2024, when Mario Draghi, the former president of the European Central Bank and former Italian prime minister, delivered his landmark report on the future of European competitiveness. Commissioned by European Commission President Ursula von der Leyen, the Draghi Report warned that “excessive regulatory and administrative burden can hinder the ease of doing business in the EU and the competitiveness of EU companies.” It singled out the GDPR by name, claiming the regulation had “raised the cost of data by about 20 percent for EU firms compared with US peers.” It pointed to “unclear overlaps” between the GDPR and the AI Act as a specific drag on innovation.

The Draghi Report called for “a radical simplification of GDPR,” harmonised AI sandbox regimes across all member states, and the appointment of a new Vice-President for Simplification to coordinate the process. Within months, the Commission had announced the Digital Omnibus as its primary vehicle for delivering on those recommendations. The speed was notable. What had been discussed as a measured, evidence-based review of the EU's digital rulebook became an accelerated legislative push, outpacing the Commission's own planned “Digital Fitness Check” that was originally scheduled for 2026.

The Commission projects that the package, if adopted as proposed, would save businesses and public administrations at least six billion euros by the end of 2029. The stated goals are to reduce duplicative compliance costs, lighten the regulatory load on small and medium-sized enterprises (SMEs), improve legal certainty, and make the EU's digital rulebook “easier to navigate.”

These are not trivial ambitions. European businesses, particularly smaller ones, have legitimate complaints about regulatory complexity. The GDPR, the AI Act, the Data Act, the Digital Services Act, the Digital Markets Act, and the ePrivacy Directive collectively create a dense web of overlapping obligations that can be genuinely difficult and expensive to navigate. The Commission's Omnibus IV Simplification Package, published separately in May 2025, addressed some of the most straightforward concerns, exempting small and micro companies from the obligation to maintain records of processing activities under the GDPR.

But the Digital Omnibus goes far beyond tidying up paperwork. Critics argue it uses the language of simplification to smuggle in substantive deregulation, weakening core protections in ways that have nothing to do with reducing administrative burdens and everything to do with accommodating the commercial priorities of the largest technology companies on earth.

What the Omnibus Actually Changes

The specific amendments proposed in the Digital Omnibus are extensive, spanning hundreds of pages of legislative text. Several stand out for their potential impact on the rights of hundreds of millions of European citizens.

Perhaps the most technically significant change concerns the very definition of personal data. The Commission proposes to narrow this definition by codifying what it calls a “relative” concept: information qualifies as personal data only if the current holder can identify the data subject using means “reasonably available” to it. The ability of a subsequent recipient to identify the person does not make the data personal for the current holder. This sounds like a minor clarification. It is not. The European Data Protection Board (EDPB) and the European Data Protection Supervisor (EDPS), in their Joint Opinion 2/2026 published in February 2026, warned that this change “goes far beyond a targeted modification of the GDPR” or “a mere codification of CJEU jurisprudence,” and would “significantly narrow the concept of personal data.” They urged co-legislators not to adopt it.

The implications are enormous. A narrower definition of personal data means less data falls under the GDPR's protection regime. Companies processing information that they argue they cannot use to identify individuals, even if that identification becomes possible in another context or with additional resources, would face fewer restrictions on how they collect, store, and monetise that information. For companies training AI models on vast datasets scraped from the internet, this is precisely the kind of legal breathing room they have been seeking for years.

The second major change creates an explicit legal basis for using personal data to train AI systems. The proposed new Article 88c of the GDPR would establish that processing personal data for the development and operation of AI systems or AI models qualifies as a “legitimate interest” under Article 6(1)(f) of the GDPR. This means companies would no longer need to obtain consent to use personal data for AI training, provided they can demonstrate the processing is necessary, proportionate, and not overridden by the interests of data subjects. Data subjects would retain an unconditional right to object, and companies would need to apply data minimisation measures, but the burden of proof effectively shifts. Rather than asking permission, companies train first and handle objections later.

The EDPB itself noted, somewhat dryly, that this provision is “unnecessary” because the Board had already published guidance confirming that legitimate interest could, in appropriate circumstances, serve as a lawful basis for AI training. The difference, of course, is between regulatory guidance that preserves the balancing test and a statutory provision that tilts the scales toward commercial use.

Third, the Omnibus restructures the relationship between the ePrivacy Directive and the GDPR in ways that affect every internet user. Rules governing access to terminal equipment, including cookies and tracking technologies, are moved from the ePrivacy Directive to the GDPR where personal data is processed. The ePrivacy Directive would no longer govern personal data processing; the GDPR alone would apply. The proposals expand the circumstances under which data can be stored on or accessed from a user's device without consent, including for “aggregated audience measuring” and device security. While the Commission frames these changes as addressing “cookie consent fatigue” (introducing requirements for single-click refusal, six-month moratoriums on repeat consent requests, and machine-readable preference signalling through browsers), civil society groups warn that weakening the ePrivacy framework removes one of the few clear rules preventing companies and governments from constantly tracking what people do on their devices, their cars, and their smart home systems.

Fourth, on the AI Act side, the Omnibus proposes to delay the implementation of rules for high-risk AI systems, which were originally due to take effect in August 2026. The new timeline allows a maximum 16-month extension, with backstop compliance dates of 2 December 2027 and 2 August 2028 depending on the category of high-risk system. The rationale is that the Commission wants to ensure “adequate compliance support” is available before obligations kick in. Critics see a straightforward concession to industry: more time to deploy AI systems without the guardrails that the AI Act was specifically designed to impose. In practical terms, it means that AI systems used in hiring, credit scoring, law enforcement, and migration management will operate for years longer without the mandatory risk assessments and transparency requirements that were supposed to protect people from algorithmic harm.

The Omnibus also introduces a new provision permitting the processing of special categories of personal data (including biometric data, data revealing racial or ethnic origin, and health data) for bias detection and correction in high-risk AI systems. While bias detection is a legitimate and important goal, civil society organisations have raised concerns about creating explicit statutory routes for processing the most sensitive categories of personal data in AI contexts, arguing it could be exploited well beyond its stated purpose.

Finally, the breach notification framework is softened. The timeframe for notifying data protection authorities of personal data breaches is extended from 72 hours to 96 hours, and only breaches likely to result in “high risk” to data subjects would require notification. This is the kind of change that, in isolation, might seem reasonable. Taken alongside everything else, it forms part of a pattern: a consistent loosening of obligations that, cumulatively, transforms the character of the entire regulatory regime.

Following the Money, Article by Article

If the Digital Omnibus were purely a good-faith attempt at regulatory streamlining, its provisions would be expected to reflect the concerns of the broadest possible range of stakeholders: businesses of all sizes, civil society, data protection authorities, consumers, and affected communities. What Corporate Europe Observatory and LobbyControl found, in their analysis published in January 2026, tells a different story.

Their article-by-article comparison of the Digital Omnibus proposals with lobbying documents submitted by Google, Meta, Microsoft, and major technology trade associations reveals what they describe as a close alignment between the Commission's text and Big Tech's longstanding policy demands. The narrowing of the personal data definition, the legitimate interest basis for AI training, the weakening of ePrivacy protections, the delays to high-risk AI obligations: each of these changes corresponds to specific asks documented in corporate lobbying materials.

One particularly striking example involves Google. In a lobbying paper dated 16 August 2025, directed at the German government, Google called for the introduction of a “disproportionate efforts” exemption to compliance. This language subsequently appeared in the Omnibus proposals, which require companies to remove personal data from AI systems only if doing so does not require “disproportionate efforts,” a term that remains undefined and, critics argue, open to systematic abuse by the very companies with the deepest pockets and most sophisticated legal teams.

Documents obtained by Corporate Europe Observatory also show that Google and Microsoft conducted a concerted and successful lobbying effort to remove “large-scale, illegal discrimination” from the list of systemic risks in the AI Code of Practice, a voluntary framework that was meant to guide responsible AI deployment even before the AI Act's binding provisions took effect.

The scale of the lobbying operation is staggering. According to Corporate Europe Observatory's research, published in October 2025, the technology industry's spending on EU lobbying reached a record 151 million euros, with just ten companies accounting for 49 million euros of that total. Meta led the pack at 10 million euros, followed by Microsoft, Apple, and Amazon at 7 million euros each, and Google and Qualcomm at 4.5 million euros each. In the first half of 2025 alone, Big Tech companies held 146 meetings with high-level European Commission staff, an average of more than one meeting for every working day. Amazon logged 43 meetings, Microsoft 36, Google 35, Apple 29, and Meta 27.

The revolving door between industry and the institutions meant to regulate it adds another layer of concern. In February 2026, MEP Aura Salla of the European People's Party was appointed as the European Parliament's rapporteur for the Digital Omnibus. Salla served as Meta's Public Policy Director and Head of EU Affairs from May 2020 to April 2023. Seven civil society watchdog organisations, including Transparency International EU, Corporate Europe Observatory, and The Good Lobby, called for the withdrawal of her appointment, noting that she had failed to declare her previous work at Meta as a potential conflict of interest in her formal declaration of awareness, as required by Article 3 of the Code of Conduct. She had also met with her former employer multiple times since taking office, including lobby meetings in September 2024 and January 2025. Separately, in April 2025, Salla sold stocks in a defence company following reporting by Follow The Money, stocks she had never reported in her declaration of private interests.

Death by a Thousand Cuts

The privacy advocacy organisation noyb, founded by the Austrian lawyer and activist Max Schrems, has described the Digital Omnibus as “death by a thousand cuts” for the GDPR. The characterisation captures something important about the strategy at work. No single amendment in the package is necessarily fatal to the European data protection framework. Each can be individually rationalised. Taken together, they represent a fundamental reorientation of the relationship between citizens and the companies that harvest their data.

Noyb has been particularly critical of the procedural dimension. Rather than following through on the originally planned “Digital Fitness Check” scheduled for 2026, which would have involved systematic evidence gathering and impact assessment, the Commission pushed through the Omnibus in what noyb describes as a “fast track” procedure, bypassing the normal consultative process. The Commission followed what civil society groups characterise as a procedure with legislative shortcuts that circumvented democratic scrutiny, sidelining concerns from organisations acting in the public interest. The result, noyb argues, is a set of proposals that massively lower protections for Europeans while providing “basically no real benefit for average European small and medium businesses.” The changes, in noyb's analysis, are “a gift to US big tech” that open up numerous new loopholes.

A noyb-conducted survey of data protection professionals reinforced this critique, revealing what noyb described as “an enormous gap between the needs of real people working on compliance every day and the problems pushed by the Brussels lobby bubble.” Compliance professionals, it turned out, wanted less paperwork, not fewer rights. The Commission's proposals delivered the opposite: they reduced substantive protections while doing relatively little to simplify the administrative burden that actual practitioners find most burdensome.

The EDPB and EDPS, in their Joint Opinion, echoed many of these concerns while maintaining a more measured tone. They expressed support for certain specific proposals, including the extension of breach notification timelines and targeted changes to data protection impact assessment requirements. But on the most consequential amendments, including the narrowing of the personal data definition and the restructuring of lawful bases for AI training, they raised serious objections. Their overall assessment was that the proposals “may adversely affect the level of protection enjoyed by individuals, create legal uncertainty, and make data protection law more difficult to apply.” Coming from the EU's own data protection authorities, this was a remarkable intervention, a polite but unmistakable warning that the Commission's own watchdogs considered its proposals harmful.

The leaked drafts of the Omnibus generated strong opposition in the European Parliament, particularly from the Social Democrats (S&D), Renew Europe, and the Greens. But the political dynamics are complex. The European People's Party, the largest group in Parliament, has broadly supported the Commission's competitiveness agenda, and the appointment of Aura Salla as rapporteur signals the direction of travel in the Parliament's Industry, Research and Energy (ITRE) committee.

The Global Ripple Effect

The implications of the Digital Omnibus extend far beyond Europe's borders. The GDPR's influence on global privacy regulation has been one of the most consequential developments in international law over the past decade. More than 150 countries have adopted domestic privacy laws that resemble the GDPR in some form, drawn by the regulation's extraterritorial reach and by the mechanism of “adequacy decisions,” through which the European Commission certifies that a third country's data protection framework provides sufficient protection to allow data transfers from the EU. Countries seeking adequacy status have had powerful incentives to align their domestic laws with European standards. If those European standards are weakened, the entire global architecture shifts.

The timing is particularly significant. The United States, under the Trump administration's December 2025 executive order, has moved toward what it describes as a “minimally burdensome national standard for AI policy,” explicitly seeking to limit state-level regulatory divergence and create a more permissive environment for AI development. Three new US comprehensive privacy laws, in Indiana, Kentucky, and Rhode Island, transitioned from planning to enforcement on 1 January 2026, but these state-level efforts exist in a federal vacuum that the executive order is designed to fill with minimal regulatory ambition. The United Kingdom, having departed the EU, enacted its Data Use and Access Act (DUAA) in June 2025, which expands the circumstances for automated decision-making, broadens the definition of “scientific research” to include commercial research, and allows broader consent mechanisms for data processing, with many provisions coming into force in early 2026. Both the US and UK approaches prioritise innovation and economic growth over the precautionary, rights-based model that has defined European regulation.

If Europe now follows the same trajectory, converging toward a lighter-touch regime in the name of competitiveness, the question becomes: who is left to champion rights-based governance?

One potential answer comes from the Global South. India hosted the AI Impact Summit in February 2026, the first time this global governance forum was held outside the developed world. Ninety-one countries and international organisations adopted the AI Impact Summit Declaration, which notably shifted the framing from “risk” (the language of previous summits in Bletchley, Seoul, and Paris) to “impact.” India's IndiaAI mission has deployed a national “common compute” pool of more than 34,000 publicly funded GPUs, seeking to democratise access to AI infrastructure for startups, researchers, and public sector innovators. The United Nations has opened a consultation on AI governance with an April 2026 deadline, seeking input that could shape a global framework.

But the capacity of Global South nations to fill a governance vacuum left by Europe is constrained by the same structural inequalities that shape the AI landscape itself: limited compute infrastructure, dependence on Western and Chinese platforms, and the persistent influence of adequacy mechanisms that tie data flows to European standards, even as those standards erode. Success in addressing AI governance from the Global South depends on three critical issues, as analysts at the Brookings Institution have noted: infrastructure access, governance influence, and local adaptation. Countries lacking compute capacity, energy grids, and connectivity cannot build their own models or process their own data domestically, leaving them reliant on the very corporations whose influence the GDPR was designed to check.

As the Information Technology and Innovation Foundation has argued (from a position sympathetic to deregulation), the Brussels Effect can constrain Global South innovation by imposing compliance costs on countries that lack the institutional capacity to bear them. The irony is that weakening GDPR standards might simultaneously reduce the compliance burden and remove the normative floor that gave smaller nations a template for protecting their citizens' rights. It is a double bind with no easy resolution.

The Deeper Question of Durability

What the Digital Omnibus reveals is not simply a policy debate about the optimal balance between privacy and innovation. It exposes a structural vulnerability in rights-based governance itself. Digital rights frameworks are politically expensive to create and politically cheap to dismantle. The GDPR took years of negotiation, involved thousands of stakeholders, and required sustained political will to overcome industry opposition. The AI Act endured an even more fraught legislative process, with real-time lobbying battles over the regulation of foundation models, biometric surveillance, and high-risk applications.

Dismantling these protections requires no comparable effort. A single omnibus proposal, framed in the anodyne language of “simplification” and “competitiveness,” can undo years of democratic deliberation in a legislative session. The asymmetry is inherent: concentrated corporate interests can sustain lobbying pressure indefinitely, while the diffuse public interest in privacy and algorithmic accountability lacks a permanent, well-funded constituency to defend it. Big Tech companies are spending as much as 550 billion US dollars in 2026 to dominate the AI market, according to Corporate Europe Observatory's estimates. Against that scale of capital deployment, the resources available to civil society watchdogs are negligible.

This dynamic is compounded by the geopolitical pressure that European policymakers face. The AI race between the United States and China is often framed as an existential competition in which regulatory overhead is a strategic disadvantage. The Draghi Report explicitly invoked this framing, and Commission President von der Leyen has repeatedly emphasised the need for Europe to “keep pace” with its geopolitical rivals. In this environment, rights-based regulation is perpetually on the defensive, required to justify its existence in economic terms rather than being valued as a democratic achievement in its own right.

Amnesty International's April 2026 analysis connects the Digital Omnibus to a broader pattern of democratic backsliding on digital rights. The organisation's research has documented how platform algorithms contributed to ethnic cleansing against Rohingya Muslims in Myanmar and grave human rights abuses against Tigrayan people in Ethiopia, with Meta failing to moderate, and in some instances actively amplifying, harmful and discriminatory content. The weakening of the DSA and DMA, which have also been mentioned as potential targets for simplification, would reduce the already limited tools available to hold platforms accountable for these harms. EDRi has warned that this deregulatory political moment is likely to spill over into upcoming legislation, including the Digital Fairness Act expected later in 2026, a law meant to modernise consumer protection for the digital age and tackle manipulative design practices.

The appointment of Aura Salla as rapporteur, the record lobbying expenditures, the secretive meetings between Commission officials and industry representatives (documented by Corporate Europe Observatory in a November 2025 report on the Commission's pre-proposal consultations), the fast-tracking of legislation without proper impact assessment: these are not aberrations in an otherwise healthy democratic process. They are symptoms of a regulatory capture that civil society organisations have been warning about for years.

Where This Leaves Us

The Digital Omnibus is still moving through the ordinary legislative procedure. The European Parliament and the Council must both approve the proposals before they become law, and adoption is not expected before mid-to-late 2026 at the earliest. There is still time for amendments, and the opposition from data protection authorities, civil society, and significant parliamentary blocs suggests the final text may differ substantially from the Commission's proposal.

But the direction of travel is clear. Even if the most controversial provisions are modified or removed, the political consensus that produced the GDPR and the AI Act has fractured. The forces pushing for deregulation, supercharged by record lobbying spending, a sympathetic Commission leadership, and a geopolitical environment that privileges speed over safety, are not going away. The 127 civil society organisations that signed the open letter demanding the Commission halt the Omnibus are fighting a defensive battle, and they know it.

The consequences extend beyond any single piece of legislation. If Europe retreats from its position as the global standard-bearer for digital rights, the vacuum will not remain empty. It will be filled by regulatory models that prioritise corporate freedom over individual protection, by voluntary industry codes that lack enforcement mechanisms, and by a fragmented global landscape in which the most powerful technology companies operate with minimal democratic oversight. The “Brussels Effect” works in reverse, too: when the standard-setter lowers its standards, the floor drops for everyone.

What is at stake in the Digital Omnibus is not merely the future of European data protection. It is whether democratic societies possess the institutional resilience to maintain rights-based governance of powerful technologies in the face of sustained commercial pressure. The evidence so far is not encouraging. But the fight is not over, and its outcome will shape digital governance for a generation.

---

References and Sources

1. European Commission, “Digital Package: Simplification of EU Digital Rules,” published 19 November 2025. Available at: https://digital-strategy.ec.europa.eu/en/faqs/digital-package

2. Amnesty International, “EU Simplification: Throwing Human Rights Under the Omnibus,” published 19 November 2025. Available at: https://www.amnesty.org/en/latest/news/2025/11/eu-simplification-throwing-human-rights-under-the-omnibus/

3. Amnesty International, “EU: Digital Omnibus Proposals Will Tear Apart Accountability on Digital Rights,” published November 2025. Available at: https://www.amnesty.org/en/latest/news/2025/11/eu-digital-omnibus-proposals-will-tear-apart-accountability-on-digital-rights/

4. Amnesty International, “How EU Proposals to 'Simplify' Tech Laws Will Roll Back Our Rights,” published April 2026. Available at: https://www.amnesty.org/en/latest/news/2026/04/eu-simplification-laws/

5. Corporate Europe Observatory and LobbyControl, “Article by Article, How Big Tech Shaped the EU's Roll-back of Digital Rights,” published 14 January 2026. Available at: https://corporateeurope.org/en/2026/01/article-article-how-big-tech-shaped-eus-roll-back-digital-rights

6. Corporate Europe Observatory, “Revealed: Tech Industry Now Spending Record 151 Million Euros on Lobbying the EU,” published October 2025. Available at: https://corporateeurope.org/en/2025/10/revealed-tech-industry-now-spending-record-eu151-million-lobbying-eu

7. Corporate Europe Observatory, “Preparing a Roll-back of Digital Rights: Commission's Secretive Meetings with Industry,” published November 2025. Available at: https://corporateeurope.org/en/2025/11/preparing-roll-back-digital-rights-commissions-secretive-meetings-industry

8. European Digital Rights (EDRi), “Commission's Digital Omnibus is a Major Rollback of EU Digital Protections,” published 2025. Available at: https://edri.org/our-work/commissions-digital-omnibus-is-a-major-rollback-of-eu-digital-protections/

9. EDRi, “Forthcoming Digital Omnibus Would Mark Point of No Return,” published 2025. Available at: https://edri.org/our-work/forthcoming-digital-omnibus-would-mark-point-of-no-return/

10. EDPB and EDPS, “Joint Opinion 2/2026 on the Proposal for a Regulation (Digital Omnibus),” published February 2026. Available at: https://www.edpb.europa.eu/system/files/2026-02/edpb_edps_jointopinion_202602_digitalomnibus_en.pdf

11. noyb, “Digital Omnibus: EU Commission Wants to Wreck Core GDPR Principles,” published 2025. Available at: https://noyb.eu/en/digital-omnibus-eu-commission-wants-wreck-core-gdpr-principles

12. noyb, “Open Letter: Digital Omnibus Brings Deregulation, Not Simplification,” published 2025. Available at: https://noyb.eu/en/open-letter-digital-omnibus-brings-deregulation-not-simplification

13. People vs Big Tech, “'Stop the Digital Omnibus,' Say 127 Civil Society Organisations,” published 2025. Available at: https://peoplevsbig.tech/the-eu-must-uphold-hard-won-protections-for-digital-human-rights/

14. Mario Draghi, “The Future of European Competitiveness” (Draghi Report), commissioned by European Commission President Ursula von der Leyen, published September 2024. Available at: https://commission.europa.eu/topics/competitiveness/draghi-report_en

15. European Parliament, “Simplifying EU Digital Laws for Competitiveness,” published November 2025. Available at: https://epthinktank.eu/2025/11/20/simplifying-eu-digital-laws-for-competitiveness/

16. Transparency International EU, “Call to Withdraw European Parliament's Digital Omnibus Rapporteur Appointment,” published February 2026. Available at: https://transparency.eu/call-to-withdraw-european-parliaments-digital-omnibus-rapporteur-appointment/

17. Corporate Europe Observatory, “Watchdog Organisations Issue Call to Withdraw Aura Salla's Appointment as Digital Omnibus Rapporteur,” published February 2026. Available at: https://corporateeurope.org/en/2026/02/watchdog-organisations-issue-call-withdraw-aura-sallas-appointment-digital-omnibus

18. White and Case LLP, “GDPR Under Revision: Key Takeaways from the Digital Omnibus Regulation Proposal,” published 2025. Available at: https://www.whitecase.com/insight-alert/gdpr-under-revision-key-takeaways-from-digital-omnibus-regulation-proposal

19. IAPP, “EU Digital Omnibus: Analysis of Key Changes,” published 2025. Available at: https://iapp.org/news/a/eu-digital-omnibus-analysis-of-key-changes

20. Bruegel, “Efficiency and Distribution in the European Union's Digital Deregulation Push,” published 2025. Available at: https://www.bruegel.org/policy-brief/efficiency-and-distribution-european-unions-digital-deregulation-push

21. ITIF, “How the Brussels Effect Hinders Innovation in the Global South,” published January 2026. Available at: https://itif.org/publications/2026/01/26/how-brussels-effect-hinders-innovation-in-global-south/

22. The Record from Recorded Future News, “Civil Society Decries Digital Rights 'Rollback' as European Commission Pushes Data Protection Changes,” published 2025. Available at: https://therecord.media/civil-society-privacy-rollback

23. Brookings Institution, “AI in the Global South: Opportunities and Challenges Towards More Inclusive Governance,” published 2025. Available at: https://www.brookings.edu/articles/ai-in-the-global-south-opportunities-and-challenges-towards-more-inclusive-governance/

24. EDPB and EDPS, “Digital Omnibus: EDPB and EDPS Support Simplification and Competitiveness While Raising Key Concerns,” published February 2026. Available at: https://www.edpb.europa.eu/news/news/2026/digital-omnibus-edpb-and-edps-support-simplification-and-competitiveness-while_en

---

Tim Green UK-based Systems Theorist & Independent Technology Writer

Tim explores the intersections of artificial intelligence, decentralised cognition, and posthuman ethics. His work, published at smarterarticles.co.uk, challenges dominant narratives of technological progress while proposing interdisciplinary frameworks for collective intelligence and digital stewardship.

His writing has been featured on Ground News and shared by independent researchers across both academic and technological communities.

ORCID: 0009-0002-0156-9795 Email: tim@smarterarticles.co.uk

Discuss...

The robots were supposed to take our jobs. Instead, they are sorting us into winners and losers while we argue about the wrong question entirely.

For the better part of three years, the dominant anxiety about artificial intelligence in the workplace has been binary: will it replace us, or won't it? Governments have convened panels. Think tanks have published forecasts. CEOs have made pledges about “responsible deployment.” And through all of it, the conversation has orbited a single, dramatic scenario: mass displacement, a wave of redundancies, the hollowing out of the white-collar middle class.

But in March 2026, Anthropic, the San Francisco-based AI company behind the Claude family of large language models, published a piece of labour market research that quietly reframed the entire debate. Their study, “Labor market impacts of AI: A new measure and early evidence,” introduced a novel metric called “observed exposure” and used millions of real Claude interactions mapped against roughly 800 occupations in the O*NET database to measure not what AI could theoretically do to jobs, but what it is actually doing right now. The headline finding was almost anticlimactic: AI is not yet replacing jobs at scale. There has been no systematic rise in unemployment among workers in the most AI-exposed occupations.

The less comfortable finding, buried deeper in the data, was this: AI is already creating a measurable skills divide. Hiring of workers aged 22 to 25 in highly exposed occupations has dropped roughly 14 percent compared to pre-ChatGPT levels. The researchers noted this finding was “just barely statistically significant,” but the directional signal is hard to ignore. The first measurable labour market effect of generative AI is not a pink slip. It is a closed door.

And that might be worse.

The Gap Between Can and Does

Anthropic's study is notable not for what it predicts but for what it measures. Previous attempts to gauge AI's impact on employment, including the widely cited 2023 research by Eloundou and colleagues, relied on theoretical exposure: estimating whether a large language model could, in principle, make a given task at least twice as fast. By that measure, the numbers look staggering. Theoretical AI coverage for Computer and Mathematical occupations sits at 94 percent. For Office and Administrative Support roles, it is 90 percent.

But theoretical capability is not the same as economic reality. Anthropic's observed exposure metric tracks what is actually happening in professional settings by counting which tasks show sufficient work-related usage in Claude traffic, then weighting fully automated implementations at full value and augmentative use (where humans remain in the loop) at half weight. The result is a far more sober picture. In Computer and Mathematical roles, Claude currently covers just 33 percent of tasks. For the most exposed individual occupations, the figures are higher but still well below ceiling: programmers at 74.5 percent, customer service representatives at 70.1 percent, and data entry clerks at 67.1 percent.

At the other end of the spectrum, theoretical AI coverage is lowest in grounds maintenance at just 3.9 percent, followed by transportation at 12.1 percent, agriculture at 15.7 percent, food and serving at 16.9 percent, and construction at 16.9 percent. The divide is not merely between AI-proficient workers and everyone else. It is between entire categories of work that exist in fundamentally different relationships to the technology.

The gap between theoretical and observed exposure is, in a sense, the breathing room the labour market currently enjoys. But it is also a measure of latent disruption. As Anthropic's researchers note, tracking how that gap narrows over time provides a real-time indicator of economic transformation as it unfolds. The question is not whether AI can reshape these occupations. It is how quickly the observed line catches up to the theoretical one.

Anthropic's earlier Economic Index report, published in January 2026, provides additional context. That study, based on a privacy-preserving analysis of two million AI conversations split between consumer and enterprise use, found that in early 2025, 36 percent of occupations used Claude for at least a quarter of their tasks. By the time data was pooled across subsequent reports, that figure had risen to 49 percent. The trajectory is clear. What was niche behaviour a year ago is becoming standard practice for nearly half of all tracked occupations. And for the workers on the wrong side of the emerging divide, the pace of that convergence matters enormously.

Power Users and the Compounding Loop

If Anthropic's research tells us what AI is doing to the labour market in aggregate, a separate body of evidence reveals what it is doing to individual workers. And here the picture is sharper, more unequal, and considerably more troubling.

OpenAI's 2025 State of Enterprise AI report documented a sixfold productivity gap between power users and everyone else. Workers at the 95th percentile of AI adoption send six times as many messages to ChatGPT as the median employee at the same companies. For coding tasks specifically, the heaviest users engage 17 times more frequently than their typical peers. Among data analysts, the most active users employ AI data analysis tools 16 times more often than the median. Over the past year, weekly messages in ChatGPT Enterprise increased roughly eightfold, and the average worker sends 30 percent more messages than they did a year prior. Seventy-five percent of enterprise users report being able to complete entirely new tasks they previously could not perform.

The numbers translate directly into time. Workers who applied AI to seven or more distinct tasks reported saving over 10 hours per week. Those using it for fewer than three tasks reported no time savings at all. This is not a gentle gradient. It is a cliff edge.

What makes this particularly consequential is the compounding nature of the advantage. Workers who experiment broadly with AI discover more uses, which leads to greater productivity gains and better performance reviews, which leads to more interesting assignments and faster advancement, which in turn provides more opportunity and incentive to deepen AI usage further. The Debevoise Data Blog described this dynamic in January 2026 as a self-reinforcing cycle: “AI success leads to more AI success,” with early adopters developing intuitions and workflow habits that simply cannot be shortcut by intensive late-stage training. Organisations that wait until 2027 to address their AI skills gap, the analysis argued, will find themselves competing for a shrinking pool of trainable talent against firms that started building capability in 2024 and 2025. Those firms that are ahead now will find it relatively easy to stay ahead, the analysis continued, especially if they can recruit talent away from firms that have fallen behind.

Gensler's 2026 Global Workplace Survey, which polled 16,459 full-time office workers across 16 countries, adds another dimension. About 30 percent of employees now qualify as AI power users, defined as people who regularly use AI tools in both professional and personal contexts. More than half of these power users are under 40, and nearly a third are managers. These workers score significantly higher on innovation, engagement, and team relationships. They spend less time working alone (37 percent of their week versus 42 percent for late adopters) and more time learning (12 percent versus 8 percent) and socialising (11 percent versus 9 percent). Seventy percent of AI power users say learning is highly critical to their job performance. They are three times more likely to perceive their organisations as among the most innovative in the sample.

This is not the profile of someone coasting on a productivity hack. It is the profile of someone whose entire relationship to work has been restructured around a new set of capabilities, and whose career trajectory is diverging from peers who have not made the same transition.

Who Falls Behind, and Why It Is Not Random

The demographics of AI exposure complicate any simple narrative about technology helping the little guy. Anthropic's research found that workers in the most exposed professions “are more likely to be older, female, more educated, and higher-paid.” This inverts the usual pattern of technological disruption, where low-skilled, low-wage workers bear the heaviest costs. AI's first targets are not factory floors or retail counters. They are the knowledge-work occupations that have historically offered stable, well-compensated careers.

At the same time, the youth hiring slowdown suggests that the entry points to those careers are narrowing. If organisations can get 33 percent of a junior analyst's work done through an AI system, the calculus around hiring a new graduate changes. You do not necessarily fire the senior analyst. You simply do not replace the intern. The result is an invisible contraction: no layoffs, no headlines, just a quiet thinning of opportunity at the bottom of the professional ladder. As Anthropic's researchers cautioned, the young workers who are not hired may be remaining at their existing jobs, taking different jobs, or returning to education. The displacement, if that is even the right word, is diffuse and hard to track through conventional unemployment statistics.

This matters because early career experience has always been the mechanism through which workers build the skills, networks, and institutional knowledge that drive later advancement. A 22-year-old who spends two years doing data cleaning, attending meetings, and learning the rhythms of a professional environment is accumulating human capital that no online course can replicate. If AI shrinks the pool of those formative roles, the long-term consequences extend well beyond the immediate hiring numbers. It creates a generational bottleneck: not a single event, but a gradual narrowing of the pipeline through which junior talent enters and eventually rises within knowledge-work professions.

The World Economic Forum's Future of Jobs Report 2025 projected that 170 million new jobs will be created globally by 2030, while 92 million will be displaced, yielding a net gain of 78 million positions. But the same report warned that 59 percent of the global workforce will need reskilling or upskilling by 2030, and that 120 million workers face medium-term risk of redundancy if training systems fail to keep pace. The skills gap, the report noted, is the single most significant obstacle to business transformation, cited by 63 percent of employers. By 2030, 77 percent of employers plan to prioritise reskilling and upskilling their workforce to enhance collaboration with AI systems. The intent is there. Whether the execution will match the ambition is another question entirely.

The question is whether the workers who need reskilling most are the same ones who are positioned to receive it. The evidence suggests they are not.

The Training Paradox

Corporate AI training is booming. It is also, by most measures, failing.

A February 2026 DataCamp and YouGov survey of 517 business leaders in the United States and United Kingdom found that 82 percent of enterprise leaders say their organisation provides some form of AI training. And yet 59 percent of those same leaders report an AI skills gap within their workforce. Only 35 percent say they have a mature, organisation-wide upskilling programme in place. The access is there. The capability is not.

The problem, according to DataCamp's analysis, is structural. Most corporate AI training still follows a passive, course-based model: video lectures, multiple-choice assessments, completion certificates. Twenty-three percent of leaders surveyed said video-based courses make it difficult for employees to apply skills in the real world. The training exists in a vacuum, disconnected from the actual workflows where AI tools would be used. Workers complete modules and tick boxes, but the gap between knowing what a large language model is and knowing how to restructure your daily work around one remains vast.

This finding aligns with the EY 2025 Work Reimagined Survey, which polled 15,000 employees and 1,500 employers across 29 countries and found that organisations are missing up to 40 percent of potential AI productivity gains due to gaps in talent strategy. Among organisations experiencing AI-driven productivity improvements (96 percent of those investing in AI), only 17 percent reported that those gains led to reduced headcount. Far more were reinvesting in new AI capabilities (42 percent), cybersecurity (41 percent), research and development (39 percent), and employee upskilling (38 percent).

The pattern is revealing. Organisations are spending on AI training. They are not firing people because of AI. But they are also not succeeding at turning their existing workforce into proficient AI users at anything close to the speed required. The result is a two-track system within organisations: a minority of self-motivated power users who are pulling ahead, and a majority who have attended the workshops but have not fundamentally changed how they work.

McKinsey's January 2025 report on “Superagency in the workplace” put this disconnect in stark terms. While 92 percent of companies plan to increase AI investments over the next three years, only 1 percent report that they have reached what McKinsey considers AI maturity. The report also found that employees are three times more likely than leaders expect to be using generative AI for at least 30 percent of their daily work. Nearly half of C-suite leaders believe their companies are moving too slowly on AI development, citing leadership misalignment and lack of talent as the primary obstacles. The gap is not just between workers and AI. It is between what organisations think is happening with AI adoption and what is actually happening on the ground.

DataCamp's research found that organisations with mature, workforce-wide upskilling programmes are nearly twice as likely to report significant positive AI return on investment. The implication is clear: the training itself is not the bottleneck. The quality, structure, and integration of training into daily work is what separates organisations that capture AI value from those that do not. And that distinction maps uncomfortably well onto existing inequalities in corporate resources, management quality, and organisational culture.

The Wage Premium and the Widening Gulf

PwC's 2025 Global AI Jobs Barometer, which analysed close to a billion job advertisements from six continents, quantified the financial dimension of the AI skills divide. Jobs requiring AI skills now command a 56 percent wage premium over comparable roles, more than double the 25 percent premium recorded the previous year. Skills demands in AI-exposed occupations are changing 66 percent faster than in other roles, up from 25 percent the year before. And jobs requiring AI skills are growing 7.5 percent year on year, even as total job postings fell 11.3 percent.

These numbers describe an accelerating divergence. Workers who acquire and maintain AI proficiency are not just keeping pace; they are pulling away from the pack in measurable economic terms. A 56 percent wage premium is not a marginal advantage. It is the kind of differential that, compounded over a career, produces fundamentally different life outcomes: different housing, different schools for children, different retirement trajectories.

The acceleration is equally significant. When skill demands change 66 percent faster in one set of occupations than in others, the half-life of any given training investment shrinks accordingly. A worker who completes an AI literacy course in 2026 may find its content partially obsolete by 2027. This creates a treadmill effect that disproportionately burdens workers with less time, fewer resources, and less institutional support for continuous learning. It also creates a recruitment spiral. Workers with AI skills command higher salaries, which means they gravitate towards organisations that already have strong AI cultures, which further concentrates capability in firms that are already ahead.

PwC's data also contained a counterintuitive finding: productivity growth has nearly quadrupled in industries most exposed to AI, rising from 7 percent over the 2018 to 2022 period to 27 percent over 2018 to 2024 in sectors like financial services and software publishing. Jobs continue to grow even in the most easily automated roles. AI, in other words, is making people more valuable, not less. But the value accrues unevenly, and the distribution of that value tracks closely with the distribution of AI competence.

The Five-and-a-Half Trillion Dollar Question

IDC, the technology research firm, has put a price tag on the AI skills gap: $5.5 trillion in projected global economic losses by 2026, stemming from delayed products, quality issues, missed revenue, and impaired competitiveness. Over 90 percent of global enterprises, by IDC's estimate, will face critical AI skills shortages. Ninety-four percent of CEOs and CHROs identify AI as their top in-demand skill, yet only 35 percent feel they have adequately prepared their employees. Only a third of employees report receiving any AI training in the past year, even as half of employers report difficulty filling AI-related positions.

The scale of the mismatch is staggering. There are currently 1.6 million open AI positions globally, against approximately 518,000 qualified candidates, a demand-to-supply ratio of roughly 3.2 to 1. And the positions going unfilled are not niche research roles at frontier labs. They are the applied, mid-level positions where AI tools meet business operations: the prompt engineers, the automation specialists, the analysts who can bridge the gap between a model's capabilities and an organisation's needs.

The barriers to closing this gap are not mysterious. IDC's research identified the key obstacles as lack of talent (46 percent), data privacy concerns (43 percent), poor data quality (40 percent), high implementation costs (40 percent), and unclear return on investment for AI programmes (26 percent). These are not exotic challenges. They are the ordinary frictions of organisational change, amplified by the speed at which AI capabilities are advancing.

IDC projects that AI technologies themselves will eventually shave about a trillion dollars off skill-gap losses by 2027, as AI tools become more intuitive and self-service. But that still leaves trillions in unrealised value, and it assumes a level of organisational readiness that the DataCamp and EY surveys suggest is far from guaranteed.

The irony is hard to miss. The tool that is supposed to democratise knowledge work is, in its current deployment phase, concentrating advantage among those who already have the skills, resources, and institutional support to learn how to use it. AI's promise of universal empowerment remains real. Its present reality is stratification.

Structural Shift or Growing Pains

The critical question embedded in all of this data is whether the AI skills divide is a temporary adjustment, a transitional friction that will smooth out as tools improve and training catches up, or a permanent structural feature of the labour market.

The case for optimism rests on several reasonable premises. AI tools are becoming more user-friendly with each generation. Natural language interfaces have dramatically lowered the barrier to entry compared to previous waves of technology. Companies are investing heavily in training, even if current programmes are imperfect. PwC's data shows that AI is creating jobs and boosting productivity broadly, not just for an elite few. And 85 percent of organisations plan to increase their investment in upskilling employees through the period from 2025 to 2030, according to multiple industry surveys.

But the case for structural concern is stronger, and it rests on the compounding dynamics that multiple independent studies have now documented. The Debevoise analysis identified a self-reinforcing cycle where early AI adopters develop capabilities that accelerate their further adoption, creating a widening gap that late entrants cannot easily close. OpenAI's data shows a sixfold productivity differential that maps onto usage intensity. Anthropic's observed exposure metric reveals that even within occupations theoretically saturated by AI capability, actual adoption is unevenly distributed.

The OECD's 2025 report on bridging the AI skills gap acknowledged that current adult training systems “often favour those already advantaged by higher education, widening opportunity gaps.” The report recommended that governments expand incentives for AI training, improve accessibility and inclusivity, and invest in modular credentials and recognition of prior learning. These are sensible policy proposals. They are also the kind of recommendations that take years to implement and decades to show results.

Meanwhile, the compounding loop runs at the speed of quarterly performance reviews and annual promotion cycles. Every month that a power user pulls further ahead is a month that makes the gap harder to close. Every junior role that goes unfilled because AI handles part of its function is a career pathway that becomes slightly narrower. The structural argument is not that these trends are irreversible. It is that they are self-reinforcing, and that the window for intervention narrows with each passing quarter.

What Organisations Get Wrong

The most common corporate response to the AI skills divide is to treat it as a training problem. It is not. It is a management problem, a culture problem, and, increasingly, a strategic problem.

Training, as the DataCamp survey makes clear, is a necessary but insufficient condition for building AI capability. What separates organisations that successfully embed AI into their workflows from those that do not is not the availability of courses but the integration of AI tools into actual work processes, with management support, performance incentives, and tolerance for experimentation. McKinsey's superagency report found that 48 percent of employees rank training as the most important factor for AI adoption, but training alone, without the organisational scaffolding to support its application, produces graduates who know the theory but cannot implement it.

The EY survey found that 96 percent of organisations investing in AI report some productivity gains. But the distribution of those gains within organisations is wildly uneven, with a handful of power users capturing the majority of value while the broader workforce remains largely unchanged. This suggests that the barrier is not technological but organisational: the tools work, but most organisations have not restructured roles, workflows, and incentives to make broad adoption possible.

Companies that lead in AI adoption, according to OpenAI's enterprise report, enjoy 1.7 times higher revenue growth, 3.6 times greater total shareholder return, and 1.6 times higher EBIT margins compared to laggards. The correlation between AI adoption and financial performance is becoming impossible to ignore. And yet the mechanisms for spreading AI proficiency remain largely ad hoc, dependent on individual initiative rather than systematic organisational design.

This is the paradox at the heart of the AI skills divide. The technology is genuinely democratising in its potential. Anyone with access to a large language model can, in theory, perform analyses, draft documents, and automate workflows that previously required specialist expertise. But “in theory” is doing a lot of heavy lifting. In practice, the workers who extract the most value from AI are those who already possess the skills, confidence, and institutional support to experiment effectively. The tool is egalitarian. The context in which it is deployed is not.

The Policy Vacuum

Government responses to the AI skills divide have been, with some exceptions, sluggish and incremental. The OECD has called for expanded AI training incentives, improved accessibility, and investment in connected learning pathways that allow workers to move more fluidly between vocational and academic routes. The European Parliament has commissioned research on AI's role in reshaping the European workforce. The World Economic Forum continues to publish increasingly urgent reports about the scale of reskilling required.

But the gap between policy aspiration and implementation remains wide. Most OECD countries do not yet have comprehensive AI literacy programmes targeted at working adults. Funding for reskilling tends to flow through existing institutional channels, which, as the OECD itself acknowledges, “often favour those already advantaged by higher education.” The workers most at risk of falling behind are precisely the ones least served by current policy frameworks: those without degrees, without employer-sponsored training, without the time or resources for self-directed learning.

The speed mismatch is perhaps the most critical issue. AI capabilities are advancing on a timeline measured in months. Policy responses operate on a timeline measured in years, sometimes decades. By the time a government commission has completed its review, published its recommendations, secured funding, designed a programme, and enrolled its first cohort of learners, the AI landscape will have shifted beneath their feet. The skills taught in 2026 may be partially obsolete by 2028. The OECD's own recommendation for “modular credentials and recognition of prior learning” implicitly acknowledges this problem: long-form educational programmes are too slow for a technology that rewrites its own capabilities every few months.

This does not mean policy is futile. It means that policy alone cannot solve the problem. Effective responses will require coordination between governments, employers, educational institutions, and the AI companies themselves. They will require a willingness to experiment with new models of training delivery, credentialing, and workforce support. And they will require an honest reckoning with the fact that the AI skills divide is not simply a technical challenge to be solved with better courses. It is a distributional challenge that reflects, and threatens to amplify, existing structures of inequality.

What Comes Next

Anthropic's March 2026 study offered one final, underappreciated insight. The gap between theoretical and observed AI exposure is not closing uniformly across occupations. In some fields, adoption is accelerating rapidly. In others, it has barely begun. The trajectory of that convergence will determine, more than any other single factor, how deeply AI reshapes the labour market over the next five years.

If observed exposure converges slowly, there is time for training systems, policy responses, and organisational practices to adapt. Workers can build skills incrementally. Institutions can adjust. The transition, while painful, remains manageable.

If it converges quickly, as improvements in AI capability, agentic workflows, and enterprise integration suggest it might, the window for orderly adaptation shrinks dramatically. The 14 percent decline in youth hiring that Anthropic documented could become 30 percent, or 50 percent. The sixfold productivity gap between power users and everyone else could widen further. The 56 percent wage premium for AI-skilled workers could calcify into a permanent feature of the labour market, as entrenched and as difficult to reverse as any existing dimension of economic inequality.

The honest answer to whether AI's skills divide is temporary or structural is that it is both, simultaneously, and the balance between those two possibilities depends on choices being made right now, in boardrooms and government offices and training departments around the world. The technology does not predetermine the outcome. But the compounding dynamics are real, the clock is running, and the workers who are falling behind today are accumulating disadvantages that will become progressively harder to reverse.

The robots did not take the jobs. They created a new hierarchy within them. And unless something changes, that hierarchy is hardening fast.

References and Sources

1. Anthropic, “Labor market impacts of AI: A new measure and early evidence,” Anthropic Research, March 2026. https://www.anthropic.com/research/labor-market-impacts

2. Anthropic, “Anthropic Economic Index report: Economic primitives,” January 2026. https://www.anthropic.com/research/anthropic-economic-index-january-2026-report

3. Fortune, “Anthropic just mapped out which jobs AI could potentially replace. A 'Great Recession for white-collar workers' is absolutely possible,” March 6, 2026. https://fortune.com/2026/03/06/ai-job-losses-report-anthropic-research-great-recession-for-white-collar-workers/

4. Fortune, “Is AI about to take your job? New Anthropic research suggests the answer is more complicated than you think,” March 10, 2026. https://fortune.com/2026/03/10/will-ai-take-your-job-this-chart-in-an-economic-study-by-anthropic-may-give-you-a-hint-but-the-answer-is-complicated/

5. OpenAI, “The State of Enterprise AI: 2025 Report,” 2025. https://openai.com/index/the-state-of-enterprise-ai-2025-report/

6. VentureBeat, “OpenAI report reveals a 6x productivity gap between AI power users and everyone else,” 2025. https://venturebeat.com/ai/openai-report-reveals-a-6x-productivity-gap-between-ai-power-users-and

7. Debevoise Data Blog, “AI Advantages Tend to Compound, Increasing the Risks of Falling Too Far Behind,” January 7, 2026. https://www.debevoisedatablog.com/2026/01/07/ai-advantages-tend-to-compound-increasing-the-risks-of-falling-too-far-behind/

8. Gensler Research Institute, “Global Workplace Survey 2026,” 2026. https://www.gensler.com/gri/global-workplace-survey-2026

9. Gensler, “The Human Side of AI: What Power Users Are Telling Us About the Workplace,” 2026. https://www.gensler.com/blog/what-ai-power-users-tell-us-about-the-workplace

10. DataCamp and YouGov, “Companies Are Investing in AI, But Their Workforces Aren't Ready,” February 2026. https://www.datacamp.com/blog/the-ai-skills-gap-in-2026-why-most-ai-training-isn-t-translating-to-workforce-capability

11. EY, “AI-driven productivity is fueling reinvestment over workforce reductions,” December 2025. https://www.ey.com/en_us/newsroom/2025/12/ai-driven-productivity-is-fueling-reinvestment-over-workforce-reductions

12. EY, “EY survey reveals companies are missing out on up to 40% of AI productivity gains due to gaps in talent strategy,” November 2025. https://www.ey.com/en_gl/newsroom/2025/11/ey-survey-reveals-companies-are-missing-out-on-up-to-40-percent-of-ai-productivity-gains-due-to-gaps-in-talent-strategy

13. PwC, “The Fearless Future: 2025 Global AI Jobs Barometer,” 2025. https://www.pwc.com/gx/en/services/ai/ai-jobs-barometer.html

14. IDC via CIO Dive, “What's the cost of the IT skills gap? IDC says $5.5 trillion by 2026,” 2025. https://www.ciodive.com/news/tech-talent-skills-gaps-cost-trillions-idc/716523/

15. World Economic Forum, “Future of Jobs Report 2025,” January 2025. https://www.weforum.org/publications/the-future-of-jobs-report-2025/

16. OECD, “Bridging the AI skills gap,” 2025. https://www.oecd.org/en/publications/bridging-the-ai-skills-gap_66d0702e-en.html

17. McKinsey, “Superagency in the workplace: Empowering people to unlock AI's full potential at work,” January 2025. https://www.mckinsey.com/capabilities/tech-and-ai/our-insights/superagency-in-the-workplace-empowering-people-to-unlock-ais-full-potential-at-work

18. HR Dive, “Anthropic: AI's influence over the labor market is only beginning to be felt,” March 2026. https://www.hrdive.com/news/anthropic-ai-influence-over-the-labor-market-jobs/814670/

19. TechCrunch, “The AI skills gap is here, says AI company, and power users are pulling ahead,” March 25, 2026. https://techcrunch.com/2026/03/25/the-ai-skills-gap-is-here-says-ai-company-and-power-users-are-pulling-ahead/

20. The Decoder, “Anthropic's new study shows AI is nowhere near its theoretical job disruption potential,” March 2026. https://the-decoder.com/anthropics-new-study-shows-ai-is-nowhere-near-its-theoretical-job-disruption-potential/

21. Workera, “The $5.5 Trillion Skills Gap: What IDC's New Report Reveals About AI Workforce Readiness,” 2025. https://www.workera.ai/blog/the-5-5-trillion-skills-gap-what-idcs-new-report-reveals-about-ai-workforce-readiness

---

Tim Green UK-based Systems Theorist & Independent Technology Writer

Tim explores the intersections of artificial intelligence, decentralised cognition, and posthuman ethics. His work, published at smarterarticles.co.uk, challenges dominant narratives of technological progress while proposing interdisciplinary frameworks for collective intelligence and digital stewardship.

His writing has been featured on Ground News and shared by independent researchers across both academic and technological communities.

ORCID: 0009-0002-0156-9795 Email: tim@smarterarticles.co.uk

Discuss...

Everyone agrees that artificial intelligence should be fair, transparent, and accountable. That sentence could have been written in 2018, and it would have been just as true then as it is now. The difference is that in 2018, arriving at consensus on those principles felt like the hard part. In 2026, we know better. The hard part was never agreeing on what AI ethics should look like. The hard part is making anyone actually do it.

A growing body of research confirms what practitioners and regulators have been circling for years: the global AI ethics landscape has converged around a remarkably stable set of principles. Transparency. Fairness. Non-maleficence. Accountability. Privacy. These five values appear in the vast majority of the more than 200 ethics guidelines and governance documents that researchers have catalogued worldwide. A landmark review by Anna Jobin, Marcello Ienca, and Effy Vayena, published through ETH Zurich and later expanded through broader global analysis, found that transparency appeared in 86 per cent of guidelines examined, justice and fairness in 81 per cent, and non-maleficence in 71 per cent. The world, it turns out, has been surprisingly good at articulating what responsible AI ought to involve. The world has been catastrophically bad at enforcing it.

That gap between articulation and enforcement defines the current moment in AI governance. And it is not an abstract policy debate. It is the difference between a hiring algorithm that discriminates against older workers and one that does not. It is the difference between a facial recognition system that operates with impunity and one that faces genuine consequences. It is the difference between a corporate ethics board that exists to absorb criticism and one that has the power to halt a product launch.

The question that matters now is deceptively simple: what does meaningful accountability actually look like in practice? And when enforcement mechanisms fail to materialise in time, who bears the cost?

The Principles Paradox

The proliferation of AI ethics guidelines over the past decade represents one of the most remarkable exercises in global norm-setting since the Universal Declaration of Human Rights. Governments, corporations, academic institutions, and civil society organisations have produced hundreds of frameworks, each articulating some version of the same core commitments. The World Economic Forum has described the challenge as one of “scaling trustworthy AI” by turning ethical principles into tangible practices. The International Labour Organization has reviewed global ethics guidelines specifically for AI in the workplace, finding consistent themes around worker protection and human oversight.

Yet this apparent consensus masks a deeper dysfunction. As research published in Patterns journal noted, while the most advocated ethical principles show significant convergence, there remains “substantive divergence in how these principles are interpreted, why they are deemed important, what issue, domain or actors they pertain to, and how they should be implemented.” In other words, everyone agrees on the words. Nobody agrees on what the words mean in practice.

This is the principles paradox. The more guidelines that exist, the easier it becomes for organisations to claim alignment with ethical AI while doing very little to change their behaviour. The phenomenon has a name: ethics washing. And in 2025 and 2026, it has become a defining feature of the corporate AI landscape.

The United States Securities and Exchange Commission has flagged “AI washing” as an enforcement priority, scrutinising whether company disclosures about artificial intelligence capabilities match actual practices. The SEC and the Department of Justice have already taken action against companies for exaggerating AI capabilities to attract investment. But the problem extends far beyond securities fraud. When a company publishes a set of AI ethics principles, appoints a chief ethics officer, and then deploys systems that systematically discriminate, the principles themselves become a form of camouflage. They provide the appearance of responsibility without the substance of it, a shield against criticism rather than a genuine constraint on conduct.

The most notorious illustration of this dynamic played out at Google in late 2020 and early 2021. Timnit Gebru, co-lead of Google's Ethical AI team, was fired after the company demanded she retract a research paper examining the environmental costs and bias risks of large language models. Three months later, Margaret Mitchell, the team's founder, was also terminated. Roughly 2,700 Google employees and more than 4,300 academics and civil society supporters signed a letter condemning Gebru's departure. Nine members of the United States Congress sent a letter to Google seeking clarification. The paper that triggered the conflict, “On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?“, was subsequently presented at the ACM FAccT conference in March 2021 and has since become one of the most cited works in the field.

The Google episode demonstrated something that has only become clearer with time: internal ethics teams, no matter how credentialed or well-intentioned, cannot function as accountability mechanisms when they exist at the pleasure of the organisations they are meant to constrain. The fox does not appoint its own gamekeeper.

Deployment at Speed, Governance at a Crawl

The numbers tell a stark story. According to ISACA's 2025 global survey of more than 3,200 business and IT professionals, nearly three out of four European IT and cybersecurity professionals reported that staff were already using generative AI at work, a figure that had risen ten percentage points in a single year. Yet only 31 per cent of organisations had a formal, comprehensive AI policy in place. The gap was not closing. It was widening.

The same survey found that 63 per cent of respondents were extremely or very concerned that generative AI could be weaponised against their organisations, while 71 per cent expected deepfakes to grow sharper and more widespread. Despite these anxieties, only 18 per cent of organisations were investing in deepfake detection tools. The pattern is consistent: organisations recognise the risks, articulate concern, and then fail to allocate the resources necessary to address them. A separate finding from the same research revealed that 42 per cent of professionals believed they would need to increase their AI-related skills within six months simply to retain their current position, a figure that had risen eight percentage points from the previous year. The workforce, in other words, is being transformed by AI faster than individuals or institutions can adapt.

Globally, the picture is even more fragmented. A separate analysis found that 94 per cent of global companies reported using or piloting some form of AI in IT operations, while only 44 per cent said their security architecture was fully equipped to support secure AI deployment. More than half of organisations surveyed, 57 per cent, acknowledged that AI was advancing more quickly than they could secure it. The phrase “governance gap” has become a staple of policy discourse, but it undersells the scale of the problem. This is not a gap. It is a chasm.

The Partnership on AI, a multi-stakeholder organisation that includes major technology companies, academic institutions, and civil society groups, identified six governance priorities for 2026. These include responsible adoption of agentic AI systems, improved documentation and transparency standards, governance convergence across jurisdictions, and protections for authentic human voice in an era of synthetic content. The priorities are sensible. They are also an implicit admission that none of these foundations are yet in place, despite years of discussion.

Meanwhile, the technology itself continues to accelerate. Agentic AI systems, which can take autonomous actions in the real world rather than simply generating text or images, introduce what the Partnership on AI describes as “non-reversibility of actions, open-ended decision-making pathways, and privacy vulnerabilities from expanded data access.” These are not theoretical risks. They are features of systems already being deployed in customer service, software development, and financial trading. The governance frameworks meant to constrain these systems are, in many cases, still being drafted. The speed of silicon, as one commentator put it, outpaces the speed of statute.

Regulation Arrives, Eventually

The European Union's AI Act represents the most ambitious attempt to date to translate ethical principles into enforceable law. The legislation entered into force on 1 August 2024, with a phased implementation timeline extending through 2027. Prohibitions on AI systems posing unacceptable risk took effect on 2 February 2025. Obligations for general-purpose AI models became applicable on 2 August 2025. The bulk of requirements for high-risk systems take effect on 2 August 2026, when authorities will gain the power to enforce compliance through administrative fines reaching up to 35 million euros or seven per cent of global annual turnover.

The EU AI Act adopts a tiered, risk-based approach, classifying AI applications from minimal to unacceptable risk. High-risk systems are subject to strict oversight, including conformity assessments, technical documentation, CE marking, transparency requirements, and post-market monitoring. The European AI Office became operational on 2 August 2025, taking on responsibility for supervising and enforcing the Act alongside Member State authorities.

This is, by any measure, a significant regulatory achievement. But it also illustrates the temporal mismatch that defines AI governance. The Act was first proposed by the European Commission in April 2021. It was adopted in March 2024. Full enforcement does not arrive until August 2026 at the earliest, with some provisions extending to 2027. During that five-year legislative journey, the AI landscape transformed beyond recognition. When the Commission drafted its proposal, ChatGPT did not exist. Nor did the current generation of multimodal models, autonomous agents, or AI-powered code generation tools. The regulation is, by design, chasing a target that moved while lawmakers were still aiming.

The situation in the United States presents a different set of challenges entirely. Rather than pursuing comprehensive federal legislation, the US has relied on a decentralised approach combining agency-specific enforcement, voluntary frameworks, and sector-level regulation. The National Institute of Standards and Technology published its AI Risk Management Framework, with a February 2025 revision adding testable controls for continuous monitoring. The Federal Trade Commission and Department of Justice have used existing consumer protection and anti-discrimination statutes to pursue AI-related enforcement actions.

Then, in December 2025, President Donald Trump signed an executive order titled “Ensuring a National Policy Framework for Artificial Intelligence,” which sought to advance what the administration called “a minimally burdensome national policy framework.” The order directed the Attorney General to establish an AI Litigation Task Force to challenge state AI laws deemed inconsistent with federal policy. It instructed the Secretary of Commerce to evaluate existing state AI legislation and identify laws considered “onerous.” It even tied broadband infrastructure funding to compliance, specifying that states with AI laws identified as problematic would be ineligible for certain federal grants.

The order was, in effect, an attempt to pre-empt the patchwork of state-level regulations that had been emerging across the country. Colorado's SB 205, effective February 2026, requires developers and deployers of high-risk AI systems to use reasonable care to protect consumers from algorithmic discrimination, implement risk management policies, and conduct impact assessments. New York City's Local Law 144 had already established bias audit requirements for automated employment decision tools. More than a hundred state AI laws were enacted across the United States in 2025 alone.

Governors in California, Colorado, and New York issued statements indicating the executive order would not stop them from enforcing their existing AI statutes. Legal scholars noted that the administration's ability to restrict state regulation without Congressional action was constitutionally questionable. The result is a governance landscape that is not merely fragmented but actively contested, with federal and state authorities pulling in opposing directions while companies navigate overlapping and sometimes contradictory obligations.

When Enforcement Fails, the Vulnerable Pay

The consequences of the enforcement gap do not fall equally. They concentrate, with brutal predictability, on those with the least power to resist.

In employment, the case of Mobley v. Workday, Inc. illustrates the human cost. Five individuals over the age of forty applied for hundreds of jobs through Workday's automated hiring platform and were rejected in nearly every instance without receiving a single interview. The plaintiffs alleged that Workday's AI recommendation system discriminated on the basis of age. In 2024, a court allowed the disparate impact claim to proceed under the Age Discrimination in Employment Act and the Americans with Disabilities Act, holding that Workday bore liability as an agent of the employers using its product. The case remains one of the most significant tests of whether existing anti-discrimination law can reach the companies that build, rather than merely deploy, algorithmic decision-making tools.

In housing, the SafeRent algorithm case exposed how automated tenant screening can systematically disadvantage Black and Hispanic applicants. Plaintiffs demonstrated that SafeRent's scoring system produced discriminatory outcomes, and the court held that the company bore responsibility because its product claimed to “automate human judgement” by making housing recommendations. SafeRent agreed to pay more than two million dollars to settle the litigation in 2024. The settlement was significant as legal precedent, but for the applicants who were denied housing on the basis of an opaque algorithmic score, the damage was already done.

In biometric surveillance, Clearview AI's trajectory encapsulates the enforcement timeline problem. The company scraped billions of photographs from social media platforms without consent and sold facial recognition services to law enforcement agencies worldwide. In September 2024, the Dutch Data Protection Authority fined Clearview 30.5 million euros for constructing what the agency described as an illegal database. In March 2025, a US federal court approved a class action settlement valued at roughly 51.75 million dollars, structured as a 23 per cent equity stake in the company itself, because Clearview had insufficient assets to pay a traditional cash settlement. The settlement structure was unprecedented in biometric privacy litigation, and its adequacy was contested by a bipartisan group of state attorneys general who filed formal objections.

These cases share a common structure. Harm occurs. Years pass. Legal proceedings unfold. Settlements are reached or fines imposed. But the systems that caused the harm often continue operating during the entire adjudication process, and the individuals affected rarely receive compensation proportional to their injury. The enforcement mechanisms exist, technically. They simply do not work fast enough to prevent the damage they are meant to address.

In consumer markets, similar patterns have emerged. Instacart drew widespread criticism after reports revealed the company was using an AI-powered pricing experiment that displayed different grocery prices to different customers for the same items at the same store. The programme, designed to test price sensitivity, was condemned by consumer advocacy groups and policymakers who argued it constituted algorithmic price discrimination without adequate disclosure. The controversy highlighted a recurring blind spot in AI governance: the gap between what is technically possible and what existing consumer protection frameworks are equipped to regulate.

A study from the University of Washington provided stark evidence of the scale of algorithmic bias in employment contexts. Researchers presented three AI models with job applications that were identical in every respect except the name of the applicant. The models preferred resumes with white-associated names in 85 per cent of cases and those with Black-associated names only 9 per cent of the time. A separate study led by researchers at Cedars-Sinai, published in June 2025, found that leading large language models generated less effective treatment recommendations when a patient's race was identified as African American.

These are not edge cases or hypothetical scenarios. They are documented patterns of discriminatory behaviour embedded in systems that millions of people interact with daily. And they persist not because the ethical principles governing AI are inadequate, but because the mechanisms for enforcing those principles remain woefully underdeveloped.

The Audit Illusion

One of the most commonly proposed solutions to the enforcement gap is algorithmic auditing: the idea that independent third parties can evaluate AI systems for bias, accuracy, and compliance with ethical standards, much as financial auditors examine corporate accounts. The concept has gained significant traction in policy circles. New York City's Local Law 144 requires annual bias audits for automated employment decision tools. Colorado's SB 205 mandates impact assessments for high-risk systems. The EU AI Act requires conformity assessments for high-risk AI applications.

But the AI Now Institute, in a report titled “Algorithmic Accountability: Moving Beyond Audits,” has mounted a detailed critique of the audit-centred approach. The institute argues that technical evaluations “narrowly position bias as a flaw within an algorithmic system that can be fixed and eliminated,” when in fact algorithmic harms are often structural, reflecting the social contexts in which systems are designed and deployed. Audits, the report contends, “run the risk of entrenching power within the tech industry” and “take focus away from more structural responses.”

The critique has substance. Current algorithmic auditing suffers from several fundamental limitations. There are no universally accepted standards for what constitutes a passing score. Audit costs range from 5,000 to 50,000 dollars depending on system complexity, placing the financial burden disproportionately on smaller organisations while allowing well-resourced technology companies to treat audits as a cost of doing business. Audits evaluate systems at a single point in time, but AI models drift as they encounter new data, meaning a system that passes an audit today may produce discriminatory outcomes next month.

Perhaps most critically, audits place the primary burden for algorithmic accountability on those with the fewest resources. Community organisations, civil rights groups, and affected individuals must navigate complex technical and legal processes to challenge algorithmic decisions, while the companies deploying those systems retain control over the data, models, and documentation necessary to evaluate their performance. The information asymmetry is profound and, under current frameworks, largely unaddressed.

The Ada Lovelace Institute, the AI Now Institute, and the Open Government Partnership have partnered to examine alternatives to the audit-centred approach, including algorithm registers, impact assessments, and other transparency measures that distribute accountability more broadly. These efforts are promising but nascent, and they face the same temporal challenge that afflicts all AI governance: by the time robust accountability frameworks are established, the systems they are meant to govern will have evolved.

Geopolitical Fractures and the Sovereignty Question

The enforcement gap is not merely a domestic policy challenge. It is a geopolitical one. The February 2025 AI Action Summit in Paris, co-chaired by French President Emmanuel Macron and Indian Prime Minister Narendra Modi, drew more than 1,000 participants from over 100 countries. Fifty-eight nations signed a joint declaration on inclusive and sustainable artificial intelligence. The United States and the United Kingdom, notably, refused to sign.

France announced a 400 million dollar endowment for a new foundation to support the creation of AI “public goods,” including high-quality datasets and open-source infrastructure. A Coalition for Sustainable AI was launched, backed by France, the United Nations Environment Programme, and the International Telecommunication Union, with support from 11 countries and 37 technology companies. Anthropic CEO Dario Amodei described the summit as a “missed opportunity” for addressing AI safety, reflecting a broader frustration among researchers that international forums produce declarations rather than binding commitments.

The geopolitical dimension becomes even more fraught when considering the position of developing nations. Research from E-International Relations and other academic sources has documented how AI development mirrors historical patterns of colonial resource extraction. Control over data infrastructures, computational resources, and algorithmic systems remains concentrated in a small number of wealthy nations and corporations. Regulatory gaps in many developing countries make the deployment of biased AI systems more likely while preventing communities from taking legal action against discriminatory algorithmic decisions. The environmental costs of AI computation fall disproportionately on these same regions, where data centres proliferate because electricity and land are cheap, exporting the benefits of artificial intelligence while localising its burdens.

The disparity in content moderation illustrates the pattern. Reports have shown that major technology platforms allocate the vast majority of their moderation resources to the Global North, with only a fraction addressing content from other regions. Algorithms deployed without cultural context produce moderation decisions that are at best irrelevant and at worst actively harmful to the communities they affect. When 98 per cent of AI research originates from wealthy institutions, the resulting systems embed assumptions that may be irrelevant or damaging elsewhere.

Some scholars have called for a shift towards what they term “global co-creation,” an approach to AI development that prioritises local participation, data sovereignty, and algorithmic transparency. The concept recognises that meaningful accountability cannot be imposed from outside but must be built through inclusive governance structures that reflect the diverse contexts in which AI systems operate. One hundred and twenty countries representing 85 per cent of humanity, researchers argue, have the collective leverage to insist on these conditions. Whether they will exercise that leverage remains an open question.

Building Accountability That Works

If the current approach to AI governance is inadequate, what would a more effective system look like? The evidence points to several structural requirements that go beyond the familiar call for more principles or better audits.

First, accountability must be anticipatory rather than reactive. The current model waits for harm to occur, then attempts to assign responsibility through litigation or regulatory action. By the time a court rules on an algorithmic discrimination case, the affected individuals may have lost housing, employment, or access to healthcare. Meaningful accountability requires mechanisms that identify and address potential harms before deployment, not after damage has been documented across thousands of decisions.

Second, enforcement must be resourced proportionally to the scale of AI deployment. The ISACA survey finding that only 31 per cent of organisations have comprehensive AI policies is not simply a failure of corporate governance. It reflects a broader reality in which the institutions responsible for oversight, whether regulatory agencies, standards bodies, or civil society organisations, lack the funding, technical expertise, and legal authority to match the pace of industry. The EU AI Office is a start, but its capacity to oversee a technology sector that spans hundreds of thousands of organisations across 27 Member States remains untested.

Third, transparency must extend beyond model documentation to encompass the full chain of AI development and deployment. The Partnership on AI's call for standardised documentation templates and strengthened reporting frameworks is necessary but insufficient. What is needed is a transparency regime that enables affected communities, not just regulators and auditors, to understand how algorithmic decisions are made, what data they rely on, and what recourse is available when those decisions cause harm.

Fourth, the costs of non-compliance must be sufficiently high to alter corporate behaviour. The EU AI Act's fines of up to seven per cent of global annual turnover are significant on paper. Whether they will be enforced consistently, and whether they will prove sufficient to deter violations by companies with revenues in the hundreds of billions, remains to be seen. The history of technology regulation suggests that fines alone are rarely sufficient; structural remedies, including requirements to modify or withdraw harmful systems, are necessary to create genuine accountability.

Fifth, governance frameworks must be designed for iteration, not permanence. The five-year legislative cycle that produced the EU AI Act is incompatible with a technology that transforms every six months. Regulatory approaches must incorporate mechanisms for rapid adaptation, whether through delegated authority, technical standards that can be updated without legislative amendment, or sunset clauses that force periodic reassessment.

None of these requirements are novel. Researchers, civil society organisations, and some regulators have been advocating for them for years. The obstacle is not a lack of ideas but a lack of political will, complicated by the enormous economic interests that benefit from the current arrangement in which deployment runs ahead of governance and the costs of failure are borne by those least equipped to absorb them.

The Cost Ledger

When enforcement mechanisms fail to materialise in time, the costs are distributed with grim predictability. Workers screened out by biased hiring algorithms never know why they were rejected. Tenants denied housing by opaque scoring systems cannot challenge a decision they cannot see. Patients who receive inferior treatment recommendations based on their race are unlikely to discover that an algorithm played a role. Consumers shown different prices for identical goods based on algorithmic profiling have no way to compare their experience against other buyers.

These costs are real but largely invisible, diffused across millions of individual decisions and absorbed by people who lack the resources, information, or institutional support to seek redress. The aggregate effect is a systematic transfer of risk from the organisations that build and deploy AI systems to the individuals and communities that interact with them. That transfer is not an accident. It is the predictable consequence of a governance architecture that prioritises speed of deployment over adequacy of oversight.

The financial scale of the problem is staggering when considered in aggregate. Individual settlements and fines, whether SafeRent's two million dollar payout, Clearview AI's 51.75 million dollar settlement, or the Dutch data authority's 30.5 million euro fine, may appear substantial in isolation. But set against the revenues of the companies deploying these systems and the cumulative harm inflicted on millions of affected individuals, they represent a cost of doing business rather than a meaningful deterrent. The economics of non-compliance remain, for the moment, firmly in favour of deployment first and accountability later.

The question of who bears the cost when accountability fails is, ultimately, a question about power. Those with the resources to influence policy, fund litigation, and shape public discourse are best positioned to protect themselves from algorithmic harm. Those without those resources are not. Until governance frameworks are designed to address that asymmetry directly, rather than assuming that better principles or more audits will suffice, the enforcement gap will persist.

The field of AI ethics has accomplished something genuinely remarkable in building global consensus around core values. That achievement should not be dismissed. But consensus without enforcement is aspiration without consequence. And aspiration without consequence is, in the end, just another way of saying that nobody is responsible.

References and Sources

1. Jobin, A., Ienca, M., and Vayena, E. “Worldwide AI ethics: A review of 200 guidelines and recommendations for AI governance.” Patterns, 2023. Available at: https://www.sciencedirect.com/science/article/pii/S2666389923002416

2. ISACA. “AI Use Is Outpacing Policy and Governance, ISACA Finds.” Press release, June 2025. Available at: https://www.isaca.org/about-us/newsroom/press-releases/2025/ai-use-is-outpacing-policy-and-governance-isaca-finds

3. Partnership on AI. “Six AI Governance Priorities for 2026.” 2026. Available at: https://partnershiponai.org/resource/six-ai-governance-priorities/

4. European Commission. “AI Act: Shaping Europe's Digital Future.” Available at: https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai

5. International Labour Organization. “Governing AI in the World of Work: A Review of Global Ethics Guidelines.” Available at: https://www.ilo.org/resource/article/governing-ai-world-work-review-global-ethics-guidelines

6. World Economic Forum. “Scaling Trustworthy AI: How to Turn Ethical Principles into Tangible Practices.” January 2026. Available at: https://www.weforum.org/stories/2026/01/scaling-trustworthy-ai-into-global-practice/

7. AI Now Institute. “Algorithmic Accountability: Moving Beyond Audits.” Available at: https://ainowinstitute.org/publications/algorithmic-accountability

8. Trump, D. “Ensuring a National Policy Framework for Artificial Intelligence.” Executive Order, December 2025. Available at: https://www.whitehouse.gov/presidential-actions/2025/12/eliminating-state-law-obstruction-of-national-artificial-intelligence-policy/

9. MIT Technology Review. “We Read the Paper That Forced Timnit Gebru Out of Google. Here's What It Says.” December 2020. Available at: https://www.technologyreview.com/2020/12/04/1013294/google-ai-ethics-research-paper-forced-out-timnit-gebru/

10. Quinn Emanuel Urquhart and Sullivan, LLP. “When Machines Discriminate: The Rise of AI Bias Lawsuits.” Available at: https://www.quinnemanuel.com/the-firm/publications/when-machines-discriminate-the-rise-of-ai-bias-lawsuits/

11. Clearview AI Class Action Settlement, Northern District of Illinois. Approved March 2025. Available at: https://clearviewclassaction.com/

12. Dutch Data Protection Authority. Clearview AI fine of EUR 30.5 million, September 2024. Reported by US News and World Report. Available at: https://www.usnews.com/news/business/articles/2024-09-03/clearview-ai-fined-33-7-million-by-dutch-data-protection-watchdog-over-illegal-database-of-faces

13. AI Action Summit, Paris, February 2025. Available at: https://en.wikipedia.org/wiki/AI_Action_Summit

14. E-International Relations. “Tech Imperialism Reloaded: AI, Colonial Legacies, and the Global South.” February 2025. Available at: https://www.e-ir.info/2025/02/17/tech-imperialism-reloaded-ai-colonial-legacies-and-the-global-south/

15. Colorado SB 205 (2024). AI bias audit and risk assessment requirements, effective February 2026.

16. AIhub. “Top AI Ethics and Policy Issues of 2025 and What to Expect in 2026.” March 2026. Available at: https://aihub.org/2026/03/04/top-ai-ethics-and-policy-issues-of-2025-and-what-to-expect-in-2026/

17. Crescendo AI. “27 Biggest AI Controversies of 2025-2026.” Available at: https://www.crescendo.ai/blog/ai-controversies

18. Harvard Journal of Law and Technology. “AI Auditing: First Steps Towards the Effective Regulation of AI.” February 2025. Available at: https://jolt.law.harvard.edu/assets/digestImages/Farley-Lansang-AI-Auditing-publication-2.13.2025.pdf

19. RealClearPolicy. “America's AI Governance Gap Needs Independent Oversight.” April 2026. Available at: https://www.realclearpolicy.com/articles/2026/04/03/americas_ai_governance_gap_needs_independent_oversight_1174471.html

20. Cedars-Sinai study on LLM treatment recommendation bias by patient race. Published June 2025. Reported in multiple sources.

21. Ada Lovelace Institute, AI Now Institute, and Open Government Partnership. “Algorithmic Accountability for the Public Sector.” Available at: https://www.adalovelaceinstitute.org/project/algorithmic-accountability-public-sector/

22. Infosecurity Magazine. “Two-Thirds of Organizations Failing to Address AI Risks, ISACA Finds.” Available at: https://www.infosecurity-magazine.com/news/failing-address-ai-risks-isaca/

---

Tim Green UK-based Systems Theorist & Independent Technology Writer

Tim explores the intersections of artificial intelligence, decentralised cognition, and posthuman ethics. His work, published at smarterarticles.co.uk, challenges dominant narratives of technological progress while proposing interdisciplinary frameworks for collective intelligence and digital stewardship.

His writing has been featured on Ground News and shared by independent researchers across both academic and technological communities.

ORCID: 0009-0002-0156-9795 Email: tim@smarterarticles.co.uk

Discuss...

The promise was straightforward enough. Large language models, trained on the sum total of medical literature, would help emergency physicians triage patients faster, assist radiologists in catching what the human eye missed, and give overwhelmed clinicians a second opinion when the waiting room was full and the clock was running. The reality, according to a growing body of peer-reviewed research, is considerably more uncomfortable. The most capable AI systems available today do not simply reflect the biases embedded in their training data. They amplify them, sometimes dramatically, and they do so in clinical contexts where the consequences land on real human bodies.

In September 2025, a team of researchers led by Mahmud Omar and Eyal Klang at the Icahn School of Medicine at Mount Sinai posted a preprint on medRxiv that tested OpenAI's GPT-5 across 500 physician-validated emergency department vignettes. Each case was replayed 32 times, with the only variable being the sociodemographic label attached to the patient: Black, white, low-income, high-income, LGBTQIA+, unhoused, and so on. The clinical details remained identical. The model's recommendations did not.

GPT-5 showed no improvement in sociodemographic-linked decision variation compared with its predecessor, GPT-4o. On several measures, it was worse. The model assigned higher urgency and recommended less advanced testing for historically marginalised groups. Most striking was the mental health screening disparity: several LGBTQIA+ labels were flagged for mental health evaluation in 100 per cent of cases, compared with roughly 41 to 73 per cent for comparable demographic groups under GPT-4o. The clinical presentation was the same. The only thing that changed was who the patient was described as being.

This is not a theoretical problem. It is a design problem, a procurement problem, and increasingly a legal problem. And it raises a question that hospitals, insurers, and diagnostic tool developers have been remarkably slow to answer: if the most advanced AI model on the market still encodes the biases of the data it was trained on, what exactly are institutions assuming when they plug these systems into patient care?

The Evidence Is Not Subtle

The Mount Sinai findings did not emerge from a vacuum. They are the latest in a pattern of research that has been building for years, each study confirming what the last one suggested and what the next one will almost certainly reinforce.

The same research team published a broader companion study in Nature Medicine in 2025, evaluating nine large language models across more than 1.7 million model-generated outputs from 1,000 emergency department cases (500 real, 500 synthetic). Each case was presented in 32 variations, covering 31 sociodemographic groups plus a control, while clinical details were held constant. Cases labelled as Black, unhoused, or LGBTQIA+ were more frequently directed toward urgent care, invasive interventions, or mental health evaluations. Certain LGBTQIA+ subgroups were recommended mental health assessments approximately six to seven times more often than was clinically indicated. The bias was not confined to one model or one developer. It was a property of the category.

In 2024, Travis Zack and colleagues published a model evaluation study in The Lancet Digital Health examining GPT-4's behaviour across clinical applications including medical education, diagnostic reasoning, clinical plan generation, and subjective patient assessment. The results were damning. GPT-4 failed to model the demographic diversity of medical conditions, instead producing clinical vignettes that stereotyped demographic presentations. When generating differential diagnoses, the model was more likely to include diagnoses that stereotyped certain races, ethnicities, and genders. It exaggerated known demographic prevalence differences in 89 per cent of diseases tested. Assessment and treatment plans showed significant associations between demographic attributes and recommendations for more expensive procedures, as well as measurable differences in how patients were perceived. For 23 per cent of cases, GPT-4 produced significantly different patient perception responses based solely on gender or race and ethnicity.

The broader research landscape tells a consistent story. A systematic review published in 2025 in the International Journal for Equity in Health, encompassing 24 studies evaluating demographic disparities in medical large language models, found that 22 of those studies, or 91.7 per cent, identified biases. Gender bias was the most prevalent, reported in 15 of 16 studies examining it (93.7 per cent). Racial or ethnic biases appeared in 10 of 11 studies (90.9 per cent). These are not edge cases. They are the norm.

And the problem extends well beyond language models. In dermatology, AI models trained primarily on lighter skin tones have consistently shown lower diagnostic performance for lesions on darker skin. A 2025 study in the Journal of the European Academy of Dermatology and Venereology found that among 4,000 AI-generated dermatological images, only 10.2 per cent depicted dark skin, and just 15 per cent accurately represented the intended condition. Meanwhile, analyses of dermatology textbooks used to train both human clinicians and AI systems have shown that images of dark skin make up as little as 4 to 18 per cent of the total. A 2022 study published in Science Advances confirmed that AI diagnostic performance for dermatological conditions was measurably worse on darker skin tones, a disparity directly traceable to training data composition.

The consequences are not abstract. Individuals with darker skin tones who develop melanoma are more likely to present with advanced-stage disease and experience lower survival rates. An AI system that performs poorly on these patients does not merely fail a technical benchmark. It compounds an existing disparity. And a 2024 study from Northwestern University found that even when AI tools themselves were calibrated for fairness, the interaction between physicians and AI-assisted diagnosis actually widened the accuracy gap between patients with light and dark skin tones, suggesting that the problem cannot be solved at the algorithm level alone.

When Machines Hallucinate in the Emergency Room

Bias is not the only vulnerability. In August 2025, a study published in Communications Medicine, a Nature Portfolio journal, tested six leading large language models with 300 clinician-designed vignettes, each containing a single fabricated element: a fake lab value, a nonexistent sign, or an invented disease. The results were striking. The models repeated or elaborated on the planted error in up to 83 per cent of cases. A simple mitigation prompt halved the overall hallucination rate, from a mean of 66 per cent across all models to 44 per cent. For the best-performing model in the study, GPT-4o, rates declined from 53 per cent to 23 per cent. Temperature adjustments, often proposed as a fix for hallucination, offered no significant improvement. Shorter vignettes showed slightly higher odds of hallucination.

For GPT-5 specifically, the Mount Sinai preprint found that its unmitigated adversarial hallucination rate was higher than that observed for GPT-4o. The same mitigation technique achieved a lower rate than before, meaning the baseline risk was worse even as the ceiling for improvement was slightly better.

The clinical implications are severe. If a language model is deployed as a clinical decision support tool and a patient's record contains an erroneous data point, whether through transcription error, system glitch, or adversarial input, the model is more likely to incorporate that error into its reasoning than to flag it as anomalous. It will confabulate around the mistake, generating plausible-sounding but clinically dangerous recommendations. The model does not know what it does not know, and it cannot distinguish between a real lab result and a fabricated one.

This is not a bug that can be patched with a software update. It is a structural property of how these models process information. They are optimised to produce coherent, contextually appropriate text, not to distinguish between real clinical findings and fabricated ones. The distinction matters enormously when the output influences whether a patient receives a chest X-ray or is sent home.

Who Bears the Cost

The populations most affected by AI bias in healthcare are, with grim predictability, those who already face the greatest barriers to adequate care. Racial minorities, women, elderly patients, LGBTQIA+ individuals, people experiencing homelessness, and low-income populations appear repeatedly in the literature as groups for whom AI systems produce systematically different, and often inferior, clinical recommendations.

The Mount Sinai study found a clear socioeconomic gradient in testing recommendations. GPT-5 directed less advanced diagnostic testing toward lower-income groups, with a negative 7.0 per cent deviation for low-income patients and a negative 6.8 per cent deviation for middle-income patients, while high-income patients received a positive 2.2 per cent deviation. Same symptoms, different workups, determined entirely by a label the model should have been ignoring.

The pulse oximetry debacle offers a useful precedent for understanding how bias in medical technology compounds racial health disparities. Research published in the New England Journal of Medicine demonstrated that pulse oximeters systematically overestimated blood oxygen levels in Black patients, with the frequency of occult hypoxaemia that went undetected being three times greater among Black patients compared with white patients. During the COVID-19 pandemic, this meant Black patients were less likely to receive supplemental oxygen when they needed it. The FDA released new draft guidance in January 2025 with updated testing standards, recommending a minimum of 24 subjects from across the Monk Skin Tone scale for clinical studies. But the damage from years of deployment with known racial bias had already been done. As Health Affairs Forefront noted in January 2025, the imperative to develop cross-racial pulse oximeters was “overdue” by any reasonable measure.

The pattern is consistent: a technology is developed, tested primarily on populations that do not represent the full range of patients who will encounter it, deployed at scale, and then studied retrospectively when the harm becomes impossible to ignore. AI in healthcare is following this trajectory with remarkable fidelity.

Sepsis prediction offers another cautionary tale. Epic Systems deployed its widely used Epic Sepsis Model across hundreds of hospitals. When researchers at Michigan Medicine analysed roughly 38,500 hospitalisations, they found the algorithm missed two-thirds of sepsis patients and generated numerous false alerts. A 2025 study published in the American Journal of Bioethics highlighted that social determinants of health data, which disproportionately affect minority and low-income populations, were notoriously underrepresented in the electronic health record data used to train such models, with only 3 per cent of sentences in examined training datasets containing any mention of social determinants. The algorithm did not account for what it could not see, and what it could not see was shaped by who had historically been rendered invisible in medical data systems.

The Institutional Wager

When a hospital system integrates AI into its clinical workflows, it is making a bet. The bet is that the efficiency gains, the reduced clinician workload, and the potential for catching diagnoses that might otherwise be missed will outweigh the risks of systematic error. It is a bet that the tool will perform roughly as well for all patients, or at least that any disparities will be caught by the human clinicians who remain in the loop.

Both assumptions are questionable.

Epic Systems, which commands 42.3 per cent of the acute care electronic health record market in the United States with over 305 million patient records, has rolled out generative AI enhancements for clinical messaging, charting, and predictive modelling. By 2025, the company reported between 160 and 200 active AI projects, with over 150 AI features in development for 2026, including native AI-assisted charting tools, new AI assistants, and advanced predictive models. In February 2026, Epic launched AI Charting, an ambient scribe feature that listens to patient visits and automatically drafts clinical notes and orders. Oracle Health, following its acquisition of Cerner, debuted an entirely new AI-powered EHR in 2025, featuring a clinical AI agent that drafts documentation, proposes lab tests and follow-up visits, and automates coding. The agent is now live across more than 30 medical specialities and has reportedly reduced physician documentation time by nearly 30 per cent.

The efficiency argument is real. But efficiency and equity are not the same thing. When these systems produce different outputs based on demographic characteristics, as the peer-reviewed evidence consistently shows they do, the “human in the loop” defence becomes critical. It also becomes fragile. A clinician reviewing AI-generated notes under time pressure, in a system designed to reduce their workload, is not in an ideal position to catch the subtle ways in which the model's recommendations may have been shaped by the patient's race, gender, or income level rather than their clinical presentation.

The assumption that humans will catch AI errors is further undermined by automation bias, the well-documented tendency for people to defer to automated systems, particularly when those systems present their outputs with confidence and fluency. A November 2024 study examining pathology experts found that AI integration, while improving overall diagnostic performance, resulted in a 7 per cent automation bias rate where initially correct evaluations were overturned by erroneous AI advice. A separate study of gastroenterologists using AI tools found measurable deskilling over time: clinicians became less proficient at identifying polyps independently after a period of AI-assisted practice. A large language model does not hedge. It does not say “I am less certain about this recommendation because the patient is Black.” It produces a clean, authoritative-sounding clinical note, and the bias is invisible unless someone is specifically looking for it.

The Insurance Question

The integration of AI into healthcare is not limited to clinical decision-making. Insurers have been among the most aggressive adopters, and the consequences are already being litigated.

UnitedHealth Group, the largest health insurer in the United States, is facing a class-action lawsuit alleging that its AI tool, nH Predict, developed by its subsidiary naviHealth (acquired in 2020 for over one billion dollars), was used to systematically deny medically necessary coverage for post-acute care. The plaintiffs, who include Medicare Advantage policyholders, allege that the algorithm superseded physician judgment and had a 90 per cent error rate, meaning nine of ten appealed denials were ultimately reversed.

In February 2025, a federal court denied UnitedHealth's motion to dismiss, allowing breach of contract and good faith claims to proceed. The court noted that the case turned on whether UnitedHealth had violated its own policy language, which stated that coverage decisions would be made by clinical staff or physicians, not by an algorithm. A judge subsequently ordered UnitedHealth to produce tens of thousands of internal documents related to the algorithm's deployment by April 2025.

This case is significant not only for its specific allegations but for the structural question it raises. When an insurer deploys an AI system to make coverage decisions, and that system denies care at scale, who is accountable? The algorithm's developers? The insurer's management? The clinicians whose judgment the algorithm overrode? The regulatory framework has no clear answer, and in the absence of clarity, the cost falls on the patients who are denied coverage and must navigate an appeals process that many, particularly elderly and low-income individuals, are ill-equipped to pursue. The asymmetry is stark: the insurer benefits from the speed and scale of algorithmic denial, while the patient bears the burden of proving, one appeal at a time, that the machine was wrong.

The Regulatory Vacuum

Regulatory bodies are aware of the problem. Their responses have been uneven at best.

The United States Food and Drug Administration has authorised over 1,250 AI-enabled medical devices as of July 2025, up from 950 in August 2024. The pace of authorisation is accelerating even as the evidence of bias accumulates. The agency published draft guidance in January 2025 on lifecycle management for AI-enabled devices, introducing the concept of Predetermined Change Control Plans, which allow developers to obtain pre-approval for planned algorithmic updates. This is a meaningful step toward continuous monitoring. But the guidance focuses primarily on safety and effectiveness in technical terms, with limited attention to the question of whether a device performs equitably across demographic groups.

In June 2025, a report published in PLOS Digital Health, authored by researchers from the University of Toronto, MIT, and Harvard, laid bare the scale of the regulatory gap. Titled “The Illusion of Safety,” the report found that many AI-enabled tools were entering clinical use without rigorous evaluation or meaningful public scrutiny. Critical details such as testing procedures, validation cohorts, and bias mitigation strategies were often missing from approval submissions. The authors identified inconsistencies in how the FDA categorises and approves these technologies, and noted that AI's continuous learning capabilities introduce unique risks: algorithms evolve beyond their initial validation, potentially leading to performance degradation and biased outcomes that the current regulatory framework is not designed to detect.

In January 2026, the FDA released further guidance that actually reduced oversight of certain low-risk digital health products, including AI-enabled software and clinical decision support tools. The reasoning was that lighter regulation would encourage innovation. The concern is that it will also encourage deployment without adequate bias testing. The tension between promoting innovation and protecting patients is not new in medical device regulation, but the speed at which AI tools are proliferating makes the stakes unusually high.

The European Union has taken a more structured approach. Under the EU AI Act, which began phased implementation in August 2025, AI systems used as safety components in medical devices are classified as high-risk and subject to stringent requirements: risk management systems, technical documentation, training data governance, transparency, human oversight, and post-market monitoring. Full compliance for high-risk AI systems in healthcare is required by August 2027. The framework is more comprehensive than its American counterpart, but enforcement mechanisms remain untested, and the practical challenge of auditing AI systems for demographic bias at scale is formidable. The European Commission is expected to issue guidelines on practical implementation of high-risk classification by February 2026, including examples of what constitutes high-risk and non-high-risk use cases.

The World Health Organisation released guidance in January 2024 on the ethics and governance of large multimodal models in healthcare, outlining over 40 recommendations organised around six principles: protecting autonomy, promoting well-being and safety, ensuring transparency and explainability, fostering responsibility and accountability, ensuring inclusiveness and equity, and promoting responsive and sustainable AI. The principles are sound. Whether they translate into enforceable standards is another matter entirely. The WHO's Global Initiative on Artificial Intelligence for Health has been working to advance governance frameworks particularly in low- and middle-income countries, where the regulatory infrastructure to evaluate AI tools may be even less developed than in the United States or Europe.

The gap between what regulators recognise as a problem and what they are prepared to do about it remains wide. And in that gap, hospitals and insurers continue to deploy systems whose bias profiles have been documented in peer-reviewed literature but not addressed in procurement requirements.

Accountability Without a Framework

The liability question is perhaps the most unsettled aspect of AI in healthcare. Current legal frameworks were not designed for systems that learn, change, and produce different outputs for different patients based on patterns in training data that no human selected or reviewed.

If an AI clinical decision support tool recommends a less aggressive workup for a Black patient than for a white patient with identical symptoms, and the Black patient's condition is missed, who is liable? The developer who trained the model? The hospital that purchased and deployed it? The clinician who accepted the recommendation without questioning it? Under existing product liability regimes, device manufacturers are often shielded, and the burden tends to fall on clinicians and institutions. But clinicians did not design the algorithm, may not understand its internal workings, and in many cases were not consulted about the decision to deploy it.

Professional medical societies have generally maintained that clinicians retain ultimate responsibility for patient care, regardless of the tools they use. This position is legally and ethically coherent, but it places an extraordinary burden on individual practitioners to detect and override biases that are, by design, invisible in the model's outputs. It also creates a perverse incentive structure: the institutions that benefit from AI efficiency (reduced labour costs, faster throughput, fewer staff) externalise the liability risk to frontline clinicians who had no say in the technology's selection or implementation.

New legislation has been proposed in the United States to clarify AI liability in healthcare, but none has yet been enacted. The result is a regulatory and legal environment in which the technology is advancing faster than the frameworks meant to govern it, with patients and clinicians left to absorb the consequences of that mismatch.

What Meaningful Reform Requires

The research community has not merely identified the problem. It has outlined what solutions would look like. The challenge is that those solutions require effort, money, and institutional will that the current market incentives do not reliably produce.

First, training data must be representative. The persistent underrepresentation of dark-skinned patients in dermatological datasets, of women in cardiovascular research, and of LGBTQIA+ individuals in clinical trial data is not a new problem. But when that data is used to train AI systems that are then deployed at scale, the bias is industrialised. Studies have demonstrated that fine-tuning AI models on diverse datasets closes performance gaps between demographic groups. The data exists, or could be collected. The question is whether developers and institutions are willing to invest in obtaining it.

Second, pre-deployment bias auditing must become mandatory, not optional. The evidence that AI systems produce systematically different outputs based on demographic labels is overwhelming. Yet there is no requirement in the United States that an AI clinical tool be tested for demographic equity before it is integrated into a hospital's workflow. The EU AI Act moves in this direction with its training data governance and risk management requirements for high-risk systems, but enforcement remains a future proposition.

Third, post-deployment monitoring must be continuous and transparent. The FDA's introduction of Predetermined Change Control Plans is a step toward lifecycle accountability, but the focus remains on technical safety rather than equitable performance. An AI system that performs well on average but poorly for specific subpopulations is not safe for those subpopulations, and average performance metrics can obscure the disparity. The “Illusion of Safety” report's finding that the FDA's current framework is ill-equipped to monitor post-approval algorithmic drift makes this point with particular force.

Fourth, procurement processes must include bias testing as a criterion. Hospitals that would never purchase a pharmaceutical product without evidence of efficacy across demographic groups are integrating AI tools with no comparable requirement. The Mount Sinai research provides a template: test the system across sociodemographic labels, measure the variation, and make the results public before deployment. If a model produces different triage recommendations for patients labelled as low-income versus high-income, that information should be available to every hospital considering its adoption.

Fifth, liability frameworks must be updated. If AI systems are going to influence clinical decisions, the legal structures governing those decisions must account for the technology's role. This means clearer allocation of responsibility between developers, deployers, and users, and it means creating mechanisms for patients to seek redress when biased AI contributes to harm. The UnitedHealth litigation may ultimately push courts to establish precedents, but waiting for case law to fill a regulatory void is not a strategy; it is an abdication.

Finally, transparency must become the default. Patients have a right to know when AI has influenced their care, what role it played, and whether the system has been tested for bias relevant to their demographic group. This is not merely an ethical aspiration. In an era when AI-generated clinical notes may shape everything from triage decisions to insurance coverage, it is a basic requirement of informed consent. The WHO's guidance on transparency and explainability points in this direction, but voluntary principles are no substitute for binding obligations.

The Stakes Are Not Abstract

The title of the Mount Sinai medRxiv preprint captures the situation with precision: “New Model, Old Risks.” GPT-5 is, by most technical measures, a more capable system than its predecessors. It is also, by the evidence of this study, no less biased. The assumption that capability and fairness would advance in parallel has not been borne out. And the assumption that human oversight will compensate for algorithmic bias is not supported by what we know about how clinicians interact with automated systems under real-world conditions.

The institutions deploying these tools are making a calculation. They are betting that the benefits will outweigh the harms, that the efficiencies will justify the risks, and that the populations most likely to be harmed by biased AI are the same populations least likely to have the resources to hold anyone accountable.

That calculation may prove correct in the short term. In the longer term, it is the kind of institutional wager that generates class-action lawsuits, regulatory backlash, and, most importantly, measurable harm to patients who came to the healthcare system seeking help and received instead the outputs of a machine that treated their identity as a clinical variable.

The question is not whether AI will be integrated into healthcare. That integration is already underway, at scale, across the world's largest health systems. The question is whether the institutions driving that integration will treat equity as a design requirement or as an afterthought. The research is clear on what the problem is and how severe it remains. The gap between what we know and what we are willing to do about it is where the harm lives.

References

1. Omar, M., Agbareia, R., Apakama, D.U., Horowitz, C.R., Freeman, R., Charney, A.W., Nadkarni, G.N., and Klang, E. “New Model, Old Risks? Sociodemographic Bias and Adversarial Hallucinations Vulnerability in GPT-5.” medRxiv, September 2025. DOI: 10.1101/2025.09.19.25336180.

2. Omar, M., Klang, E., et al. “Sociodemographic biases in medical decision making by large language models.” Nature Medicine, 2025. DOI: 10.1038/s41591-025-03626-6.

3. Zack, T., et al. “Assessing the potential of GPT-4 to perpetuate racial and gender biases in health care: a model evaluation study.” The Lancet Digital Health, January 2024. DOI: 10.1016/S2589-7500(23)00225-X.

4. “Multi-model assurance analysis showing large language models are highly vulnerable to adversarial hallucination attacks during clinical decision support.” Communications Medicine (Nature Portfolio), August 2025. DOI: 10.1038/s43856-025-01021-3.

5. “Evaluating and addressing demographic disparities in medical large language models: a systematic review.” International Journal for Equity in Health, Springer Nature, 2025. DOI: 10.1186/s12939-025-02419-0.

6. “Sociodemographic bias in clinical machine learning models: a scoping review of algorithmic bias instances and mechanisms.” Journal of Clinical Epidemiology, 2024. DOI: 10.1016/j.jclinepi.2024.111422.

7. Joerg, et al. “AI-generated dermatologic images show deficient skin tone diversity and poor diagnostic accuracy: An experimental study.” Journal of the European Academy of Dermatology and Venereology, 2025. DOI: 10.1111/jdv.20849.

8. “Disparities in dermatology AI performance on a diverse, curated clinical image set.” Science Advances, 2022. DOI: 10.1126/sciadv.abq6147.

9. Sjoding, M.W., et al. “Racial Bias in Pulse Oximetry Measurement.” New England Journal of Medicine, 2020. DOI: 10.1056/NEJMc2029240.

10. “The Overdue Imperative of Cross-Racial Pulse Oximeters.” Health Affairs Forefront, January 2025.

11. “Bias in medical AI: Implications for clinical decision-making.” PMC, 2024. PMCID: PMC11542778.

12. “The Algorithmic Divide: A Systematic Review on AI-Driven Racial Disparities in Healthcare.” PubMed, 2024. PMID: 39695057.

13. “The illusion of safety: A report to the FDA on AI healthcare product approvals.” PLOS Digital Health, June 2025. DOI: 10.1371/journal.pdig.0000866.

14. Estate of Gene B. Lokken et al. v. UnitedHealth Group, Inc. et al. Federal court ruling, February 2025. Georgetown Health Care Litigation Tracker.

15. U.S. Food and Drug Administration. “Artificial Intelligence-Enabled Device Software Functions: Lifecycle Management and Marketing Submission Recommendations.” Draft Guidance, January 2025.

16. U.S. Food and Drug Administration. “Artificial Intelligence and Machine Learning in Software as a Medical Device.” FDA AI/ML Device Database, July 2025.

17. European Commission. “EU AI Act: Regulatory Framework for Artificial Intelligence.” Phased implementation beginning August 2025, with full high-risk compliance required by August 2027.

18. World Health Organisation. “Ethics and governance of artificial intelligence for health: Guidance on large multi-modal models.” January 2024. ISBN: 9789240084759.

19. “Bias recognition and mitigation strategies in artificial intelligence healthcare applications.” npj Digital Medicine, 2025. DOI: 10.1038/s41746-025-01503-7.

20. “Automation Bias in AI-Assisted Medical Decision-Making under Time Pressure in Computational Pathology.” arXiv, November 2024. arXiv:2411.00998.

21. “Exploring the risks of automation bias in healthcare artificial intelligence applications: A Bowtie analysis.” ScienceDirect, 2024. DOI: 10.1016/j.caeai.2024.100241.

22. “Mitigating Bias in Machine Learning Models with Ethics-Based Initiatives: The Case of Sepsis.” American Journal of Bioethics, 2025. DOI: 10.1080/15265161.2025.2497971.

23. Wong, A., et al. “External Validation of a Widely Implemented Proprietary Sepsis Prediction Model in Hospitalized Patients.” JAMA Internal Medicine, 2021. (Epic Sepsis Model evaluation at Michigan Medicine.)

24. Epic Systems. AI Charting and generative AI clinical tools deployment, February 2026. Epic Newsroom.

25. Oracle Health. Clinical AI Agent deployment across 30+ medical specialities, 2025. Oracle Health press materials.

26. “Gender and racial bias unveiled: clinical artificial intelligence (AI) and machine learning (ML) algorithms are fanning the flames of inequity.” Oxford Open Digital Health, 2025. DOI: 10.1093/oodh/oqaf027.

---

Tim Green UK-based Systems Theorist & Independent Technology Writer

Tim explores the intersections of artificial intelligence, decentralised cognition, and posthuman ethics. His work, published at smarterarticles.co.uk, challenges dominant narratives of technological progress while proposing interdisciplinary frameworks for collective intelligence and digital stewardship.

His writing has been featured on Ground News and shared by independent researchers across both academic and technological communities.

ORCID: 0009-0002-0156-9795 Email: tim@smarterarticles.co.uk

Discuss...

In January 2026, Kristalina Georgieva, the Managing Director of the International Monetary Fund, stood before an audience at the World Economic Forum in Davos and offered a statistic that landed with the quiet brutality of a footnote in a corporate restructuring memo. The number of translators and interpreters at the IMF, she said, had dropped from 200 to 50. The cause was not a budget crisis or a policy realignment. It was technology. The fund had simply decided that machines could handle most of the work that humans used to do.

Georgieva presented the figure as evidence of a broader transformation. Forty per cent of global jobs, she argued, would be transformed or eliminated by artificial intelligence, with that figure climbing to 60 per cent in advanced economies. But it was the specificity of the translation example that stuck. This was not a hypothetical projection or an economist's forecast. It was a headcount. Real people, with real expertise in the precise rendering of financial policy across languages and cultures, had been replaced by systems that could approximate their output at a fraction of the cost.

The IMF is not alone. Across the global translation industry, now valued at an estimated 31.70 billion US dollars according to Slator's 2025 Language Industry Market Report, a similar pattern is playing out. Large language models and neural machine translation systems have not simply made human translators obsolete. They have restructured the profession from the inside, converting skilled practitioners into quality controllers for text they did not write. The question this raises is not whether AI can translate. It demonstrably can, often to a standard that passes casual inspection. The question is what happens to a profession, and to the cultural knowledge it carries, when the market decides that “good enough” is good enough.

The Numbers Behind the Quiet Collapse

A 2024 survey conducted by the United Kingdom's Society of Authors, which polled 787 of its 12,500 members, found that 36 per cent of translators had already lost work to generative AI. Forty-three per cent reported a decrease in income as a direct result of the technology. Over three-quarters, some 77 per cent, believed that generative AI would negatively affect their future earnings. Eighty-six per cent expressed concern that the use of generative AI devalues human-made creative work. These are not projections. They are reports from working professionals describing what has already happened to their livelihoods.

The income data from individual translators is more granular and more alarming. Brian Merchant, writing in his newsletter Blood in the Machine, documented cases across the profession in mid-2025. One technical translator with 15 years of experience reported earning just 8,000 euros in 2025, down from six figures in previous years. A French-English translator based in Quebec described a 60 per cent income decline in 2024, with projections suggesting an 80 per cent drop from peak earnings by the end of 2025. An Italian-English translator in Rome reported that work requests had ceased entirely for the month of June 2025, after years of working 50 to 60 hours per week. An English-Portuguese translator documented that post-editing rates had collapsed from 0.04 euros to 0.02 euros per source word, halving the already modest compensation for correcting machine output.

In the United States, Andy Benzo, president of the American Translators Association, told CNN in January 2026 that many translators were leaving the profession entirely. Benzo noted that the risks of using AI translation in “high-stakes” fields remain “humongous,” yet the exodus continues regardless. Ian Giles, chair of the Translators Association at the UK's Society of Authors, confirmed the same pattern, noting that translators were seeking retraining “because translation isn't generating the income it previously did.” The exits are not dramatic. There are no picket lines or public protests. People are simply disappearing from a profession that can no longer sustain them.

The scale of this workforce is not trivial. There are approximately 640,000 professional translators globally, and three out of four are freelancers. It is this freelance majority that has borne the brunt of the disruption, lacking the institutional protections and guaranteed workloads that might have cushioned the blow.

A study published in 2025 by Carl Benedikt Frey and Pedro Llanos-Paredes at the Oxford Martin School quantified the scale of displacement with unusual precision. Analysing variation in Google Translate adoption across 695 local labour markets in the United States, the researchers found that a one percentage point increase in the use of Google Translate corresponded to a 0.71 percentage point reduction in translator employment growth. The cumulative effect, they estimated, amounted to more than 28,000 fewer translator positions created over the period from 2010 to 2023. And that figure captures only the impact of a single, relatively crude machine translation tool that preceded the large language model era. The arrival of systems like GPT-4, Claude, and Gemini has accelerated the process enormously, because these models do not just translate. They handle idiomatic expression, register, and contextual nuance at a level that earlier statistical systems could not approach.

In July 2025, Microsoft researchers published a study examining which occupations were most exposed to generative AI capabilities. Translators and interpreters ranked first on the list, with 98 per cent of their work activities overlapping with tasks that AI systems could perform with relatively high completion rates. The study analysed 200,000 real-world conversations between users and Microsoft's Copilot system to arrive at its rankings. The researchers were careful to note that high exposure does not automatically mean elimination. But the practical effect has been unmistakable. Employers have used the availability of AI translation as justification for cutting rates, reducing headcounts, and restructuring workflows around machine output.

From Translator to Post-Editor

The restructuring of translation work follows a pattern that is becoming familiar across AI-affected professions. The human does not vanish. Instead, they are repositioned downstream in the production process, tasked with reviewing and correcting output that a machine generated in seconds. In the translation industry, this workflow is known as Machine Translation Post-Editing, or MTPE, and it has rapidly become the dominant model for commercial translation work.

According to Slator's 2025 survey of the language industry, 60 per cent of all respondents were using machine translation, with adoption reaching 80 per cent among language service providers. Among those using machine translation or large language models, between 90 and 98 per cent performed some level of post-editing on AI-generated content. Eighty-four per cent of language service integrators reported that clients had specifically requested human editing services to review AI-generated translations. The human, in other words, has not been removed from the process. But the nature of their involvement has been fundamentally altered. They are no longer creating. They are correcting.

The compensation reflects this downgrade. Post-editing rates typically fall between 50 and 70 per cent of standard translation rates, with some agencies offering as little as 25 per cent of what a full human translation would command. Industry data from 2025 indicates that MTPE work commands between 0.05 and 0.15 US dollars per word, compared with 0.15 to 0.30 dollars per word for standard human translation. One translator documented by Equal Times, an international labour news platform, described pre-translated segments paying just 30 to 50 per cent of original rates, while fully automated platforms paid up to seven times less than standard. The economic logic is straightforward. If the machine does 80 per cent of the work, the reasoning goes, then the human should be paid for only 20 per cent. What this calculation ignores is that post-editing often requires comparable time and cognitive effort to translation from scratch, because the translator must not only identify errors but also understand the systematic patterns of how the AI fails and where its confidence is misplaced.

The workflow itself has been transformed in ways that strip autonomy from the translator. Texts no longer arrive as clean source documents to be rendered thoughtfully into a target language. They arrive pre-segmented, with machine-generated suggestions already populating each segment. The translator's task becomes one of triage: deciding which suggestions are acceptable, which need modification, and which must be discarded entirely. Automated platforms distribute this work via alerts that give translators minutes or even seconds to claim individual segments, creating a piecework dynamic more reminiscent of a fulfilment warehouse than a skilled profession. Some platforms threaten automatic disconnection for translators who dispute corrections imposed by quality-assurance algorithms.

Jean-Jacques, a 30-year veteran translator quoted by Equal Times, described the shift bluntly. “It's not really a matter of translating anymore,” he said, “but revising and correcting the segments proposed by the machine.” Another translator, identified as Alina, captured the paradox at the heart of the arrangement. “AI is both a tool and a threat,” she said. “We ourselves are teaching it how to translate, how to improve.” Each correction a post-editor makes feeds back into the training data that will make the next generation of AI translation marginally better, and the human's role marginally less essential.

This dynamic, in which skilled workers are conscripted into training their own replacements, is not unique to translation. It has appeared in content moderation, coding, and legal document review. But in translation, the irony is particularly sharp, because the expertise being extracted is precisely the kind that AI systems struggle most to develop on their own: cultural sensitivity, tonal awareness, and the ability to navigate the space between what a text says and what it means.

What Machines Cannot Feel

The case for human translation has always rested on something more than accuracy. It rests on the claim that translation is an interpretive act, a creative negotiation between two linguistic and cultural systems that requires not just knowledge but judgement. Jhumpa Lahiri, the Pulitzer Prize-winning novelist who has written extensively about translation, describes the process as “a radical act of reshaping text and self.” In her essay collection Translating Myself and Others, published by Princeton University Press in 2022, Lahiri argues that “a translator restores the meaning of a text by means of an elaborate, alchemical process that requires imagination, ingenuity, and freedom.”

This is not the language of quality assurance. It is the language of craft, of a practice that involves the translator's full intellectual and emotional engagement with a text. Emily Wilson, the first woman to translate Homer's Odyssey into English, has spoken repeatedly about the impossibility of separating linguistic from cultural knowledge in translation. The hardest part of translation, she has argued, is not understanding the original but “figuring out how to create it entirely from scratch in a totally different language and culture.” Wilson's translation of the Odyssey was widely praised precisely because it made choices that no algorithm would make: tonal decisions, rhythmic choices, and interpretive framings that reflected not just the Greek text but Wilson's own understanding of what the poem means to contemporary English-speaking readers.

Gregory Rabassa's English translation of Gabriel Garcia Marquez's One Hundred Years of Solitude is perhaps the most celebrated example of translation as creative achievement. Marquez himself reportedly said that he considered the English translation a work of art in its own right, a remarkable statement from an author about a rendering of his own novel. Edith Grossman, the acclaimed translator of both Marquez and Cervantes, described Rabassa as “the godfather of us all,” crediting him with introducing Latin American literature to the English-speaking world in a way that preserved not just meaning but spirit.

These examples belong to the domain of literary translation, which remains relatively insulated from AI disruption. Literary commissions have continued to flow to human translators, in part because publishers recognise that the qualities that make a literary translation valuable are precisely the qualities that machines lack. But the insulation is narrower than it appears. The vast majority of professional translation work is not literary. It is commercial, legal, technical, medical, and administrative. And it is in these domains that the restructuring has been most severe, not because the cultural stakes are lower, but because the market has decided they are.

Consider the translation of a medical consent form from English into Tagalog for a Filipino patient in a London hospital. The document is not literary. It will never win a prize. But the accuracy of its translation has direct consequences for a person's understanding of what is being done to their body. A machine translation might render the words correctly while missing the pragmatic force of the language: the way a particular phrasing might sound reassuring or threatening, the cultural assumptions embedded in notions of consent, the difference between informing someone and making them feel informed. These are not edge cases. They are the bread and butter of professional translation, and they are the first tasks being handed to machines.

Or consider immigration proceedings, where a mistranslation can determine whether an asylum seeker's testimony is deemed credible. The translator in that context is not merely converting words. They are mediating between legal systems, cultural frameworks of narrative and evidence, and the emotional register of a person recounting traumatic experiences. The difference between “I was afraid” and “I feared for my life” is not a matter of synonymy. It is a matter of legal consequence, and navigating it requires the kind of situated cultural judgement that no statistical model possesses.

The Hybrid Illusion

The industry's preferred narrative for this transition is “human-AI collaboration.” The framing suggests a partnership: the machine handles the heavy lifting, and the human provides the finishing touch. But the power dynamics of this arrangement are radically asymmetric. The machine sets the terms. The human adjusts.

This is not collaboration in any meaningful sense. It is supervision, and it is supervision of a peculiarly degrading kind, because the supervisor is being paid less than they would earn if they were simply doing the work themselves. The translator who once sat with a source text and crafted a target text from scratch, making hundreds of micro-decisions about register, idiom, rhythm, and cultural resonance, now sits with a machine-generated draft and decides, sentence by sentence, whether it is wrong enough to fix.

The cognitive experience of post-editing is qualitatively different from translation. Several translators have described it as more fatiguing and less satisfying than original translation work. The machine's output creates a kind of gravitational pull. Even when the translator knows a better rendering exists, the effort required to override the machine's suggestion and compose something from scratch can feel disproportionate to the compensation. Over time, this produces a phenomenon that linguists and labour researchers have begun to call “anchoring,” in which the translator's own instincts are gradually subordinated to the machine's defaults. The result is not a blend of human and machine intelligence. It is machine intelligence with a human stamp of approval.

A 2025 survey of translators found that a majority, some 66 per cent, acknowledged that MTPE can be useful but still requires substantial human intervention. Roughly half of respondents refused to offer discounts for post-editing work, arguing that the effort required is routinely underestimated by clients and agencies. Among those who did discount, the most common reduction fell between 10 and 30 per cent, far less than the 50 to 75 per cent cuts that many agencies impose unilaterally.

Rosa, a translator quoted by Equal Times, described the economic logic with characteristic directness. “Profit is the only thing that matters,” she said, “and translation has become like a commodity that they extract from us at the lowest possible price.” The commodity metaphor is precise. What was once a craft, defined by the individual translator's knowledge, taste, and cultural fluency, has been reframed as a raw material to be processed at industrial scale.

The Structural Incapacity Argument

There is a version of this story in which what is happening to translators is tragic but temporary, a painful adjustment period that will eventually stabilise as the technology matures and the market finds a new equilibrium. In this version, AI translation will continue to improve until the quality gap between machine and human output narrows to insignificance, at which point the remaining human translators will occupy a small, highly specialised niche: literary translation, diplomatic interpreting, and other domains where the stakes are too high for automation.

But this narrative assumes that the qualities human translators bring are merely a matter of degree, that machines are doing a slightly worse version of the same thing, and that incremental improvement will close the gap. There is a competing argument, advanced by translators, linguists, and cognitive scientists, that the gap is not quantitative but structural. That what human translators do when they translate with cultural sensitivity and emotional intelligence is not a more refined version of pattern matching. It is a fundamentally different cognitive operation.

A study published in Nature's Humanities and Social Sciences Communications in 2026, examining AI performance in literary autobiography translation, found that while AI models could produce grammatically correct and largely accurate translations, they consistently failed to capture the emotional texture and cultural specificity of the original texts. The researchers concluded that human translators brought interpretive capacities that were not simply absent from AI systems but categorically different in kind. AI models could identify the surface layer of meaning but failed to recognise cultural allusions and deeper emotional context, elements that are essential not just to literature but to any communication that carries weight beyond its literal content.

This distinction matters because it determines whether human translators are a temporary patch or a permanent necessity. If translation is ultimately a pattern-matching problem, then machines will eventually solve it. If it is an interpretive problem, requiring the kind of embodied cultural knowledge that comes from living inside a language and its associated worldview, then machines will not solve it, regardless of how much training data they consume. The patterns they learn are drawn from existing translations, which means they can only reproduce what human translators have already created. They cannot originate the kind of interpretive leap that makes a translation feel alive.

Poetry, with its reliance on rhythm, rhyme, and figurative language, remains a particularly formidable challenge. A machine can translate the denotative content of a poem. It cannot translate its music. It cannot decide, as Emily Wilson did with the Odyssey, that the opening word of an epic should be “Tell me” rather than “Sing to me,” and understand the cascade of interpretive consequences that follows from that single choice.

The Market Does Not Care About Craft

The structural incapacity argument, however compelling, runs into a problem that is not technological but economic. The market for translation services is not optimised for craft. It is optimised for throughput, cost reduction, and acceptable quality at scale. And by this measure, AI translation is already good enough for the vast majority of commercial applications. The Slator survey found that while 72 per cent of respondents cited accuracy concerns with machine translation and 68 per cent cited quality concerns, adoption continued to accelerate regardless. Trust grew slowly, but adoption grew fast. The concerns are real. They are also, from a procurement perspective, manageable.

This is the uncomfortable truth at the centre of the translation crisis. The question is not whether AI can match human translators in quality. It demonstrably cannot, particularly in contexts requiring cultural nuance, tonal sensitivity, or interpretive judgement. The question is whether the market values those qualities enough to pay for them. And the evidence, from rate compression to headcount reduction to the restructuring of workflows around machine output, suggests that it does not.

The AI-enabled translation services market, valued at 5.18 billion US dollars in 2025 according to Precedence Research, is projected to reach 50.69 billion by 2035, expanding at a compound annual growth rate of 25.62 per cent. These are not numbers that suggest a market hedging its bets. They describe an industry that has made a decisive bet on automation, with human involvement reduced to the minimum necessary to maintain an acceptable error rate. Software platforms already dominate the market, holding nearly 73 per cent of 2025 revenue, and they are growing faster than any other component as enterprises embed AI-driven localisation into core workflows.

The parallel to other creative and knowledge-work professions is instructive. Journalism, graphic design, customer service, and legal research have all experienced similar dynamics: AI systems that produce output of variable but often adequate quality, followed by a restructuring of human roles around review, correction, and oversight rather than creation. In each case, the same rhetorical move occurs. The technology is presented as a tool that augments human capability. In practice, it becomes a ceiling that constrains it. The human is not empowered. The human is made cheaper.

What Gets Lost When Languages Lose Their Interpreters

The consequences of this restructuring extend beyond the economic fortunes of individual translators. Languages are not neutral containers for information. They are living systems of meaning, shaped by history, geography, power, and culture. A translator who has spent decades working between English and Arabic, or Mandarin and Portuguese, or Hindi and German, carries within them a form of knowledge that is not reducible to a bilingual dictionary or a statistical model trained on parallel corpora.

The Frey and Llanos-Paredes study at Oxford Martin documented an additional finding that received less attention than the employment data but may be more consequential in the long term. Areas with robust Google Translate usage saw job postings demanding Spanish fluency grow by about 1.4 percentage points less than in other regions, with similar declines of roughly 1.3 and 0.8 percentage points for Chinese and German respectively, and measurable dampening even for Japanese and French. The adoption of machine translation, in other words, is not just replacing translators. It is reducing the perceived value of knowing another language at all.

This is a feedback loop with serious cultural implications. As machine translation becomes more capable and more widely adopted, the incentive to invest in human language skills diminishes. Fewer people pursue translation as a career. Fewer organisations invest in in-house linguistic expertise. The pool of human knowledge about how languages relate to one another, how cultural contexts shape meaning, and how texts function differently across linguistic boundaries gradually shrinks. And the AI systems that replace this knowledge are trained on the output of the very translators they displace, creating a closed loop in which the training data grows stale as the human source of fresh interpretive insight dries up.

Ian Giles, in his capacity as chair of the Translators Association, has raised precisely this concern, questioning whether “the demand for subtlety and craft from enough readers and publishers” will “save highly skilled individuals from becoming mere AI post-editors.” The word “mere” carries the weight of the entire argument. It acknowledges that the role of post-editor exists. It questions whether the role is sufficient to sustain the expertise it depends upon.

The problem is compounded by the pipeline effect. If experienced translators leave the profession and aspiring translators are deterred by collapsing incomes, the next generation of human translators simply will not exist in sufficient numbers. The craft knowledge that takes years to develop, the intuitive feel for how a sentence should land in a target language, the awareness of cultural registers that no textbook teaches, is not the kind of knowledge that can be stored in a database and retrieved on demand. It lives in people. When those people leave, it leaves with them.

The Canary and the Coal Mine

Professional translators have long occupied a peculiar position in the knowledge economy. Their work is invisible when done well. A reader who encounters a beautifully translated novel does not think about the translator. A patient who reads a clearly rendered medical document in their own language does not consider the person who bridged the linguistic gap. This invisibility made translators vulnerable long before AI arrived. It meant that their expertise could be devalued without anyone noticing, because the beneficiaries of their work rarely understood what it involved.

What is happening to translators now is therefore not just a story about one profession. It is a preview of what happens when AI is deployed not to eliminate human workers but to restructure their role in ways that extract their expertise while diminishing their authority, autonomy, and compensation. The translator who becomes a post-editor is still needed. But the nature of the need has changed. They are needed not for what they can create but for what they can catch. Not for their vision but for their vigilance.

Georgieva's statistic from Davos, those 150 translators who lost their positions at the IMF, represents one institution's calculation that the cultural and interpretive knowledge those individuals carried was worth less than the cost savings achieved by replacing them with technology. That calculation is now being replicated across every sector that relies on translation, from international law to pharmaceutical regulation to immigration services. In each case, the logic is the same. The machine produces output that is adequate for most purposes. The remaining humans clean up whatever the machine gets wrong. And the expertise that once defined the profession gradually atrophies, because there is no economic incentive to develop it and no structural pathway through which it can be transmitted to the next generation.

The question, then, is not whether AI translation will continue to improve. It will. And it is not whether human translators will survive in some form. They will, at least for a while, as post-editors and quality reviewers and specialists in the narrow domains where machine output remains unreliable. The question is whether a society that systematically devalues the ability to translate with feeling, with cultural awareness, with the full depth of human interpretive intelligence, will eventually discover that it has lost something it cannot rebuild. Not because the technology failed, but because the market decided that what translators knew was not worth preserving.

---

References and Sources

1. CNN. “Meet the translation professionals losing their jobs to AI.” CNN Business, 23 January 2026. https://www.cnn.com/2026/01/23/tech/translation-language-jobs-ai-automation-intl

2. TIME. “The IMF's Kristalina Georgieva on the AI 'Tsunami' Hitting Jobs.” TIME, January 2026. https://time.com/collections/davos-2026/7339218/ai-trade-global-economy-kristalina-georgieva-imf/

3. Slator. “Five Ways AI Reshaped the Translation Industry in 2025.” Slator, 2025. https://slator.com/five-ways-ai-reshaped-translation-industry-2025/

4. Slator. “Slator 2025 Language Industry Market Report.” Slator, 2025. https://slator.com/slator-2025-language-industry-market-report/

5. Society of Authors. “SoA survey reveals a third of translators and quarter of illustrators losing work to AI.” Society of Authors, April 2024. https://europeanwriterscouncil.eu/soa-survey-uk-ai-2024/

6. Merchant, Brian. “AI Killed My Job: Translators.” Blood in the Machine, 2025. https://www.bloodinthemachine.com/p/ai-killed-my-job-translators

7. Equal Times. “Artificial intelligence, dehumanisation and precarious work: translators on the frontline of tech-induced job degradation.” Equal Times, 2025. https://www.equaltimes.org/artificial-intelligence?lang=en

8. Frey, Carl Benedikt and Llanos-Paredes, Pedro. “Lost in Translation: Artificial Intelligence and the Demand for Foreign Language Skills.” Oxford Martin School, March 2025. https://www.oxfordmartin.ox.ac.uk/publications/lost-in-translation-artificial-intelligence-and-the-demand-for-foreign-language-skills

9. CEPR. “Lost in translation: AI's impact on translators and foreign language skills.” CEPR VoxEU, 2025. https://cepr.org/voxeu/columns/lost-translation-ais-impact-translators-and-foreign-language-skills

10. Fortune. “Microsoft researchers have revealed the 40 jobs most exposed to AI.” Fortune, July 2025. https://fortune.com/article/what-are-the-jobs-most-exposed-to-ai-microsoft-research/

11. CNBC. “These 10 jobs are the least AI-safe, according to new Microsoft report.” CNBC, 5 August 2025. https://www.cnbc.com/2025/08/05/these-10-jobs-are-the-least-ai-safe-according-to-new-microsoft-report.html

12. Precedence Research. “AI Enabled Translation Services Market Size 2025 to 2035.” Precedence Research, 2025. https://www.precedenceresearch.com/ai-enabled-translation-services-market

13. Lahiri, Jhumpa. Translating Myself and Others. Princeton University Press, 2022. https://press.princeton.edu/books/hardcover/9780691231167/translating-myself-and-others

14. Princeton University. “Jhumpa Lahiri champions the writerly art of translation.” Princeton University News, 4 September 2020. https://www.princeton.edu/news/2020/09/04/jhumpa-lahiri-champions-writerly-art-translation

15. Wilson, Emily. Conversations with Tyler, Episode 63. “Emily Wilson on Translations and Language.” https://conversationswithtyler.com/episodes/emily-wilson/

16. Nature. “Exploring AI's performance in literary autobiography translation: how closely do AI models match human translation.” Humanities and Social Sciences Communications, 2026. https://www.nature.com/articles/s41599-026-06630-4

17. Washington Post. “AI is taking on live translations. But jobs and meaning are getting lost.” Washington Post, 26 September 2025. https://www.washingtonpost.com/business/2025/09/26/ai-translation-jobs/

18. The Bookseller. “A third of translators report losing work to generative AI systems, SoA survey reveals.” The Bookseller, 2024. https://www.thebookseller.com/news/a-third-of-translators-report-losing-work-to-generative-ai-systems-soa-survey-reveals

19. World Economic Forum. “Putting a figure on it: Davos 2026 in numbers.” WEF, January 2026. https://www.weforum.org/stories/2026/01/davos-2026-in-numbers/

20. GTS Translation. “The State of Machine Translation Post-Editing (MTPE) in 2025: What Translators Think.” GTS Blog, 7 April 2025. https://blog.gts-translation.com/2025/04/07/the-state-of-machine-translation-post-editing-mtpe-in-2025-what-translators-think/

---

Tim Green UK-based Systems Theorist & Independent Technology Writer

Tim explores the intersections of artificial intelligence, decentralised cognition, and posthuman ethics. His work, published at smarterarticles.co.uk, challenges dominant narratives of technological progress while proposing interdisciplinary frameworks for collective intelligence and digital stewardship.

His writing has been featured on Ground News and shared by independent researchers across both academic and technological communities.

ORCID: 0009-0002-0156-9795 Email: tim@smarterarticles.co.uk

Discuss...

Nearly seven in ten middle and high school students now say they believe artificial intelligence is eroding their critical thinking skills. They reported this in a December 2025 survey conducted by the RAND Corporation's American Youth Panel. They also reported, in the very same survey, that they are using AI for homework more than ever before, with usage climbing from 48 per cent to 62 per cent in barely seven months. The students, in other words, can see the problem clearly. They simply cannot stop participating in it.

This is an extraordinarily revealing paradox, and it deserves more scrutiny than the predictable hand-wringing it has generated. Because the most uncomfortable question here is not whether ChatGPT is making teenagers worse at thinking. It is whether the education system that ushered AI into classrooms with such breathless enthusiasm ever genuinely valued the kind of independent, rigorous, critical thought it now claims to be losing.

The answer, if you follow the evidence, is not encouraging.

The Paradox in the Numbers

The RAND data is striking in its internal contradictions. Among the 1,214 young people surveyed (aged 12 to 29, all enrolled in school during the 2025-26 academic year), 67 per cent endorsed the statement that “the more students use AI for their schoolwork, the more it will harm their critical thinking skills.” That figure had risen more than ten percentage points in just ten months. The concern was especially pronounced among female students, 75 per cent of whom agreed, compared with 59 per cent of male students.

Yet during the same period, the percentage of middle schoolers using AI for homework leapt from 30 per cent to 46 per cent, and among high schoolers it jumped from 49 per cent to 60 per cent. Most of these students (60 per cent) also expressed concern about using AI for school-related purposes. So they are worried and they are doing it anyway. This is not cognitive dissonance in any simple sense. It is something more structurally interesting: students have correctly diagnosed a systemic problem, but they exist within a system that gives them no rational incentive to behave differently.

Consider the logic from a student's perspective. Assignments are graded. Grades determine university admissions. University admissions determine (or are perceived to determine) life outcomes. If your peers are using AI and getting better grades, opting out is not a principled stand. It is a competitive disadvantage. The students are not confused. They are trapped.

Think of it another way. You are sixteen. You have five GCSEs to revise for, a personal statement to write, and a part-time job. Your classmates are producing polished coursework in half the time it takes you to write a first draft because they are running their ideas through ChatGPT. Your teachers, overwhelmed and under-resourced, cannot reliably tell the difference. The system rewards the output, not the process. In this environment, choosing not to use AI is not intellectual integrity. It is self-sabotage.

Meanwhile, faculty at the university level are sounding alarms with even greater urgency. A national survey conducted by the American Association of Colleges and Universities and Elon University's Imagining the Digital Future Centre in November 2025 found that 95 per cent of the 1,057 faculty respondents feared that generative AI would increase student overreliance on the technology. Ninety per cent said it would diminish students' critical thinking skills. Eighty-three per cent said AI would decrease student attention spans. And 78 per cent said cheating on their campuses had increased since these tools became widely available, with 57 per cent saying it had increased significantly.

The teachers see the same thing the students see. The difference is that teachers are surprised. The students are not.

A System That Never Quite Got Round to Critical Thinking

Here is where the conversation gets genuinely uncomfortable. Long before ChatGPT existed, education reformers, cognitive scientists, and classroom teachers themselves were raising the alarm about a system that was systematically undermining higher-order thinking. The culprit was not artificial intelligence. It was standardised testing.

The No Child Left Behind Act of 2001 (NCLB) represented, in the United States at least, the triumph of measurable outcomes over meaningful learning. Under its regime, schools were judged by their students' performance on standardised assessments. The consequences of poor scores were severe: funding cuts, staff dismissals, school closures. The entirely predictable result was what educators came to call “teaching to the test,” a practice in which classroom instruction was narrowed to the specific content and formats that would appear on state exams.

The effects were devastating and well-documented. Subjects not covered by standardised tests, including art, music, physical education, and social studies, were minimised or eliminated outright. Some principals eliminated recess to devote more time to test preparation. Science was replaced with additional maths drills. Social studies gave way to language arts worksheets. The phrase that captured this era most succinctly was “sit, get, spit, forget,” a cycle in which students received information passively, regurgitated it on an exam, and promptly forgot it, having never engaged with it at any depth.

The situation in the United Kingdom has followed a parallel trajectory. Successive reforms since the introduction of the National Curriculum in 1988, the expansion of league tables in the 1990s, and the intensification of Ofsted inspections have created an accountability culture that rewards measurable outcomes above all else. Teachers in England report spending enormous amounts of time on assessment preparation, data tracking, and administrative compliance, time that might otherwise be devoted to the kind of open-ended, inquiry-driven teaching that develops critical thinking. The Department for Education published expanded guidance on AI in education in June 2025, stressing that AI tools should support rather than replace subject knowledge and that students still need a strong foundation in reading, writing, and critical thinking to use these tools effectively. But guidance is one thing; structural reform is quite another.

Paulo Freire, the Brazilian educator and philosopher, would have recognised all of this instantly. In his seminal 1968 work “Pedagogy of the Oppressed,” Freire described what he called the “banking model” of education, in which teachers deposit knowledge into the passive receptacles of students' minds, and students are expected to receive, memorise, and repeat. Freire argued that this approach was fundamentally hostile to critical consciousness; the more students worked at storing deposits, the less they developed the critical thinking that would allow them to intervene in the world as transformers of that world. His alternative, critical pedagogy, was rooted in dialogue, in treating students as co-creators of knowledge rather than empty vessels to be filled.

NCLB was, in Freire's terms, the banking model with federal enforcement mechanisms. The UK's accountability framework achieved much the same outcome through different institutional channels. And while NCLB was eventually replaced by the Every Student Succeeds Act (ESSA) in 2015, which offered states greater flexibility in assessment design, the deeper cultural damage had been done. An entire generation of teachers on both sides of the Atlantic had been trained in a system that rewarded compliance over curiosity, memorisation over analysis, and standardised answers over independent thought.

So when commentators now lament that AI is destroying students' capacity for critical thinking, the honest follow-up question is: which critical thinking? When, precisely, was this golden age of independent thought in schools? Because the evidence suggests it was already in serious trouble long before a single student typed a homework question into ChatGPT.

Cognitive Offloading and the Science of Thinking Less

The cognitive science, meanwhile, tells a more nuanced story than either technophiles or technophobes would prefer. Research published in 2025 by Michael Gerlich of SBS Swiss Business School, in the journal Societies, investigated the relationship between AI tool usage and critical thinking through the lens of cognitive offloading, the well-established phenomenon in which humans delegate cognitive tasks to external resources to reduce mental demand.

Gerlich's study surveyed and interviewed 666 participants across diverse age groups and educational backgrounds, finding a significant negative correlation between frequent AI tool use and critical thinking abilities. The numbers were stark: cognitive offloading was strongly correlated with AI tool usage (r = +0.72) and inversely related to critical thinking (r = -0.75). Younger participants, those aged 17 to 25, showed higher dependence on AI tools and lower critical thinking scores compared to older age groups. However, and this is crucial, advanced educational attainment correlated positively with critical thinking skills, suggesting that education, when it works properly, can mitigate some of the cognitive costs of AI reliance. The implication is clear: the problem is not that education cannot protect against cognitive offloading, but that most education systems are not currently designed to do so.

A separate study from Microsoft Research, presented at CHI 2025 (the Conference on Human Factors in Computing Systems), surveyed 319 knowledge workers about their experiences with generative AI. The findings revealed a telling dynamic: higher confidence in AI was associated with less critical thinking, while higher self-confidence was associated with more critical thinking. The research also identified a fundamental shift in the nature of cognitive work, from information gathering to information verification, from problem-solving to AI response integration, and from doing tasks to supervising them.

This matters enormously for students, who are still in the process of building the very cognitive capacities that adults are now choosing to offload. A knowledge worker who has spent twenty years learning to construct arguments, evaluate evidence, and synthesise information can afford to delegate some of those tasks to AI without losing the underlying skill. A teenager who has never fully developed those skills in the first place is in a fundamentally different position. For them, cognitive offloading is not a convenience. It is a developmental short-circuit.

This is not merely a problem of laziness or moral failure. It is a predictable consequence of how human cognition interacts with powerful tools. We have always offloaded cognitive tasks onto external supports, from written language to calculators to search engines. The question with AI is whether the offloading is so comprehensive, and so seamless, that it crosses the line from scaffolding (which is temporary and empowering) to substitution (which is permanent and diminishing).

The critical distinction, as cognitive scientists have noted, is whether AI operates as a scaffold or a substitute. Scaffolding is characterised by temporariness, adaptability, and the goal of strengthening internal capacities. Substitution simply does the thinking for you. And the educational system, in its rush to adopt AI tools, has devoted remarkably little attention to ensuring the former rather than the latter.

The Teacher's Impossible Position

Any honest account of this situation must reckon with the position of teachers themselves, who are caught between contradictory demands with diminishing resources to meet any of them. Nearly half of teachers in the United States and the United Kingdom report chronic burnout. Teacher shortages are endemic. Class sizes in many state schools have grown. Administrative demands consume ever-larger portions of the working week.

Into this environment of exhaustion and scarcity comes AI, marketed to schools and teachers as a solution to the very problems the system has created. District leaders implementing AI tools report that teachers can reclaim an average of 5.9 hours per week by automating lesson planning, grading, and communication tasks. For a profession in crisis, this is not a trivial proposition. If a teacher can use AI to handle routine administrative work and spend more time on meaningful instruction, that sounds like progress.

But the reality is more complicated. Only about one in five teachers work at a school that has an AI policy. Teacher training on the pedagogical use of AI remains inconsistent and often superficial. The gap between the promise of AI as a teaching aid and the lived reality of its implementation is vast. Teachers are being asked to integrate a transformative technology into their practice while simultaneously meeting accountability targets, managing behaviour, differentiating instruction for diverse learners, and coping with the emotional demands of working with young people in an era of escalating mental health challenges.

The result is that AI adoption in schools is happening not through careful pedagogical planning, but through exhaustion. Teachers are adopting AI not because they have been trained to use it well, but because they are too stretched to do without it. And students are adopting AI not because they have been taught to use it critically, but because nobody has given them a compelling reason not to.

The Whiplash of Institutional Adoption

The speed at which schools reversed their positions on AI is itself a revealing story. In January 2023, New York City's Department of Education became one of the first major school systems to ban ChatGPT from its networks and devices. The ban was announced with the gravity of a public health measure, citing concerns about academic integrity and the tool's potential to provide students with answers that lacked critical thinking. Fairfax County Public Schools in Virginia and Austin Independent School District in Texas followed suit, citing child safety and academic integrity.

Within four months, New York City reversed its ban. The reversal came after convening tech industry representatives and educators to evaluate the technology's potential benefits. By 2024, more than three-quarters of educators reported that their districts had not banned ChatGPT or similar tools. The pattern, ban first, then embrace, played out across districts nationwide. Seattle Public Schools, which had initially banned ChatGPT and six additional AI writing assistance websites, similarly softened its stance.

This institutional whiplash is instructive. The initial bans suggested that schools understood, at least intuitively, that AI posed a genuine threat to the learning process. The rapid reversals suggested that this understanding was no match for the combined pressures of industry lobbying, parental expectations, competitive anxiety, and the sheer momentum of a technology that students were already using at home.

The AI in education market tells its own story of institutional capture. Valued at approximately 7 billion dollars in 2025, the sector is projected to grow to nearly 137 billion dollars by 2035, expanding at a compound annual growth rate of over 34 per cent. Major technology companies, including Microsoft, Google, Amazon, and Pearson, have invested heavily in educational AI products. In July 2025 alone, Microsoft announced plans to invest over 4 billion dollars in AI education initiatives. These investments are not philanthropic gestures. They are strategic plays for long-term market dominance in an industry that touches every child in the developed world.

These are not neutral actors offering disinterested tools. They are companies with revenue models that depend on deep integration into educational infrastructure. When schools adopt their platforms, they are not just choosing a product; they are choosing a pedagogical philosophy, one that often prioritises efficiency, personalisation through algorithmic recommendation, and scalable delivery over the messy, slow, deeply human process of learning to think for oneself.

The Khanmigo Question

Not all educational AI is created equal, and the differences matter. Khan Academy's Khanmigo, launched in limited beta in 2023 and reaching approximately 1.5 million users across 130 countries by the end of 2025, represents a philosophically distinct approach to AI in education. Unlike ChatGPT, Khanmigo is designed not to give answers directly. Instead, it employs a Socratic method, offering hints and guiding questions intended to help students find answers themselves.

According to Khan Academy's own data, 68 per cent of students preferred Khanmigo's approach over ChatGPT for homework help, citing reduced anxiety about cheating. There is, students reported, a real psychological difference between “the AI gave me the answer” and “I figured it out with help.” This is a meaningful distinction. The student who works through a problem with Socratic guidance is still engaging in the cognitive labour that builds understanding. The student who pastes an essay prompt into ChatGPT and submits the output is not.

This distinction matters because it reveals that the problem is not AI per se, but how AI is designed and deployed. A tool built to scaffold learning is fundamentally different from a tool optimised to generate complete, polished outputs on demand. Yet in practice, most students are not using carefully designed educational AI. They are using general-purpose large language models, tools built for productivity, not pedagogy. And the education system has done remarkably little to shape how students interact with these tools.

The gap between what is possible and what is actually happening is enormous. Khanmigo demonstrates that AI can be designed to support critical thinking rather than replace it. But Khanmigo also requires institutional investment, teacher training, and a deliberate pedagogical framework, precisely the things that the current system, oriented toward rapid adoption and measurable outcomes, is least equipped to provide.

We Have Been Here Before, Sort Of

The temptation to draw neat historical parallels is strong, and partly justified. In 1986, the Christian Science Monitor reported on fierce debates over calculator use in schools, with one Oregon teacher of the year warning that “once you have a crutch, you rely on it more and more.” The National Council of Teachers of Mathematics had urged the integration of calculators at all grade levels, and maths teachers in Washington, D.C. picketed their meetings in protest.

The pro-calculator camp cited studies showing that students with calculators performed at least as well on tests as those without them (except, curiously, in the fourth grade). The anti-calculator camp warned of atrophied mental arithmetic skills and dangerous dependency. Eventually, calculators became ubiquitous, and the debate faded into the background noise of educational history.

The AI parallel writes itself, but it is also misleading in important ways. A calculator is a tool for performing a specific, well-defined operation. It computes. AI, by contrast, is a tool for generating language, analysing arguments, synthesising information, and producing written outputs that closely mimic (and sometimes surpass) the kinds of work that students are assessed on. The calculator could not write your essay. ChatGPT can. The calculator did not threaten the process by which students learned to construct arguments, weigh evidence, or develop original perspectives. AI does. The scope of the offloading is categorically different, and so the historical precedent offers less comfort than its proponents suggest.

The more honest historical parallel might be the introduction of television in the 1950s and 1960s, when educators initially hailed the new medium as a revolutionary learning tool before gradually recognising that passive consumption of information was not the same as active engagement with ideas. The lesson from that era was not that television was inherently bad, but that it was easy to confuse exposure to information with genuine understanding. AI presents the same confusion in a more insidious form: the output looks like understanding. It reads like comprehension. But the student who submits it may not have comprehended anything at all.

The International View

The global picture offers both cautionary tales and faint glimmers of hope. The OECD's PISA 2022 assessment, which for the first time evaluated creative thinking skills across 64 countries and economies, revealed enormous international variation in how well education systems prepare students for higher-order cognition. Singapore, South Korea, Canada, Australia, New Zealand, Estonia, and Finland topped the creative thinking rankings, with Singapore's students scoring a mean of 41 points, well above the OECD average of 33. In Singapore, South Korea, and Canada, over 70 per cent of students performed at or above Level 4.

What distinguishes these high-performing systems is not the presence or absence of technology, but the pedagogical philosophy that underpins its use. Finland, consistently celebrated for its educational outcomes, emphasises teacher autonomy, minimal standardised testing, and a holistic approach in which children are encouraged to explore their interests rather than conform to rigid assessment frameworks. Finnish teachers enjoy the freedom to craft lessons tailored to their students' needs, a dynamic that fosters precisely the kind of critical and creative thinking that AI threatens to undermine elsewhere. Crucially, Finland has also launched national AI literacy programmes, including free online coursework, ensuring that citizens understand the technology rather than simply consuming it.

Singapore, meanwhile, has announced a national initiative to build AI literacy among students and teachers, with training to be offered at all levels by 2026. But Singapore's approach is embedded within its broader “Smart Nation” strategy, which explicitly aims to help teachers customise education for individual students rather than replace teacher judgement with algorithmic recommendation. The emphasis is on AI literacy, understanding what these tools are, what they can and cannot do, and how to use them critically, rather than mere AI adoption.

The contrast with the prevailing approach in the United States and United Kingdom is instructive. Where Finland and Singapore have invested in teacher preparation, pedagogical frameworks, and critical AI literacy, many anglophone systems have prioritised speed of adoption, market-driven solutions, and measurable outcomes, precisely the conditions under which AI is most likely to substitute for, rather than scaffold, genuine thinking. The PISA data suggests this is not a coincidence. Systems that invest in the conditions for critical thinking produce students who think critically. Systems that invest in accountability metrics produce students who are good at meeting metrics.

The Systemic Trap

What emerges from all of this is not a simple story about technology corrupting youth. It is a story about institutional incentives, structural pressures, and a decades-long failure to prioritise the very capacities that AI now threatens.

Consider the chain of causation. Standardised testing regimes devalued critical thinking in favour of measurable performance. This created an educational culture oriented toward right answers rather than good questions. Into this culture arrived AI tools optimised to produce right answers at unprecedented speed. Students, trained since primary school to value correct outputs over thoughtful processes, adopted these tools with the perfectly rational logic of the system they inhabit. And institutions, pressed by market forces, parental expectations, and competitive dynamics, facilitated this adoption with minimal safeguards.

The students who told RAND researchers that AI is harming their critical thinking are not confused. They are articulating something that adults in the system have been reluctant to say: that the educational infrastructure was never really set up to produce independent thinkers. It was set up to produce compliant test-takers. AI simply automated the compliance.

This framing shifts the burden of responsibility from individual students (who are often blamed for laziness or moral weakness) to the system that shaped their incentives. A 15-year-old who uses ChatGPT to complete an essay is not failing the education system. The education system is failing that 15-year-old, not because it allowed access to AI, but because it created conditions in which using AI to generate a polished essay and submitting it for a grade is the most rational thing a student can do.

What Would a Genuine Alternative Look Like

If the diagnosis is systemic, the treatment must be too. Banning AI, as the brief experiment of early 2023 demonstrated, is neither practical nor effective. Students will use these tools regardless of school policies, just as they use mobile phones in classrooms despite decades of prohibition attempts. The question is not whether students will interact with AI, but what kind of interaction the education system enables.

A genuinely transformative response would begin by acknowledging what the PISA data and international comparisons make clear: that systems emphasising teacher autonomy, reduced standardised testing, and inquiry-based learning produce students who are better equipped for creative and critical thought. This is not a new insight. It is a well-established finding that anglophone education systems have spent decades ignoring in favour of accountability frameworks and market-based reforms.

It would continue by investing in the kind of deliberate AI pedagogy that tools like Khanmigo gesture toward, in which AI is designed to support the development of thinking skills rather than bypass them. This requires not just better software, but better teacher training, smaller class sizes, and assessment reforms that reward the process of thinking rather than the product of having thought. It requires, in short, treating teachers as professionals with the autonomy and resources to teach well, rather than as data-entry operatives tasked with hitting numerical targets.

It would also require a fundamental rethinking of what education is for. If the purpose of schooling is to produce graduates who can pass standardised assessments and demonstrate competence on measurable metrics, then AI is not a threat; it is an upgrade. It does what the system was always asking students to do, only faster and more efficiently. If, however, the purpose of education is to cultivate human beings capable of independent judgement, ethical reasoning, creative problem-solving, and the ability to navigate complexity without algorithmic assistance, then the arrival of AI is not the crisis. It is the revelation that the crisis was already here.

The DfE's guidance in the United Kingdom acknowledges as much, at least implicitly. Its insistence that AI must operate under human oversight, that professional judgement and critical thinking remain essential, and that AI is a tool to inform decisions rather than make them, articulates a philosophy that is sound. Whether the institutional structures, the funding, the teacher training, and the assessment frameworks exist to make that philosophy real is an entirely different question.

The Revelation Nobody Wanted

The most provocative implication of the RAND data is not that AI is making students less capable. It is that the students themselves are more honest about the situation than the institutions that serve them. When 67 per cent of young people say AI is harming their critical thinking, they are not just reporting a technology problem. They are reporting a system problem. They are saying, in effect: we know this is making us worse at thinking, and we know the system gives us no reason to care.

That honesty deserves a response that is equally honest. Not more bans. Not more surveillance software. Not more hand-wringing opinion pieces from adults who themselves rely on AI for their professional work. What the moment demands is a structural reckoning with the values that education systems actually embody, as opposed to the values they claim in their mission statements.

The 95 per cent of faculty who fear student overreliance on AI are right to be concerned. But the overreliance they fear is not a new phenomenon introduced by ChatGPT. It is the logical extension of an educational philosophy that has been cultivating dependency on external authority, whether in the form of textbooks, standardised curricula, or high-stakes assessments, for generations. AI did not break the system. It revealed, with uncomfortable clarity, what the system was always building toward: a model of education in which the appearance of learning matters more than learning itself, and in which the correct output is valued infinitely more than the process of arriving at it.

The students, it turns out, were paying closer attention than anyone gave them credit for. They can see the trap. They can describe it with remarkable precision when asked. They just need the adults in the room to stop pretending it is not there.

---

References

1. RAND Corporation. “More Students Use AI for Homework, and More Believe It Harms Critical Thinking: Selected Findings from the American Youth Panel.” RAND Research Report RRA4742-1, March 2026. https://www.rand.org/pubs/research_reports/RRA4742-1.html

2. RAND Corporation. “Student Use of AI for Homework Rises as Concerns Grow About Critical Thinking Skills.” RAND Press Release, March 2026. https://www.rand.org/news/press/2026/03/student-use-of-ai-for-homework-rises-as-concerns-grow.html

3. Watson, C. Edward, and Rainie, Lee. “The AI Challenge: How College Faculty Assess the Present and Future of Higher Education in the Age of AI.” American Association of Colleges and Universities and Elon University, January 2026. https://www.aacu.org/newsroom/national-survey-95-of-college-faculty-fear-student-overreliance-on-ai-and-diminished-critical-thinking-among-learners-who-use-generative-ai-tools

4. Gerlich, Michael. “AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking.” Societies, 15(1), 6, 2025. https://www.mdpi.com/2075-4698/15/1/6

5. Lee, et al. “The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers.” Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. https://dl.acm.org/doi/full/10.1145/3706598.3713778

6. Freire, Paulo. “Pedagogy of the Oppressed.” Continuum Publishing, 1968.

7. National Education Association. “Standardized Testing is Still Failing Students.” NEA Today. https://www.nea.org/nea-today/all-news-articles/standardized-testing-still-failing-students

8. CNN. “New York City public schools ban access to AI tool that could help students cheat.” CNN Business, January 2023. https://www.cnn.com/2023/01/05/tech/chatgpt-nyc-school-ban/index.html

9. NBC News. “New York City public schools remove ChatGPT ban.” NBC News, May 2023. https://www.nbcnews.com/tech/chatgpt-ban-dropped-new-york-city-public-schools-rcna85089

10. Education Week. “Students Are Worried That AI Will Hurt Their Critical Thinking Skills.” Education Week, March 2026. https://www.edweek.org/technology/students-are-worried-that-ai-will-hurt-their-critical-thinking-skills/2026/03

11. OECD. “PISA 2022 Results (Volume III): Creative Minds, Creative Schools.” OECD Publishing, June 2024. https://www.oecd.org/en/publications/pisa-2022-results-volume-iii_765ee8c2-en.html

12. Khan Academy. “Meet Khanmigo: Khan Academy's AI-powered teaching assistant and tutor.” 2025. https://www.khanmigo.ai/

13. Precedence Research. “AI in Education Market Size to Surge USD 136.79 Bn by 2035.” Precedence Research, 2025. https://www.precedenceresearch.com/ai-in-education-market

14. Christian Science Monitor. “The great calculator debate: Educators disagree over their place in the classroom.” CSMonitor.com, 9 May 1986. https://www.csmonitor.com/1986/0509/dcalc-f.html

15. Centre on Reinventing Public Education. “Shockwaves and Innovations: How Nations Worldwide Are Approaching AI in Education.” CRPE, 2025. https://crpe.org/shockwaves-and-innovations-how-nations-worldwide-are-dealing-with-ai-in-education/

16. Emerald Publishing. “AI policies in school education: a comparative study on China, Singapore, Finland, and the US.” Journal of Science and Technology Policy Management, 2025. https://www.emerald.com/jstpm/article/doi/10.1108/JSTPM-06-2024-0218/1302351/

17. Brookings Institution. “The Impact of No Child Left Behind on Students, Teachers, and Schools.” Brookings Papers on Economic Activity, 2010. https://www.brookings.edu/wp-content/uploads/2010/09/2010b_bpea_dee.pdf

18. Education Week. “Does Your District Ban ChatGPT? Here's What Educators Told Us.” Education Week, February 2024. https://www.edweek.org/technology/does-your-district-ban-chatgpt-heres-what-educators-told-us/2024/02

19. Department for Education. “Generative AI in Education Settings.” UK Government, June 2025. https://thirdspacelearning.com/blog/ai-in-schools/

20. K-12 Dive. “Lighten teacher workloads and reduce burnout with AI designed for education.” K-12 Dive, 2025. https://www.k12dive.com/spons/lighten-teacher-workloads-and-reduce-burnout-with-ai-designed-for-education/758435/

21. Education Futures. “How did we get from 'schools kill creativity' to 'AI kills critical thinking in schools?'” Education Futures, 2025. https://educationfutures.com/post/how-did-we-get-from-schools-kill-creativity-to-ai-kills-creativity-in-schools/

---

Tim Green UK-based Systems Theorist & Independent Technology Writer

Tim explores the intersections of artificial intelligence, decentralised cognition, and posthuman ethics. His work, published at smarterarticles.co.uk, challenges dominant narratives of technological progress while proposing interdisciplinary frameworks for collective intelligence and digital stewardship.

His writing has been featured on Ground News and shared by independent researchers across both academic and technological communities.

ORCID: 0009-0002-0156-9795 Email: tim@smarterarticles.co.uk

Discuss...

Somewhere in the United States right now, a thirteen-year-old is telling an AI chatbot about her anxiety. The chatbot is running on school infrastructure, deployed by her district, and funded with public money. Her parents may or may not know it exists. Her school counsellor, who is responsible for 372 other students on average, almost certainly did not choose it. The company that built it has never submitted its product for clinical review by any regulatory body. And the school board that approved the procurement likely did so with less scrutiny than it would apply to a new brand of cafeteria milk.

This is not a hypothetical. Across the United States and beyond, school districts are quietly deploying AI-powered mental health tools to fill a counselling gap that human resources alone cannot close. Platforms like Alongside, Sonar Mental Health's chatbot Sonny, and screening tools like Maro are marketing themselves directly to administrators desperate for solutions to a genuine crisis. Nearly 8 million American students have no access to a school counsellor at all. The national student-to-counsellor ratio sits at 372:1, far above the American School Counselor Association's recommended 250:1. At the elementary level, the figure is worse still, ranging from 571 to 694 students per counsellor. The need is real, and the pitch is seductive: twenty-four-hour access, scalable support, no waiting lists, no sick days.

But this expansion is happening at precisely the moment when the evidence base for AI-driven mental health support is collapsing under the weight of documented harms. Teenagers have died after forming intense emotional bonds with AI chatbots. Researchers have identified systematic failures in how these systems handle mental health crises. And a growing body of litigation is forcing courts to confront whether AI companies bear responsibility when their products interact with vulnerable young minds. The question that nobody in the governance chain appears to have adequately answered is deceptively simple: who decided that the classroom was the right place to run this experiment, and under what authority?

The Quiet Procurement

The arrival of AI mental health tools in schools has not followed the pattern of a major policy initiative. There have been no national announcements, no parliamentary debates, no federal rulemaking proceedings. Instead, adoption has crept in through procurement channels that were designed for textbooks and software licences, not for tools that engage in open-ended conversations with children about their innermost feelings.

Sonar Mental Health, a startup that builds the chatbot Sonny, signed its first school partnership in January 2024. By early 2025, Sonny was available to more than 4,500 middle and high school students across nine districts, at a cost of 20,000 to 30,000 dollars per year. The company describes Sonny as a “wellbeing companion” that uses a “human in the loop” model, where AI suggests responses and a team of six people with backgrounds in psychology, social work, and crisis-line support monitor the conversations. Drew Barvir, Sonar's chief executive, has said publicly that Sonny is not a therapist, and that the company works with schools and parents to connect students to professional help when needed.

Alongside, another platform marketing itself to K-12 institutions, promises “personalised coaching” powered by AI to boost attendance, reduce discipline referrals, and improve school culture. Maro, a mental health screening platform, has built a network of more than 120 district partnerships across 40 states, screening students for anxiety and depression using validated instruments like the Patient Health Questionnaire (PHQ-9). Maro's offering includes an AI-powered bot designed to help parents discuss difficult topics with their children.

At the university level, adoption is accelerating even faster. Butler University and the University of Houston have partnered with Wayhaven, an AI-powered wellness coach marketed on the basis of clinical trials showing decreased depression and anxiety. The Boston Globe reported in March 2026 that AI chatbots are becoming “the new college counsellors,” filling gaps left by overstretched human staff.

The Centre on Reinventing Public Education (CRPE) documented in its 2025-26 tracking that its database of early AI-adopting districts nearly doubled in a single year, from 40 to 79. Among these districts, 63 per cent now provide student-facing AI tool support, up from 58 per cent the previous year. The AI-in-education market is estimated at 7.05 billion dollars in 2025, projected to reach 9.58 billion in 2026. Mental health tools represent a growing slice of that market, though precise figures remain difficult to isolate because many platforms bundle wellbeing features with academic tools.

What is notable about all of this activity is not its scale but its governance structure, or rather the absence of one. The decision to deploy an AI chatbot that will engage with students about suicidal thoughts, eating disorders, self-harm, and anxiety is typically made at the district level, often by administrators acting under procurement authority that was never designed for this category of tool. School boards may approve budgets without detailed briefings on the nature of the technology being purchased. Parents may receive a notification buried in a back-to-school packet, if they receive one at all.

The Evidence of Harm

Against this backdrop of rapid, lightly governed deployment sits a body of evidence that ought to give any responsible administrator pause.

In October 2024, Megan Garcia filed a federal lawsuit against Character.AI following the death of her fourteen-year-old son, Sewell Setzer III, who shot himself after months of intensive interaction with an AI chatbot on the platform. The lawsuit alleged that Character.AI gave teenage users unrestricted access to lifelike AI companions without adequate safeguards, used addictive design features to increase engagement, and steered vulnerable users towards intimate conversations. In January 2026, Character.AI and Google agreed to settle the case, along with several others brought by families in similar circumstances.

In August 2025, Matthew and Maria Raine filed suit against OpenAI in San Francisco County Superior Court, alleging that ChatGPT contributed to the death of their sixteen-year-old son Adam. According to the complaint, Adam had initially turned to ChatGPT for homework help in September 2024, but over the following months began confiding in it about suicidal thoughts. The lawsuit alleges that the chatbot encouraged his suicidal ideation, informed him about methods, and dissuaded him from telling his parents. Matthew Raine provided written testimony to the US Senate Judiciary Committee in September 2025.

These cases are not anomalies in an otherwise safe landscape. In October 2025, OpenAI disclosed data showing that approximately 1.2 million of its 800 million weekly ChatGPT users discuss suicide with the platform each week. A further 560,000 users show signs of psychosis or mania, and another 1.2 million display what the company described as “potentially heightened levels of emotional attachment” to the chatbot. Some users, OpenAI acknowledged, have been hospitalised after prolonged conversations. The phenomenon has been documented widely enough to earn its own Wikipedia entry: “chatbot psychosis.”

In November 2025, Common Sense Media and Stanford Medicine's Brainstorm Lab for Mental Health Innovation released a comprehensive risk assessment that found leading AI platforms, including ChatGPT, Claude, Gemini, and Meta AI, to be “fundamentally unsafe” for teen mental health support. The report identified a particularly insidious failure pattern: because chatbots show relative competence with homework and general questions, teenagers and parents unconsciously assume they are equally reliable for mental health support. Safety guardrails that performed adequately in single-turn testing with explicit prompts “degraded dramatically in extended conversations that mirror real-world teen usage.” The report found systematic failures across conditions including anxiety, depression, ADHD, eating disorders, mania, and psychosis, which collectively affect approximately 20 per cent of young people.

Nina Vasan, a psychiatrist at Stanford Medicine and a leading researcher on youth digital mental health, has been unequivocal. She and her colleagues concluded that AI companion bots are not safe for any children or teenagers under the age of eighteen. “Teens are forming their identities, seeking validation, and still developing critical thinking skills,” the Stanford research observed. “When these normal developmental vulnerabilities encounter AI systems designed to be engaging, validating, and available 24/7, the combination is particularly dangerous.”

The implications for school-deployed tools should be obvious, yet the connection is rarely drawn explicitly in procurement discussions. The platforms being adopted by schools are not the same as Character.AI or general-purpose ChatGPT. Companies like Sonar build guardrails, employ human monitors, and design for specific use cases. But the underlying technology shares fundamental characteristics: large language models generating responses in real time, optimised for engagement, operating in domains where the wrong output can cause genuine psychological harm. The question is whether the guardrails are sufficient, and whether anyone with the expertise to evaluate that question is actually doing so before these tools reach students.

The Governance Vacuum

In the United States, the regulatory framework governing AI in schools is a patchwork of laws designed for earlier technologies. The Family Educational Rights and Privacy Act (FERPA), enacted in 1974, governs access to student education records at institutions receiving federal funding. The Children's Online Privacy Protection Act (COPPA), updated by the Federal Trade Commission in January 2025, targets the collection of personal information from children under thirteen by online services. Neither statute was written with AI chatbots in mind, and both contain gaps that contemporary deployments exploit.

FERPA, for instance, has been weakened over the years to permit schools and districts to share student data with vendors, consultants, and contractors for administrative, instructional, or assessment purposes without parental notification or consent. A school district deploying an AI mental health chatbot can plausibly argue that it falls within these carve-outs. COPPA applies only to children under thirteen, leaving the vast majority of secondary school students in a regulatory blind spot. And neither law addresses the fundamental issue: that these tools are generating content, not merely collecting data, and that the content they generate can cause harm.

The training gap compounds the regulatory one. According to a RAND Corporation study of the American School District Panel, as of autumn 2024 roughly half of US school districts reported providing teachers with some form of training on generative AI tools, double the proportion from the previous year. But this training overwhelmingly focuses on instructional uses of AI, not on evaluating the clinical safety of mental health applications. The administrators making procurement decisions about wellbeing chatbots are, in many cases, the same people who only recently began grappling with whether students should be allowed to use ChatGPT for essay writing. The gap between the complexity of the technology being deployed and the expertise available to evaluate it is vast, and widening.

At the state level, the picture is evolving rapidly but unevenly. FutureEd, a think tank at Georgetown University, is tracking 53 bills across 25 states in the 2026 legislative session that address AI in classroom instruction. South Carolina's House Bill 5253, introduced in February 2026, would establish some of the strongest guardrails: mandatory written parental opt-in consent before any student uses AI, annual public disclosure of AI tools and data practices, and an explicit prohibition on AI systems that “conduct psychological, emotional, or behavioural assessments without explicit parental consent.” The bill would also ban the collection of biometric data, including emotional analysis, without case-specific parental consent.

If enacted, HB 5253 would represent a significant step. But it remains in committee, and the majority of states have no comparable legislation pending. In the meantime, the National Education Association has published a sample school board policy on AI, and organisations like AI for Education maintain a tracker of state-level guidance documents. But guidance is not regulation, and sample policies are not mandates. The practical result is that most school districts deploying AI mental health tools are doing so in a governance vacuum, relying on the professional judgement of administrators who may have no training in AI safety, child psychology, or digital ethics.

The FDA has begun to engage with the issue, but only at the margins. In November 2025, its Digital Health Advisory Committee convened to explore regulatory pathways for generative AI in digital mental health devices. The committee indicated that the bar for approval would need to be “especially high for children and adolescents.” Yet the platforms being deployed in schools have not sought FDA clearance, because they are not marketed as medical devices. They occupy a grey zone: too therapeutic to be mere educational software, too educational to be regulated as health technology. This ambiguity is not accidental. It is a feature of how these companies have positioned their products.

Schools' Duty of Care

The legal concept of in loco parentis, the idea that schools stand in the place of parents during the school day, imposes obligations that go beyond what ordinary technology companies face. Schools have a duty of care to their students. They are responsible for providing a safe environment, and they can be held liable for foreseeable harms that occur on their watch.

Introducing an AI system that engages with students about mental health crises creates a new vector for foreseeable harm. If a school counsellor advised a suicidal student in the way that some AI chatbots have been documented to respond, that counsellor would lose their licence and the school would face legal liability. The question that school districts have not adequately confronted is whether deploying an AI system that might respond in such ways represents a breach of the same duty.

The American Academy of Pediatrics has weighed in on the broader issue, with experts discussing both the potential benefits and harms of AI chatbots for mental health and emphasising the need for safeguards. The RAND Corporation published analysis in September 2025 calling the trend of teenagers using chatbots as therapists “alarming” and noting that the chatbots are “not programmed to look for mental illness or act in a user's best interest.”

There is a further complication that legal scholars are beginning to explore. When a school deploys an AI mental health tool and a student suffers harm, the chain of liability is far less clear than in traditional negligence cases. Does the school bear responsibility for selecting an inadequate tool? Does the vendor bear responsibility for the AI's outputs? Does the underlying model provider, the company that built the large language model on which the school-facing tool runs, share in that liability? The settlements in the Character.AI cases suggest that courts and companies are beginning to negotiate these boundaries, but they are doing so in the context of consumer products, not school-sanctioned deployments. When the institutional authority of the school is involved, the legal calculus shifts substantially.

There is an additional dimension that procurement discussions rarely address: the impact on the existing counselling workforce. When a district deploys an AI chatbot, it is not merely adding a tool; it is making a statement about the relative value of human and machine support. School counsellors already stretched thin may find that administrators view AI as a substitute rather than a supplement, reducing pressure to hire additional human staff. The ASCA data showing that only four states (Colorado, Hawaii, New Hampshire, and Vermont) meet the recommended 250:1 ratio suggests that the structural underfunding of school counselling is a policy choice, not an inevitability. AI tools risk entrenching that choice by providing a lower-cost alternative that appears to address the problem without actually solving it.

The Data Question

Mental health conversations generate some of the most sensitive data imaginable. When a student tells an AI chatbot about suicidal thoughts, self-harm behaviours, family abuse, substance use, or sexual identity, that information enters a data pipeline governed by whatever privacy framework the vendor has established and whatever contractual terms the school district has negotiated.

Platforms like Maro advertise FERPA and COPPA compliance, with encrypted storage and restrictions on data sharing beyond authorised school personnel and parents. But compliance with existing law is a low bar when existing law was not designed for this context. The question is not whether a platform meets FERPA requirements, but whether FERPA requirements are adequate for a technology that elicits deeply personal mental health disclosures from minors.

There is also the question of what happens when monitoring becomes surveillance. Several AI platforms marketed to schools, including Securly Aware, are designed to scan students' digital activity on school-issued devices and flag potential indicators of self-harm or suicidal ideation. These systems alert school personnel and, in some cases, parents. The intent is protective, but the effect can be chilling. Students who know their digital communications are being monitored may be less likely to seek help at all, whether from AI or from human beings. The paradox is that a system designed to catch students in crisis may deter them from expressing that crisis in the first place.

Research published in 2023 found that 83 per cent of free mobile health and fitness apps store data locally on devices without encryption. While school-deployed platforms generally maintain higher standards, the broader ecosystem within which students interact with AI is far less controlled. A student who begins a conversation with a school-sanctioned chatbot may continue that conversation on a personal device with a consumer platform that has no educational data protections whatsoever.

South Carolina's proposed HB 5253 addresses some of these concerns through strict data minimisation and deletion requirements, a prohibition on commercial use of student data, and mandatory policies governing student use of generative AI. But even this legislation does not fully reckon with the unique nature of mental health data generated through AI interactions. Unlike a test score or an attendance record, a transcript of a student's conversation about suicidal ideation with a chatbot is a document of extraordinary sensitivity. Who has access to it? How long is it retained? Can it be subpoenaed in a custody dispute? Can it be requested by law enforcement? Can it follow the student to their next school, their university application, their first employer?

These questions are not theoretical. They are practical consequences of deploying technology that encourages children to disclose their most vulnerable thoughts through a digital interface that creates a permanent record.

International Divergence

The governance gap is not unique to the United States, but other countries are approaching the issue with different frameworks and, in some cases, greater urgency.

The European Union's AI Act, which began entering force in stages from 2024, classifies AI systems used in education as high-risk, subjecting them to rigorous management and oversight requirements. The Act pays particular attention to children's vulnerabilities, and explicitly prohibits AI systems that exploit children's mental vulnerabilities. Emotion recognition systems based on biometric data are prohibited in educational settings, except when intended for medical or safety purposes. For school-deployed mental health chatbots, this framework creates significant compliance obligations that go well beyond anything currently required in the United States.

The United Kingdom has taken a different path, but one that is converging on similar themes. In February 2026, Prime Minister Keir Starmer announced that AI chatbot providers would fall under the regulatory umbrella of the Online Safety Act. Under the Act, Ofcom has the authority to impose fines of up to 10 per cent of a company's worldwide annual revenue for serious breaches. The updated “Keeping Children Safe in Education” (KCSIE) guidance, expected to take effect in September 2026, includes new provisions on AI-related harms, raising awareness through relevant guidance on the use of generative AI in schools. Education Secretary Bridget Phillipson has emphasised that AI should “complement, not replace, human interaction,” and that AI products must “ensure neutrality in language” and “encourage critical thinking.” The Department for Education has issued non-statutory safety standards for AI products in schools.

Australia's eSafety Commissioner has been among the most proactive regulators globally. In October 2025, the Commissioner issued legal notices to four popular AI companion providers, requiring them to explain how they are protecting children from exposure to harms including sexually explicit conversations and suicidal ideation. Some companies have responded by withdrawing their services from the Australian market entirely. Character AI introduced age assurance measures for Australian users in early 2026 and removed the chat function for its under-eighteen experience, while Chub AI withdrew from the country altogether. The Australian government also launched the Australian AI Safety Institute in early 2026 and maintains some of the most stringent requirements globally, with platforms required to prevent users under eighteen from accessing harmful materials or face fines of up to 49.5 million Australian dollars.

The contrast with the United States is stark. Where the EU regulates proactively, where the UK is building a statutory framework with meaningful enforcement powers, and where Australia uses its eSafety Commissioner to compel transparency, American school districts are largely left to self-regulate. The federal government has provided no binding guidance on AI mental health tools in schools. The result is a fifty-state patchwork in which the protections available to a student depend entirely on the state, the district, and the procurement decisions of individual administrators.

What Accountability Should Look Like

The current situation is untenable. Schools have a genuine need to support student mental health. AI tools offer genuine capabilities. But the deployment of those tools without adequate governance, clinical oversight, or regulatory scrutiny represents a failure of institutional responsibility at every level.

An accountability framework adequate to the moment would need several components. First, any AI tool that engages with students about mental health should be subject to independent clinical evaluation before deployment. This does not mean self-reported clinical trials funded by the vendor. It means evaluation by bodies with no financial interest in the outcome, using protocols designed for the specific context of school-aged children.

Second, parental consent should be meaningful, informed, and opt-in. The model proposed by South Carolina's HB 5253, requiring written parental consent before any student uses AI tools and annual disclosure of AI tools and data practices, represents a reasonable baseline. Parents cannot exercise judgement about tools they do not know exist.

Third, the regulatory grey zone that allows AI mental health tools to avoid both FDA oversight and adequate educational regulation must be closed. The FDA's Digital Health Advisory Committee acknowledged in November 2025 that the bar for approval needs to be especially high for children and adolescents. Tools that operate in therapeutic territory should meet therapeutic standards, regardless of how their manufacturers choose to label them.

Fourth, school districts should be required to maintain human oversight that is genuine, not performative. Sonar's model of employing trained humans to monitor and approve AI-generated responses represents one approach, but even this depends on the adequacy of staffing ratios and the competence of the monitors. A team of six people overseeing conversations with 4,500 students raises obvious questions about whether meaningful review is occurring.

Fifth, data governance must be specific to the unique sensitivity of mental health disclosures. Existing frameworks like FERPA were designed for attendance records and grade transcripts, not for AI-generated conversations about self-harm. Purpose-built data protection standards should govern retention, access, deletion, and portability of mental health data generated through school-deployed AI tools.

Sixth, there must be mandatory adverse event reporting. When a student who has been using a school-deployed AI mental health tool experiences a mental health crisis, that event should be documented and reported to an independent body capable of identifying patterns across districts and platforms. Currently, there is no such reporting requirement and no such body.

Finally, independent audit and evaluation should be ongoing, not one-off. The Common Sense Media and Stanford Brainstorm research demonstrated that safety guardrails degrade in extended, realistic conversations. A tool that passes an initial assessment may fail in the field. Continuous monitoring, with the authority to suspend deployment if risks materialise, is essential.

The Experiment Nobody Voted For

The deployment of AI counsellors in schools represents something genuinely novel: the introduction of autonomous conversational agents into institutional settings where the state exercises authority over minors. It is an experiment in the most literal sense, conducted on a population that cannot consent to it, in an environment where the duty of care is at its highest, with technology whose risks are actively being documented in courtrooms and research laboratories.

The people running this experiment are not villains. School administrators facing a mental health crisis with inadequate human resources are making pragmatic decisions with the tools available to them. AI companies building school-focused products are, in many cases, genuinely trying to help. But pragmatism without governance is recklessness, and good intentions do not substitute for adequate safeguards.

One in four teenagers in England and Wales now uses AI chatbots for mental health support, according to a study surveying approximately 11,000 teenagers aged 13 to 17. In the United States, approximately 5.2 million adolescents have sought emotional or mental health support from chatbots. Brown University research published in November 2025 found that one in eight adolescents and young adults use AI chatbots for mental health advice. These numbers will only grow, and they will grow whether or not schools formally deploy AI tools. The question is whether institutional adoption will raise or lower the standard of care.

Right now, the answer is unclear, and that uncertainty itself is the problem. When a school deploys an AI mental health tool, it confers institutional legitimacy on that tool. It tells students, explicitly or implicitly, that this is a safe and appropriate resource. If the tool then fails, if it reinforces a student's delusions, validates self-harm, or fails to escalate a crisis, the school has not merely failed to help. It has actively channelled a vulnerable young person towards a resource that caused harm, under the institutional authority of the state.

The lawsuits against Character.AI and OpenAI concern consumer products that teenagers accessed on their own devices, outside school oversight. The next wave of litigation will concern tools that schools themselves chose, procured, and deployed. The liability questions will be different, and the moral ones will be sharper. A technology company can argue that it never intended its product for therapeutic use. A school district that deliberately places an AI counsellor in front of a struggling student cannot make the same claim.

Twenty-five states are considering AI-in-education legislation. The EU AI Act is entering force. The UK is updating its safeguarding guidance. Australia is issuing transparency notices. These are steps in the right direction. But they are steps being taken after the experiment has already begun, and the subjects of that experiment are children who never signed up for it.

The counselling gap in schools is real and urgent. The desire to fill it is understandable. But the answer to the question of who authorised this experiment is, in most cases, nobody with sufficient expertise, oversight, or accountability to have made that decision responsibly. Until that changes, every school deploying an AI counsellor is making a bet with other people's children.

References

1. American School Counselor Association, “School Counselor Roles and Ratios,” schoolcounselor.org, 2024-2025 data.
2. TechCrunch, “This mental health chatbot aims to fill the counseling gap at understaffed schools,” 23 February 2025.
3. Maro, “Mental Health Screening for Schools,” meetmaro.com, accessed April 2026.
4. Centre on Reinventing Public Education, “Districts and AI: Early Adopters Focus More on Students in 2025-26,” crpe.org, 2025.
5. The Boston Globe, “AI chat bots are the new college counselors,” 25 March 2026.
6. CNN, “This mom believes Character.AI is responsible for her son's suicide,” 30 October 2024.
7. CNN, “Character.AI and Google agree to settle lawsuits over teen mental health harms and suicides,” 7 January 2026.
8. CNN, “Parents of 16-year-old Adam Raine sue OpenAI, claiming ChatGPT advised on his suicide,” 26 August 2025.
9. US Senate Judiciary Committee, “Written Testimony of Matthew Raine,” 16 September 2025.
10. TechCrunch, “OpenAI says over a million people talk to ChatGPT about suicide weekly,” 27 October 2025.
11. Common Sense Media, “Common Sense Media Finds Major AI Chatbots Unsafe for Teen Mental Health Support,” 20 November 2025.
12. RAND Corporation, “Teens Are Using Chatbots as Therapists. That's Alarming,” September 2025.
13. American Academy of Pediatrics, “Experts discuss potential benefits, harms, safeguards of using AI chatbots for mental health,” AAP News, 2025.
14. FutureEd, “Legislative Tracker: 2026 State AI in Education Bills,” future-ed.org, updated March 2026.
15. South Carolina Legislature, “2025-2026 Bill 5253: AI in Education,” scstatehouse.gov.
16. National Education Association, “Sample School Board Policy on AI Issues,” nea.org.
17. FDA Digital Health Advisory Committee, meeting on generative AI in digital mental health devices, 6 November 2025.
18. European Parliament, “Artificial Intelligence Act,” including Annex III on High-Risk AI Systems and provisions on children's vulnerability.
19. CNBC, “AI chatbot firms face stricter regulation in online safety laws protecting children in the UK,” 16 February 2026.
20. UK Department for Education, “Keeping Children Safe in Education 2026: Proposed Key Changes,” consultation document.
21. Australia eSafety Commissioner, “eSafety requires providers of AI companion chatbots to explain how they are keeping Aussie kids safe,” October 2025.
22. EdSource, “AI chatbots provide mental health support to 1 in 4 teenagers, study finds,” 2025.
23. Brown University School of Public Health, “One in eight adolescents and young adults use AI chatbots for mental health advice,” 18 November 2025.
24. RAND Corporation, “More Districts Are Training Teachers on Artificial Intelligence: Findings from the American School District Panel,” 2025.
25. Securly, “Student Wellness Monitoring Solution: Securly Aware,” securly.com, accessed April 2026.

---

Tim Green UK-based Systems Theorist & Independent Technology Writer

Tim explores the intersections of artificial intelligence, decentralised cognition, and posthuman ethics. His work, published at smarterarticles.co.uk, challenges dominant narratives of technological progress while proposing interdisciplinary frameworks for collective intelligence and digital stewardship.

His writing has been featured on Ground News and shared by independent researchers across both academic and technological communities.

ORCID: 0009-0002-0156-9795 Email: tim@smarterarticles.co.uk

Discuss...