Skip to content
— CH. 1 · INTRODUCTION —

AI effect

~4 min read · Ch. 1 of 6
6 sections
  • The AI effect is a puzzle that has haunted artificial intelligence research since the field began. A machine beats a grandmaster at chess, and the world marvels. Then, within years, the same achievement is waved aside as mere number-crunching. Historian Pamela McCorduck named it an "odd paradox" in her 2004 book Machines Who Think: the moment a problem is solved, it stops counting as intelligence. How does a genuine breakthrough keep getting reclassified as nothing special? And what does that pattern say about what we actually mean when we use the word intelligence?

  • Pamela McCorduck put her finger on the core mechanism. Once an AI system succeeds at a task, that task gets absorbed into other domains, and AI researchers move on to the next unsolved problem. The phenomenon is widely described as an instance of moving the goalposts. Researcher Rodney Brooks made the same observation in 2002, noting that once a system is fully understood, people tend to dismiss it as "just computation". The most compact formulation belongs to Tesler's theorem, often expressed as "AI is whatever hasn't been done yet". That phrase does something useful: it reveals that the word "intelligence" is being used as a placeholder for the unknown, not as a stable description of any fixed capacity. When problems resist full formalisation, researchers sometimes reach for models involving human-assisted computation to describe what is happening.

  • IBM's Deep Blue defeated world chess champion Garry Kasparov in 1997, a moment frequently cited as a landmark in AI history. Critics did not celebrate it as proof of machine intelligence. Instead, they argued that Deep Blue relied on brute-force search methods rather than genuine understanding. The same reinterpretation had happened earlier with checkers. Early systems capable of playing both games were initially held up as demonstrations that machines could think. As those systems became better understood, their achievements were reclassified: not intelligence, just computation. The goalposts had moved again. The pattern was consistent enough that it became a recognized feature of the field rather than an isolated reaction to any single system.

  • Optical character recognition and speech recognition were once central research problems in artificial intelligence. Both required machines to interpret ambiguous real-world input, which seemed to demand something like understanding. As these technologies became reliable and commercially widespread, they were reclassified as standard engineering. Michael Swaine reported in 2007 that AI advances are routinely presented to the public as developments in other fields entirely. Marvin Minsky observed that successful AI innovations tend to evolve into separate disciplines, detaching from their origins in intelligence research. Nick Bostrom noted in 2006 that once a technology is widely adopted, it is often no longer labeled as AI at all. The techniques do not disappear; they become invisible, folded into marketing systems, automation pipelines, and software applications, stripped of the label that once made them remarkable.

  • A 2016 survey of artificial intelligence noted that AI systems were increasingly embedded in everyday applications, reinforcing earlier observations that successful AI technologies tend to become normalized. That trend accelerated sharply with the rise of large language models and other generative AI systems. As these systems gained widespread commercial use, researchers and commentators began describing their outputs as statistical or mechanical, rather than as evidence of intelligence. The current moment is unusual in one respect: unlike earlier periods, including the AI winters when researchers sometimes avoided the term "artificial intelligence" due to negative associations, the label AI is now prominent in public discourse and marketing. Visibility has increased even as the underlying reclassification dynamic continues.

  • Michael Kearns suggested that people may seek to preserve a special role for humans, and that this desire shapes how AI achievements are evaluated. Herbert A. Simon noted that artificial intelligence can provoke strong emotional reactions, which hints at the personal stakes involved in how intelligence gets defined. Some philosophers argue that reclassification is not bias at all, but reflects genuine conceptual distinctions: a system that searches billions of positions per second may truly differ from understanding in some meaningful sense. Similar patterns of reclassification have been observed in studies of animal cognition, suggesting the impulse to redraw the boundary of intelligence is not unique to reactions toward machines. McCorduck's original insight from Machines Who Think remains the sharpest frame: the boundaries of intelligence shift precisely when machines get close enough to cross them.

Continue Browsing

Common questions

What is the AI effect?

The AI effect is the phenomenon in which advances in artificial intelligence lead to a redefinition of intelligence, so that capabilities achieved by AI systems are no longer regarded as examples of real intelligence. Successful AI techniques are reclassified as routine computation or absorbed into other domains. Historian Pamela McCorduck described it as a recurring feature of AI research in her 2004 book Machines Who Think.

What is Tesler's theorem and how does it relate to the AI effect?

Tesler's theorem is commonly expressed as "AI is whatever hasn't been done yet." It captures the AI effect by showing that the word intelligence functions as a placeholder for unsolved problems rather than a stable description of any fixed capability. Once a system solves a problem, that problem is no longer counted as intelligence.

How did the 1997 Deep Blue vs. Kasparov match illustrate the AI effect?

IBM's Deep Blue defeated Garry Kasparov in 1997, but critics argued the system relied on brute-force search methods rather than genuine understanding. Rather than being celebrated as proof of machine intelligence, the victory was reclassified as an example of computation, following the same pattern seen earlier with checkers-playing systems.

Who first described the AI effect and when?

Historian Pamela McCorduck described the AI effect as a recurring feature of AI research in her 2004 book Machines Who Think, calling it an "odd paradox" in which successful AI systems are assimilated into other domains. Researcher Rodney Brooks made a similar observation in 2002, noting that understood systems are often dismissed as "just computation".

Why do successful AI technologies stop being called AI?

Nick Bostrom noted in 2006 that widely adopted technologies are often no longer labeled as AI. Marvin Minsky observed that successful AI innovations tend to evolve into separate disciplines. Michael Swaine reported in 2007 that AI advances are frequently presented to the public as developments in entirely different fields.

Does the AI effect apply to modern large language models?

Researchers and commentators have noted that the capabilities of large language models and other generative AI systems are frequently described as statistical or mechanical once understood, rather than as intelligence. A 2016 survey of artificial intelligence observed that AI systems were increasingly embedded in everyday applications, a pattern consistent with the AI effect observed in earlier decades.

All sources

15 references cited across the entry

  1. 1journalA Brief History of Artificial Intelligence: On the Past, Present, and Future of Artificial IntelligenceMichael Haenlein — 2019
  2. 2webAI GlossaryStottler Henke Associates
  3. 3bookMachines Who ThinkPamela McCorduck — A. K. Peters — 2004
  4. 4magazineIt's AliveJennifer Kahn — March 2002
  5. 5journalIntelligence at any price? A criterion for defining AIMihai Nadin — 2023
  6. 6bookGödel, Escher, Bach: an Eternal Golden BraidDouglas Hofstadter — Basic Books — 1980
  7. 7conferenceTowards a theory of AI completenessDafna Shahaf — 2007
  8. 8webAI – It's OK Again!Michael Swaine
  9. 11reportOn the Opportunities and Risks of Foundation ModelsRishi Bommasani — Stanford Center for Research on Foundation Models — 2021
  10. 13reportArtificial Intelligence and Life in 2030Peter Stone — Stanford University — 2016
  11. 14newsA new robot makes a leap in brainpowerFaye Flam — January 15, 2004
  12. 15journalA Conversation with Herbert SimonReuben L. Hann — 1998