Skip to content
— CH. 1 · INTRODUCTION —

Philosophy of artificial intelligence

~11 min read · Ch. 1 of 8
8 sections
  • The philosophy of artificial intelligence sits at a crossroads that has puzzled thinkers for centuries: what exactly is a mind, and could a machine ever have one? In 1950, computer scientist Alan Turing proposed a deceptively simple test. If a machine could hold a conversation indistinguishable from that of a real human, should we call it intelligent? That question - modest on the surface - opens into some of the deepest disputes in all of human inquiry. Can a machine genuinely understand, or only appear to? Is the human brain itself a kind of computer? And if consciousness is real, can circuits and code ever produce it? These are not idle puzzles. They sit at the heart of what it means to think, to feel, and to be alive. The philosophy of artificial intelligence, as a formal branch of both the philosophy of mind and the philosophy of computer science, exists precisely to wrestle with them.

  • Alan Turing, writing in 1950, observed that nobody - except philosophers - ever seriously asks whether people can think. He pointed out that society runs on a quiet agreement, a "polite convention", that everyone thinks. His test extended that same courtesy to machines: if a machine behaves as intelligently as a human being, then it is as intelligent as a human being. A modern version of his experimental design places one human and one computer program in an online chat room. If no observer can tell which participant is which, the program passes.

    Critics, including Stuart Russell and Peter Norvig, note that this test measures "humanness" rather than intelligence. They offer an analogy: aeronautical engineers do not define their goal as building machines that fly so exactly like pigeons that they can fool other pigeons. The test, useful as it is, confuses two things that are not identical.

    By the twenty-first century, AI researchers had shifted to a different framework. AI founder John McCarthy defined intelligence as "the computational part of the ability to achieve goals in the world." Russell and Norvig formalized this with the concept of an agent - something that perceives and acts in an environment, measured by a performance metric. The advantage of this approach is that it does not reward human-like typing errors. The disadvantage is blunt: by this definition, even a thermostat possesses a rudimentary intelligence.

  • Hubert Dreyfus framed one of the core arguments for machine intelligence this way: if the nervous system obeys the laws of physics and chemistry, then any physical device ought to be able to reproduce its behavior. The argument dates to at least 1943 and was vividly described by Hans Moravec in 1988. Futurist Ray Kurzweil later estimated that computer power sufficient for a complete brain simulation would arrive by 2029. In 2005, researchers did complete a non-real-time simulation of a thalamocortical model the size of the human brain - one hundred billion neurons - and it took 50 days running on a cluster of 27 processors to simulate just one second of brain dynamics.

    Even AI's harshest critics, including Dreyfus and John Searle himself, accept that brain simulation is theoretically possible. But Searle raises a pointed objection: anything can, in principle, be simulated by a computer, which stretches the definition of "computation" to a breaking point. What we actually want to know, he writes, is what distinguishes the mind from thermostats and livers. Building a jet airliner by copying a bird feather by feather, without understanding aeronautics, would miss the point entirely.

    Allen Newell and Herbert Simon offered a different route. In 1963, they proposed that symbol manipulation was the essence of both human and machine intelligence, stating that "a physical symbol system has the necessary and sufficient means of general intelligent action." This claim cuts in two directions at once: it implies human thought is a kind of symbol processing, and that machines can therefore be intelligent. Most AI programs written between 1956 and 1990 operated on this premise. Modern AI, built on statistics and mathematical optimization, has largely moved away from it.

  • In 1931, Kurt Gödel proved his incompleteness theorem, showing that any consistent formal system of logic can always be used to construct a true statement it cannot itself prove. Philosopher John Lucas, beginning in 1961, and mathematician Roger Penrose, beginning in 1989, argued that humans can grasp these unprovable truths in ways no machine ever could. If that is right, human reasoning exceeds what any Turing machine can do.

    The argument rests on a significant assumption: that human mathematicians are both perfectly consistent and fully confident in their own consistency. The modern consensus among scientists and mathematicians is that actual human reasoning is inconsistent, and that any idealized consistent version of human reasoning would have to maintain what amounts to a healthy skepticism about its own reliability. The textbook Artificial Intelligence states that any attempt to use Gödel's results to attack the computationalist thesis "is bound to be illegitimate, since these results are quite consistent with the computationalist thesis."

    Douglas Hofstadter, in his Pulitzer Prize-winning book Gödel, Escher, Bach: An Eternal Golden Braid, pointed out that Gödel statements refer to the system producing them - the same self-referential trap as the Epimenides paradox, the statement "this statement is false". Crucially, the paradox applies equally to humans and machines. Lucas himself cannot assert the truth of the statement "Lucas can't assert the truth of this statement" - which is true, but unprovable by Lucas. Penrose, having concluded that human reasoning is non-computable, went further and speculated that quantum mechanical processes involving the collapse of wave functions inside neurons might give humans some advantage. Other scientists counter that there is no plausible organic mechanism in the brain for harnessing quantum computation, and that the timescale of quantum decoherence appears too fast to influence how neurons fire.

  • Hubert Dreyfus argued that human intelligence rests primarily on fast, intuitive judgements rather than on step-by-step rule-following, and that no set of formal rules would ever fully capture those intuitive skills. Turing had actually anticipated this objection in his 1950 paper Computing Machinery and Intelligence, classifying it as the "argument from the informality of behavior." Turing's response was careful: just because we do not know the rules governing a complex behavior does not mean no such rules exist. He wrote that "the only way we know of for finding such laws is scientific observation, and we certainly know of no circumstances under which we could say, 'We have searched enough. There are no such laws.'"

    In the decades after Dreyfus published his critique, AI research moved considerably closer to his position, though not because of it. Robotics adopted what is called the situated movement, trying to capture unconscious skills of perception and attention. Neural networks, evolutionary algorithms, and statistical approaches to AI all focus on simulated unconscious reasoning rather than explicit symbol manipulation. Research into commonsense knowledge attempts to reproduce the background context that humans take for granted.

    Cognitive science and psychology eventually arrived at a similar conclusion through their own paths. Daniel Kahneman and others developed a framework distinguishing "System 1" - fast, intuitive judgements - from "System 2" - slow, deliberate, step-by-step thinking. Historian and AI researcher Daniel Crevier wrote that "time has proven the accuracy and perceptiveness of some of Dreyfus's comments", and added that had Dreyfus framed his critique less aggressively, "constructive actions they suggested might have been taken much earlier."

  • John Searle drew a sharp line between two positions. "Weak AI" holds that a physical symbol system can act intelligently. "Strong AI" holds that it can actually have a mind, mental states, and consciousness - in exactly the sense that human beings do. To show why the strong version fails, Searle invented a thought experiment in 1980.

    Imagine a computer program that passes the Turing test and converses fluently in Chinese. Now write that program onto index cards and hand them to a person who does not speak Chinese. Lock the person in a room. The person follows the instructions, copies out Chinese characters, and passes them through a slot. From outside, the room appears to contain a fluent Chinese speaker. But Searle asks: does anyone inside actually understand Chinese? The man does not. The room cannot. The cards certainly do not. Searle concludes that no physical symbol system can have a mind, and goes further to argue that mental states require the specific physical and chemical properties of actual human brains - that "brains cause minds."

    The argument is not new. Gottfried Leibniz made essentially the same point in 1714, using the thought experiment of expanding the brain to the size of a mill. In 1974, Lawrence Davis imagined duplicating the brain using telephone lines and offices staffed by people. In 1978, Ned Block envisioned the entire population of China participating in such a simulation, a thought experiment called "the Chinese Nation" or "the Chinese Gym."

    Responses to Searle vary. The systems reply argues that the relevant understanding belongs not to the man but to the whole system: man, cards, room, and program together. Hans Moravec proposed the robot reply - that genuine understanding requires eyes and hands, a body anchored in the physical world. Others note that Searle's argument is just a form of the problem of other minds applied to machines. Daniel Dennett added a striking observation: natural selection cannot preserve any feature that has no effect on behavior, so if consciousness as Searle describes it cannot be detected from behavior, it could not have evolved in the first place.

  • Turing addressed a long parade of objections to machine intelligence, each of the form "a machine will never do X." His list included: be kind, resourceful, beautiful, friendly, have a sense of humor, tell right from wrong, make mistakes, fall in love, learn from experience, or do something really new. He argued that these objections rest either on naive assumptions about machines or are disguised versions of the argument from consciousness. Unless someone can show that one of these traits is strictly necessary for general intelligence, Turing wrote, none of them constitute a real objection.

    On creativity specifically, Turing argued that a machine can obviously take us by surprise - as any programmer can confirm - and that a computer with sufficient storage can behave in an astronomical number of different ways. Douglas Lenat's Automated Mathematician is one example the source points to: it combined existing ideas to discover new mathematical truths. In 2009, scientists at Aberystwyth University in Wales and the University of Cambridge designed a robot called Adam that they considered the first machine to independently arrive at new scientific findings. That same year, researchers at Cornell developed a program called Eureqa that extrapolated formulas directly from observed data, recovering the laws of motion from a pendulum's behavior.

    On emotion, Hans Moravec argued that if emotions are defined by their functional role - how they shape behavior inside an organism - then they are mechanisms an intelligent agent can use to maximize the quality of its actions. Fear generates urgency. Empathy enables useful interaction. Moravec suggested that robots "will try to please you in an apparently selfless manner because it will get a thrill out of this positive reinforcement." Daniel Crevier summarized Moravec's point: emotions are devices for directing behavior toward the survival of one's species. Whether a machine that functions this way is "really" feeling anything remains, of course, the central open question.

  • Vernor Vinge proposed that computers might, over just a few years, become thousands or millions of times more intelligent than humans. He named this threshold the Singularity and suggested it could prove dangerous. In 2009, a conference of academics and technical experts gathered specifically to examine the potential hazards posed by increasingly autonomous robots and computers. They noted that some machines had already acquired limited autonomous behaviors: finding their own power sources and independently selecting targets to attack with weapons. Some computer viruses had proved capable of evading elimination - what the group described as "cockroach intelligence." They judged that self-awareness as depicted in science fiction was unlikely, but agreed that other hazards deserved serious attention.

    Eliezer Yudkowsky coined the term "Friendly AI" to describe the goal of building artificial intelligence that is intrinsically humane, not merely constrained by external rules. The US Navy funded a report recommending greater attention to the implications of autonomous military robots as their complexity increased. The President of the Association for the Advancement of Artificial Intelligence commissioned a separate study on the same issue.

    Physicist David Deutsch has argued that without genuine engagement with philosophy, AI development will stall. The main conference series dedicated to this intersection, Philosophy and Theory of AI (PT-AI), is run by Vincent C. Müller, whose survey of the field was published in 2025. The questions Turing posed in 1950 remain genuinely open: whether a machine can understand, whether it can be conscious, and whether anything we build will ever be, in the fullest sense, a mind.

Up Next

Continue Browsing

Common questions

What is the philosophy of artificial intelligence about?

The philosophy of artificial intelligence is a branch of the philosophy of mind and the philosophy of computer science that explores whether machines can be intelligent, conscious, or have genuine mental states. It addresses questions about the nature of intelligence, ethics, consciousness, epistemology, and free will as they relate to AI systems.

What is the Turing test and what does it measure?

The Turing test, introduced by Alan Turing in 1950, proposes that if a machine can converse in a way indistinguishable from a human in an online chat, it should be considered intelligent. Critics including Stuart Russell and Peter Norvig have argued that it measures "humanness" rather than genuine intelligence, since human behavior and intelligent behavior are not identical.

What is John Searle's Chinese room argument?

John Searle's Chinese room thought experiment asks us to imagine a person following instructions on index cards to produce fluent Chinese responses without understanding Chinese at all. Searle concluded that no physical symbol system can possess a mind or genuine understanding, and that mental states require the specific physical and chemical properties of actual human brains.

What did Allen Newell and Herbert Simon argue about machine intelligence?

In 1963, Allen Newell and Herbert Simon proposed the physical symbol system hypothesis, stating that "a physical symbol system has the necessary and sufficient means of general intelligent action." This implied both that human thinking is a form of symbol manipulation and that machines capable of symbol manipulation can be intelligent.

How did Hubert Dreyfus critique artificial intelligence research?

Hubert Dreyfus argued that human intelligence depends primarily on fast intuitive judgements rather than step-by-step symbolic rules, and that formal rules could never fully capture these intuitive skills. Historian Daniel Crevier later wrote that "time has proven the accuracy and perceptiveness of some of Dreyfus's comments," and that his insights might have shaped AI research sooner had they been stated less aggressively.

What is the Singularity in the context of AI philosophy?

The Singularity is a concept proposed by Vernor Vinge describing the hypothetical point at which computers might become thousands or millions of times more intelligent than humans, potentially over just a few years. Vinge suggested this transition could be dangerous for humanity, a concern examined by the philosophical position called Singularitarianism.

All sources

58 references cited across the entry

  1. 2journalAI Algorithms as (Un)virtuous KnowersHans Van Eyghen — 2025
  2. 3journalWhy the confusion matrix fails as a model of knowledgeIan van der Linde — 2025
  3. 5journalPhilosophy of AI: A structured overviewVincent C. Müller — 2025
  4. 6citationArtificial IntelligenceSelmer Bringsjord et al. — Metaphysics Research Lab, Stanford University — 2018
  5. 7harvnbRussell, Norvig (2003) p. 947Russell, Norvig — 2003
  6. 8harvnbTuring (1950)Turing — 1950
  7. 9harvnbMcCarthy, Minsky, Rochester (1955)McCarthy, Minsky, Rochester — 1955
  8. 10harvnbNewell, Simon (1976)Newell, Simon — 1976
  9. 11harvnbDennett (1991) p. 435Dennett — 1991
  10. 12harvnbHobbes (1651) p. chpt. 5Hobbes — 1651
  11. 13harvnbRussell, Norvig (2003) p. 3Russell, Norvig — 2003
  12. 14harvnbRussell, Norvig (2003) p. 4–5, 32, 35, 36 and 56Russell, Norvig — 2003
  13. 15newsArtificial Stupidity1 August 1992
  14. 16harvnbKurzweil (2005) p. 262Kurzweil — 2005
  15. 17webEugene M. Izhikevich, Large-Scale Simulation of the Human BrainEugene Izhikevich — Vesicle.nsi.edu — 2005-10-27
  16. 18harvnbSearle (1980) p. 4Searle — 1980
  17. 19harvnbDreyfus (1979) p. 156Dreyfus — 1979
  18. 20harvnbLucas (1961)Lucas — 1961
  19. 21webGödel's Incompleteness TheoremsOppy — 20 January 2015
  20. 22bookArtificial Intelligence: A Modern ApproachStuart J. Russell et al. — Prentice Hall — 2010
  21. 23harvnbRussell, Norvig (2003) p. 950Russell, Norvig — 2003
  22. 24harvnbHofstadter (1979)Hofstadter — 1979
  23. 25harvnbHofstadter (1979) p. 476–477Hofstadter — 1979
  24. 26harvnbPenrose (1989)Penrose — 1989
  25. 27journalIs the Brain a Quantum Computer?Abninder Litt et al. — 6 May 2006
  26. 28harvnbDreyfus (1972)Dreyfus — 1972
  27. 29harvnbRussell, Norvig (2003) p. 950–951Russell, Norvig — 2003
  28. 30harvnbRussell, Norvig (2003) p. 52Russell, Norvig — 2003
  29. 31harvnbBrooks (1990)Brooks — 1990
  30. 32bookThinking, Fast and SlowKahneman — Macmillan — 2011
  31. 33harvnbCrevier (1993) p. 125Crevier — 1993
  32. 34harvnbDennett (1991)Dennett — 1991
  33. 35harvnbBlackmore (2005) p. 2Blackmore — 2005
  34. 36harvnbRussell, Norvig (2003) p. 954–956Russell, Norvig — 2003
  35. 37harvnbSearle (1980) p. 11Searle — 1980
  36. 38harvnbSearle (1980)Searle — 1980
  37. 39harvnbSearle (1980) p. 13Searle — 1980
  38. 40harvnbSearle (1984)Searle — 1984
  39. 41harvnbCole (2004) p. 2.1Cole — 2004
  40. 42harvnbCole (2004) p. 2.3Cole — 2004
  41. 43harvnbCole (2004) p. 4.2Cole — 2004
  42. 44harvnbCrevier (1993) p. 272Crevier — 1993
  43. 45harvnbHorst (2005)Horst — 2005
  44. 46harvnbHarnad (2001)Harnad — 2001
  45. 47harvnbCrevier (1993) p. 266Crevier — 1993
  46. 48journalKaplan Andreas; Michael HaenleinJanuary 2019
  47. 49webRobo-scientist makes gene discovery-on its own | CraveLeslie Katz — News.cnet.com — 2009-04-02
  48. 57inline.