— Ch. 1 · The Room And The Rules —
Chinese room.
~6 min read · Ch. 1 of 6
In 1980, philosopher John Searle published a paper titled Minds, Brains, and Programs in the journal Behavioral and Brain Sciences. This article introduced a thought experiment now known as the Chinese room argument. Imagine a person sitting inside a closed room with no knowledge of Chinese. Slips of paper containing Chinese characters slide under the door from outside. Inside the room, the person follows a detailed rulebook written in English. These rules tell him exactly which symbols to write on new slips of paper based on the shapes he sees on the incoming papers. He then slides these new papers back out under the door.
To an observer outside the room, this process looks like perfect communication. The machine behaves as if it understands Chinese perfectly well. No one can tell that they are communicating with a computer program rather than a hidden speaker who knows the language. Yet the person inside the room understands nothing about what is being said. He manipulates symbols without knowing their meaning. Searle argues that since the man does not understand, the system as a whole cannot be said to understand either. Therefore, running a program does not create understanding or consciousness.
Origins In Philosophy And Cybernetics
Searle did not invent his core idea in isolation. Gottfried Wilhelm Leibniz made a similar argument against mechanism in 1713. Leibniz imagined expanding the brain until it was the size of a mill. He found it difficult to believe that perception could arise from purely mechanical processes within such a structure. This early skepticism laid groundwork for later debates about whether machines could truly think.
In 1958, Peter Winch wrote The Idea of a Social Science and its Relation to Philosophy. He argued that a man who understands Chinese is not merely someone who has a firm grasp of statistical probabilities for word occurrences. Soviet cyberneticist Anatoly Dneprov published an essentially identical argument in 1961 through a short story called The Game. In this story, a stadium of people acted as switches and memory cells implementing a program to translate Portuguese sentences they did not know. A Professor Zarubin organized the game to answer the question Can mathematical machines think? Dneprov concluded that even the most perfect simulation of machine thinking is not the thinking process itself.
Ned Block envisioned the entire population of China involved in such a brain simulation in 1978. Lawrence H. Davis imagined duplicating the brain using telephone lines and offices staffed by people in 1974. These precursors set the stage for Searle's formalization of the problem in his 1980 paper.