Claude Shannon

• 1. Introduction

  ›

  Claude Elwood Shannon was born on the 30th of April 1916, in a hospital in Petoskey, Michigan, and by the time he died on the 24th of February 2001, he had done something almost no individual in history can claim: he invented an entirely new science. Not extended one, not contributed to one. Invented one, from scratch.

  His 1948 paper, "A Mathematical Theory of Communication", has been called the Magna Carta of the Information Age. Electrical engineer Robert G. Gallager called it a blueprint for the digital era. And Solomon W. Golomb, a mathematician who knew Shannon's work intimately, compared his influence on the digital age to that which the inventor of the alphabet has had on literature.

  Every compact disc ever pressed, every mobile phone call ever made, every packet of data ever sent across the internet traces a direct line back to Shannon's ideas. He formally introduced the word "bit" into the vocabulary of computing. He proved the unbreakability of the one-time pad in cryptography. He co-organized the 1956 Dartmouth workshop now regarded as the founding event of artificial intelligence.

  And yet historian James Gleick has noted that despite all of this, Shannon remains far less celebrated than he deserves. So who was this man, how did a boy from small-town Michigan arrive at ideas that would define the century, and what did he actually do that was so consequential? The answers turn out to be stranger, funnier, and more profound than almost any biography of a scientist has a right to be.

• 2. A Boy from Gaylord

  ›

  Gaylord, Michigan, was where Shannon spent the first sixteen years of his life. His father, Claude Sr., born in 1862, worked as a businessman and served for a time as judge of probate in the town. His mother, Mabel Wolf Shannon, born in 1880, was a language teacher who also served as principal of Gaylord High School. Claude Sr. traced his roots to New Jersey settlers; Mabel was the child of German immigrants. The family attended their Methodist Church regularly during Shannon's youth.

  At home, the young Shannon built things. He constructed models of planes, a radio-controlled model boat, and a barbed-wire telegraph system that stretched a full half-mile to a friend's house. He also worked as a messenger for Western Union. His best subjects at school were science and mathematics, and he graduated from Gaylord High School in 1932.

  Shannon's childhood hero was Thomas Edison. He would later discover that Edison was in fact a distant cousin. Both men were descendants of John Ogden, a colonial leader born in 1609, making Shannon part of a genealogical thread connecting two of America's most consequential inventors.

  In 1932, Shannon entered the University of Michigan, where he first encountered the work of George Boole. That encounter would become the seed of the most important master's thesis of the twentieth century.

• 3. The Master's Thesis That Started Everything

  ›

  In 1936, Shannon arrived at MIT as a 21-year-old graduate student in electrical engineering. He began working on Vannevar Bush's differential analyzer, an early analog computer built from electromechanical parts that could solve differential equations. While studying its complicated, improvised circuits, Shannon saw something no one had noticed before: the logical structure underneath the wiring corresponded precisely to the algebra George Boole had worked out a century earlier.

  His 1937 master's thesis, "A Symbolic Analysis of Relay and Switching Circuits", demonstrated that electrical switches could implement Boolean logic and thereby construct any logical numerical relationship. A version of the thesis was published in 1938. In the final chapter, Shannon presented diagrams of several circuits, among them a digital 4-bit full adder. His approach was far more abstract than that of earlier engineers like Akira Nakashima, who had remained grounded in existing circuit theory. Shannon's ideas relied on pure mathematics.

  In 1972, Herman Goldstine described the thesis as "surely... one of the most important master's theses ever written... It helped to change digital circuit design from an art to a science." Howard Gardner called it in 1987 "possibly the most important, and also the most famous, master's thesis of the century." One reviewer at the time wrote that it was, to the best of his knowledge, the first application of symbolic logic methods to a practical engineering problem, and rated it outstanding for originality.

  The thesis won the 1939 Alfred Noble Prize. Its insight that switching circuits could implement logic is the fundamental concept underlying every electronic digital computer built since.

• 4. Wartime Secrets

  ›

  Shannon had spent a few months at Bell Labs in the summer of 1937, and he returned there during World War II to work on fire-control systems and cryptography under a contract with the National Defense Research Committee's Control Systems section.

  For two months early in 1943, Shannon came into regular contact with the British mathematician Alan Turing. Turing had come to Washington to share methods used at Bletchley Park for breaking the ciphers used by German U-boats in the north Atlantic. He also had an interest in speech encipherment and spent time at Bell Labs. Shannon and Turing met at teatime in the cafeteria. Turing showed Shannon his 1936 paper defining the universal Turing machine, which Shannon found compelling because so many of its ideas complemented his own developing work.

  In September 1945, Shannon prepared a classified memorandum for Bell Telephone Labs titled "A Mathematical Theory of Cryptography". A declassified version appeared in 1949 in the Bell System Technical Journal as "Communication Theory of Secrecy Systems". In that paper, Shannon proved that the one-time pad is unbreakable, and that any truly unbreakable cipher must share its essential properties: the key must be random, as large as the plaintext, never reused, and kept secret. His wartime writing has been called a turning point marking the closure of classical cryptography and the beginning of the modern discipline. Shannon himself said that his insights into communication theory and cryptography developed simultaneously, and that "they were so close together you couldn't separate them".

  Shannon also credited himself with co-authoring a 1945 essay on fire-control, alongside Ralph Beebe Blackman and Hendrik Wade Bode, that modeled the problem of smoothing targeting data by analogy with separating a signal from noise in a communications system. That framing pointed directly toward the information theory he was already developing in private.

• 5. The Magna Carta of the Information Age

  ›

  In July and October of 1948, Shannon's long-promised paper appeared in two parts in the Bell System Technical Journal under the title "A Mathematical Theory of Communication". At its core, the paper addressed a deceptively simple question: how do you most efficiently encode a message for transmission?

  To answer it, Shannon invented the concept of information entropy, a mathematical measure of the uncertainty that a message reduces. In doing so, he built an entirely new field. He formally introduced the word "bit" as the fundamental unit of information. His 1951 paper "Prediction and Entropy of Printed English" extended the framework to natural language, establishing statistical bounds on the entropy of written English and proving that treating space as the 27th letter of the alphabet actually lowers uncertainty in written text.

  The reach of Shannon's 1948 paper proved extraordinary. In a 1973 collection of key papers in information theory, Shannon was author or co-author of 12 of the 49 papers cited; no other researcher appeared more than three times. Beyond the original paper, he remained the most important post-1948 contributor to the field he had created.

  In May 1951, the director of the CIA, General Walter Bedell Smith, sent a request to Mervin Kelly asking for Shannon's participation in the CIA's Special Cryptologic Advisory Group. The request described Shannon, based on "the best authority", as the most eminently qualified scientist in his particular field. Shannon joined the group that year.

  An AT&T Fellow named Neil Sloane, who co-edited Shannon's collected papers in 1993, put it plainly: "He's one of the great men of the century. Without him, none of the things we know today would exist. The whole digital revolution started with him."

• 6. Theseus and the Birth of AI

  ›

  In 1950, Shannon designed and built a learning machine he named Theseus, doing so with the help of his wife Betty. It consisted of a maze mounted on a surface, through which a mechanical mouse could move. Beneath the surface, an electromechanical relay circuit tracked the mouse's path. The mouse would search through corridors until it found the target. Once it had traversed the maze, the mouse could be placed anywhere it had previously been and navigate directly to the goal. If placed in unfamiliar territory, it searched until it reached a known location, then proceeded to the target, incorporating the new path into its memory.

  Theseus appears to have been the first artificial learning device of its kind. Mazin Gilbert later stated that it "inspired the whole field of AI. This random trial and error is the foundation of artificial intelligence."

  Shannon's work on machine intelligence extended well beyond the mouse. His 1950 paper "Programming a Computer for Playing Chess" described how to program a computer using position scoring and a minimax procedure. He assigned piece values and proposed fractional penalties for structural weaknesses such as doubled, backward, and isolated pawns, and added a mobility bonus of 0.1 points per legal move. The paper, published in Philosophical Magazine in March 1950, is among the first ever published on the subject.

  Shannon also estimated the game-tree complexity of chess as approximately 10 to the power of 120, a number now known as the Shannon number and still considered an accurate estimate. Alongside John McCarthy, Marvin Minsky, and Nathaniel Rochester, Shannon co-organized the 1956 Dartmouth workshop, the event recognized as the founding moment of the field of artificial intelligence. He joined the MIT faculty that same year, holding an endowed chair and working in the Research Laboratory of Electronics until 1978.

• 7. The Man Behind the Theory

  ›

  Shannon married Norma Levor in January 1940. The marriage ended in divorce a year later, and Levor later married Ben Barzman. Shannon met his second wife, Mary Elizabeth Moore, known as Betty, when she was working as a numerical analyst at Bell Labs. They married in 1949 and had three children. Betty assisted Claude directly in building some of his most recognized inventions, including Theseus.

  Shannon's interests outside mathematics were genuinely eccentric and deeply pursued. He juggled, rode unicycles, and played chess. He invented a Roman numeral computer called THROBAC and built juggling machines. He constructed a device that could solve the Rubik's Cube. He invented flame-throwing trumpets and rocket-powered frisbees. He designed plastic foam shoes intended to let a person appear to walk on water.

  He was also a serious and successful investor. A report in Barron's dated the 11th of August 1986 detailed the performance of 1,026 mutual funds; Shannon's returns exceeded those of 1,025 of them. Comparing his portfolio returns from the late 1950s to 1986 with Warren Buffett's from 1965 to 1995, Shannon came in at roughly 28% compared to Buffett's 27%. A snapshot of his portfolio in 1981 showed a value of $582,717.50, which translated to approximately $1.5 million in 2015 terms, not counting at least one additional stock. Shannon described his core investing method, later called Shannon's demon, as holding equal parts cash and a single stock, then rebalancing regularly to exploit the stock's random price fluctuations.

  Shannon presented himself as apolitical and an atheist. He developed Alzheimer's disease in his later years and spent his final period in a nursing home, dying in 2001 and survived by Betty, a son, a daughter, and two granddaughters.

• 8. Legacy and Reach

  ›

  Six statues of Shannon, all sculpted by Eugene Daub, stand at institutions that mark the arc of his career: the University of Michigan, MIT's Laboratory for Information and Decision Systems, Bell Labs, AT&T Shannon Labs, the University of California San Diego, and Gaylord, Michigan, where a park bears his name. After the breakup of the Bell System, the part of Bell Labs that remained with AT&T Corporation was renamed Shannon Labs in his honor.

  In June 1954, Fortune listed Shannon among the top 20 most important scientists in America. The Claude E. Shannon Award was established in his honor, and he was its first recipient, in 1973. His other honors include the National Medal of Science presented by President Lyndon B. Johnson in 1966, the Kyoto Prize in 1985, and the Marconi Society Lifetime Achievement Award in 2000.

  The roboticist Rodney Brooks declared Shannon the 20th-century engineer who contributed the most to 21st-century technologies. The biographers Jimmy Soni and Rob Goodman, writing in their 2017 book A Mind at Play, described him as "the most important genius you've never heard of". Electrical engineer Robert Gallager said of him: "He had this amazing clarity of vision. Einstein had it, too. This ability to take on a complicated problem and find the right way to look at it, so that things become very simple."

  The feature documentary The Bit Player, directed by Mark Levinson and produced by Sergio Verdu, drew on interviews conducted with Shannon in his home during the 1980s. It premiered at the World Science Festival in 2019 and was released on Amazon Prime in August 2020. Shannon's centenary in 2016 was marked by events at dozens of institutions worldwide, and Google honored the day with a Doodle on the 30th of April 2016, what would have been his 100th birthday. The cryptocurrency unit called the shannon, a synonym for gwei, was named after him. And Claude, the large language model developed by Anthropic, is partially named in Shannon's honor.