Skip to content
— CH. 1 · INTRODUCTION —

Game theory

11 min listen · Ch. 1 of 8
8 sections
  • Game theory is the study of mathematical models of strategic interactions, and it began with a question about what a rational person should do when someone else is trying to outmaneuver them. The field started narrow. At first it addressed two-person zero-sum games, where one participant's gains are exactly balanced by the other's losses. By the 1950s it had stretched far past that, into non zero-sum situations, and eventually into a wide range of behavioral relations. Today it is an umbrella term for the science of rational decision making in humans, animals, and computers. How did a tool built to solve card games end up explaining the stability of monarchies, the sex ratios of animals, and the logic of nuclear deterrence? Why did fifteen of its practitioners win the Nobel Prize in economics? And why, according to one of its pioneers, does it fit biology better than the economics it was designed for?

  • Cardano wrote on games of chance in Liber de ludo aleae, the Book on Games of Chance, composed around 1564 but only published posthumously in 1663. Long before anyone spoke of modern game theory, the mathematics of games drew careful minds toward the structure of luck and choice. Influenced by Fermat and Pascal working on the problem of points, Huygens developed the concept of expectation by reasoning about games of chance. He published his gambling calculus in De ratiociniis in ludo aleae, On Reasoning in Games of Chance, in 1657. In 1713, a letter attributed to Charles Waldegrave, an active Jacobite and uncle to the British diplomat James Waldegrave, analyzed a card game called le her. Waldegrave gave a minimax mixed strategy solution to a two-person version of the game. That puzzle is now known as the Waldegrave problem. In 1838, Antoine Augustin Cournot built a model of competition in oligopolies in his Recherches sur les principes mathematiques de la theorie des richesses. He did not use the term, but his solution is what we now call the Nash equilibrium. In 1883, Joseph Bertrand attacked Cournot's model as unrealistic and offered an alternative model of price competition, later formalized by Francis Ysidro Edgeworth. In 1913, Ernst Zermelo published a paper on set theory applied to chess, proving that optimal chess strategy is strictly determined.

  • John von Neumann published On the Theory of Games of Strategy in 1928, and with it game theory became its own independent field. His original proof used Brouwer's fixed-point theorem on continuous mappings into compact convex sets. That technique became a standard method in game theory and mathematical economics. Emile Borel had circled the same territory. In his 1938 book Applications aux Jeux de Hasard and earlier notes, Borel proved a minimax theorem for two-person zero-sum matrix games, but only when the pay-off matrix is symmetric. He even conjectured that mixed-strategy equilibria do not exist in finite two-person zero-sum games. Von Neumann proved that conjecture false. Von Neumann's work culminated in the 1944 book Theory of Games and Economic Behavior, co-authored with Oskar Morgenstern, which considered cooperative games of several players. The second edition supplied an axiomatic theory of utility, reviving Daniel Bernoulli's old theory of utility of money as an independent discipline. That step let mathematical statisticians and economists treat decision-making under uncertainty as a formal problem rather than a guess.

  • In 1950, John Nash proposed a criterion for the mutual consistency of players' strategies, now called the Nash equilibrium. It applies to a far wider variety of games than the earlier von Neumann and Morgenstern criterion. Nash proved that every finite n-player, non-zero-sum, non-cooperative game has a Nash equilibrium in mixed strategies. A Nash equilibrium is a set of strategies, one for each player, such that no player can improve their payoff by unilaterally changing strategy. The 1950s brought a flurry of new ideas. Game theorists developed the core, the extensive form game, fictitious play, repeated games, and the Shapley value. The decade also saw the first applications of game theory to philosophy and political science. The first mathematical discussion of the prisoner's dilemma appeared during this period. Mathematicians Merrill M. Flood and Melvin Dresher ran an experiment on it as part of the RAND Corporation's investigations. RAND pursued these studies because of their possible applications to global nuclear strategy.

  • Reinhard Selten introduced the solution concept of subgame perfect equilibria in 1965, a refinement of the Nash equilibrium, and he later added trembling hand perfection. In 1994, Nash, Selten, and John Harsanyi shared the Nobel Memorial Prize in the Economic Sciences for their contributions to economic game theory. The honors kept coming as the field matured. In 2005, Thomas Schelling and Robert Aumann became laureates. Schelling worked on dynamic models, early examples of evolutionary game theory, while Aumann introduced correlated equilibria and built a formal analysis of common knowledge and its consequences. In 2007, Leonid Hurwicz, Eric Maskin, and Roger Myerson won for laying the foundations of mechanism design theory. Myerson contributed the notion of proper equilibrium and an influential graduate text, Game Theory, Analysis of Conflict, while Hurwicz formalized the concept of incentive compatibility. In 2012, Alvin E. Roth and Lloyd S. Shapley won for the theory of stable allocations and the practice of market design. In 2014, the prize went to Jean Tirole. Outside economics, John Maynard Smith received the Crafoord Prize in 1999 for applying evolutionary game theory.

  • Eric Rasmusen names four essential elements of any game with the acronym PAPI: the players, the actions, the payoffs, and the information. A game must specify the players, the information and actions available to each one at every decision point, and the payoffs for each outcome. Games split along several axes. A game is cooperative when players can form binding commitments enforced externally, for instance through contract law, and non-cooperative when all agreements must be self-enforcing through credible threats. Zero-sum games are those in which choices can neither increase nor decrease available resources, so a player benefits only at the equal expense of others. Poker exemplifies a zero-sum game if you ignore the house's cut, since one wins exactly what opponents lose. Other zero-sum games include matching pennies, Go, and chess. Many studied games, including the prisoner's dilemma, are non-zero-sum, because outcomes can net more or less than zero. Symmetric games pay each player the same for the same choice, and the standard versions of chicken, the prisoner's dilemma, and the stag hunt are all symmetric. Asymmetric games, like the ultimatum game and the dictator game, give players different strategies. Games also divide into simultaneous and sequential, and into perfect and imperfect information. Tic-tac-toe, checkers, chess, and Go are perfect-information games. Poker and bridge are imperfect-information games, because players do not know all the moves already made.

  • The extensive form represents games with a time sequencing of moves, drawn as a game tree where each vertex is a point of choice for a player. The lines out of a vertex are possible actions, and the payoffs sit at the bottom of the tree. To solve an extensive form game, you use backward induction, working up from the last vertex to decide what a rational player would do, then what the prior player would do given that, and so on to the first vertex. Consider a two-player tree where Player 1 moves first, choosing fair or unfair, and Player 2 then chooses accept or reject. If Player 1 chooses one branch and Player 2 the other, Player 1 might get a payoff of eight and Player 2 a payoff of two, where eight could mean money, days of vacation, or even countries conquered. The normal form, by contrast, is usually a matrix showing players, strategies, and payoffs. One player picks the row and the other picks the column, with payoffs in the interior. Suppose Player 1 plays Up and Player 2 plays Left, giving Player 1 a payoff of 4 and Player 2 a payoff of 3. Cooperative games are usually written in characteristic function form, which lists the payoff of each coalition and traces its origin to the von Neumann and Morgenstern book. Every extensive-form game has an equivalent normal-form game, but the transformation can cause an exponential blowup in the size of the representation. Newer representations exist too, including congestion games from 1973, graphical games from 2001, and action graph games from 2012.

  • John Maynard Smith wrote in the preface to Evolution and the Theory of Games that, paradoxically, game theory turned out to be more readily applied to biology than to the economic behavior for which it was designed. In biology, payoffs are interpreted as fitness, and the central concept is the evolutionarily stable strategy, or ESS. Every ESS is a Nash equilibrium, yet its original motivation involved none of the mental requirements of rationality. The reach is extraordinary. Game theory has been used to explain the roughly 1:1 sex ratios in many species, the mobbing behavior in which prey animals swarm a larger predator, and the evolution of animal communication through signaling games. It even explains biological altruism through kin selection. Hamilton's rule states that the cost to the altruist must be less than the benefit to the recipient multiplied by the coefficient of relatedness. Vampire bats regurgitate blood for group members who failed to feed, worker bees tend the queen for life and never mate, and vervet monkeys warn the group of a predator even at risk to themselves. In political science, Anthony Downs applied the Hotelling firm location model to elections in his 1957 book An Economic Theory of Democracy, showing candidates converging on the median voter. Game theory was applied in 1962 to the Cuban Missile Crisis during the presidency of John F. Kennedy. It has even been used to explain why a king, who cannot physically control his subjects, retains authority through a coordination problem resembling the prisoner's dilemma. Peter John Wood's 2013 research found that climate treaties to cut greenhouse gas emissions could falter because they create a prisoner's dilemma for nations. The same ideas reached cinema. The 1964 film Dr. Strangelove satirizes deterrence by having the Soviet Union irrevocably commit to a catastrophic nuclear response without making the threat public.

Common questions

What is game theory and what is it used for?

Game theory is the study of mathematical models of strategic interactions. It has applications across the social sciences and is used extensively in economics, logic, systems science, and computer science. It is now an umbrella term for the science of rational decision making in humans, animals, and computers.

Who founded modern game theory?

John von Neumann founded modern game theory, publishing On the Theory of Games of Strategy in 1928 and using Brouwer's fixed-point theorem in his proof. His work culminated in the 1944 book Theory of Games and Economic Behavior, co-authored with Oskar Morgenstern.

What is the Nash equilibrium in game theory?

The Nash equilibrium is a set of strategies, one for each player, such that no player can improve their payoff by unilaterally changing their strategy. John Nash developed it in 1950 and proved that every finite n-player, non-zero-sum, non-cooperative game has a Nash equilibrium in mixed strategies.

How many game theorists have won the Nobel Prize in economics?

Fifteen game theorists had won the Nobel Prize in economics as of 2020. They include John Nash, Reinhard Selten, and John Harsanyi in 1994, and most recently Paul Milgrom and Robert B. Wilson.

What is the prisoner's dilemma in game theory?

The prisoner's dilemma is a non-zero-sum game in which two arrested gang members each face the choice to stay silent or betray the other. The dominant strategy is to betray, yet both staying silent would yield a greater reward for both than mutual betrayal.

How is game theory applied to biology?

In biology, game theory interprets payoffs as fitness and centers on the evolutionarily stable strategy, where every ESS is a Nash equilibrium. It has been used to explain roughly 1:1 sex ratios, animal communication, and biological altruism through kin selection and Hamilton's rule. John Maynard Smith applied it in his 1982 book Evolution and the Theory of Games.

All sources

146 references cited across the entry

  1. 1BookGame Theory: Analysis of ConflictRoger B. Myerson — Harvard University Press — 1991
  2. 2BookGame Theory in EconomicsLloyd S. Shapley et al. — 1971-01-01
  3. 3BookTheory of Games and Economic BehaviorJohn von Neumann et al. — Princeton University Press — 2007-04-08
  4. 4JournalChance Is 350 Years OldStephen M. Stigler — 2007
  5. 5Christiaan HuygensIvo Schneider — Springer — 2001
  6. 6The Problem of WaldegraveBellhouse, David R. — 2007
  7. 7JournalLe Her and Other Problems in Probability Discussed by Bernoulli, Montmort and WaldegraveDavid R. Bellhouse — Institute of Mathematical Statistics — 2015
  8. 8JournalBertrand versus Cournot RevisitedCheng-Zhong Qin et al. — 1997
  9. 9Über eine Anwendung der Mengenlehre auf die Theorie des SchachspielsErnst Zermelo — Cambridge University Press — 1913
  10. 10JournalZur Theorie der GesellschaftsspieleJohn von Neumann — 1928
  11. 11BookContributions to the Theory of GamesJohn von Neumann — Princeton University Press — 1959
  12. 12BookToward a History of Game TheoryPhilip Mirowski — Duke University Press — 1992
  13. 13Von Neumann, Morgenstern, and the Creation of Game TheoryRobert Leonard — Cambridge University Press — 2010
  14. 15Prisoner's DilemmaSteven Kuhn — Stanford University — 4 September 1997
  15. 17Cooperative Game TheoryRamaswamy Chandrasekaran — University of Texas at Dallas
  16. 19Symmetric GameMike Shor — 2006
  17. 20BookGame Theory: Third EditionGuillermo Owen — Emerald Group Publishing — 1995
  18. 21BookDesign Theory and Methods Using CAD/CAEKuang-Hua Chang — 2015
  19. 22Game TheoryThomas S. Ferguson — UCLA Department of Mathematics
  20. 23BookHandbook of Game Theory with Economic ApplicationsJan Mycielski — 1992
  21. 24Infinite Chess2 March 2017
  22. 25BookGame TheoryLeonard J. Mirman — 1989
  23. 26BookPerfect InformationLeonard Mirman — Palgrave Macmillan — 1989
  24. 27BookAn Introduction to Game TheoryMartin J. Osborne — Oxford University Press — 2000
  25. 28BookAn Introduction to Game TheoryMartin J Osborne — Oxford University Press — 2020
  26. 29Lessons in Play: In Introduction to Combinatorial Game TheoryMichael H. Albert et al. — A K Peters Ltd — 2007
  27. 30BookCombinatorial Games: Tic-Tac-Toe TheoryJózsef Beck — Cambridge University Press — 2008
  28. 31Games, Puzzles, and ComputationRobert A. Hearn et al. — A K Peters, Ltd. — 2009
  29. 32BookLuck, logic, and white lies: the mathematics of gamesJörg Bewersdorff — A K Peters, Ltd. — 2005
  30. 33BookArtificial Intelligence: A Systems ApproachM. Tim Jones — Jones & Bartlett Learning — 2008
  31. 34JournalGame-theoretic problems of mechanicsL. A. Petrosjan et al. — 1966
  32. 35JournalEvolutionary Game Theory: A RenaissanceJonathan Newton — 2018
  33. 36BookA Game-Theoretical Approach to Markov Decision Processes, Stochastic Positional Games and Multicriteria Control ModelsD Lozovanu et al. — Springer, Cham — 2015
  34. 37ThesisRobust Planning in Domains with Stochastic Outcomes, Adversaries, and Partial ObservabilityHugh Brendan McMahan — Carnegie Mellon University — 2006
  35. 38BookGame TheoryDrew Fudenberg et al. — MIT Press — 1991
  36. 39BookSecurity Studies: an IntroductionPaul D. Williams — Routledge — 2013
  37. 41If more than Analytical Modeling is Needed to Predict Real Agents' Strategic InteractionRustam Tagiew — 3 May 2011
  38. 42JournalA class of games possessing pure-strategy Nash equilibriaRobert W. Rosenthal — December 1973
  39. 43BookProceedings of the twenty-sixth annual ACM symposium on Theory of computing – STOC '94Daphne Koller et al. — 1994
  40. 44JournalA theory of timed automataRajeev Alur et al. — April 1994
  41. 45JournalA game theoretic approach to controller design for hybrid systemsC.J. Tomlin et al. — July 2000
  42. 46JournalRepresentations and solutions for game-theoretic problemsDaphne Koller et al. — July 1997
  43. 47JournalGraphical Models for Game TheoryMichael Kearns Michael et al. — 2001
  44. 48Graphical Models for Game TheoryMichael Kearns et al. — 7 March 2011
  45. 49Local-Effect GamesKevin Leyton-Brown et al. — Schloss Dagstuhl-Leibniz-Zentrum für Informatik — 2005
  46. 50JournalGeneral Game Playing: Overview of the AAAI CompetitionMichael Genesereth et al. — 15 June 2005
  47. 52JournalGames with Imperfectly Observable Actions in Continuous TimeYuliy Sannikov — September 2007
  48. 53Book2008 International Conference on Computational Intelligence for Modelling Control & AutomationRustam Tagiew — December 2008
  49. 54BookNew Challenges in Computational Collective IntelligenceRustam Tagiew — Springer — 2009
  50. 55Computing Nash Equilibria of Action-Graph GamesNavin Bhat et al. — 11 July 2012
  51. 56JournalNetworks of Conflict and CooperationJennifer M. Larson — 11 May 2021
  52. 59JournalGame Theory in PhilosophyBoudewijn de Bruin — September 2005
  53. 60Game TheoryDon Ross — Stanford University — 10 March 2006
  54. 61JournalChemical Game TheoryDarrell Velegol et al. — 17 October 2018
  55. 62JournalThe Confusion of Is and Ought in Game Theoretic ContextsJoseph B. Kadane et al. — December 1983
  56. 63BookThe New Palgrave Dictionary of EconomicsRobert J. Aumann — 2008
  57. 64BookHandbook of Mathematical Economics, v. 1Martin Shubik — 1981
  58. 65JournalThe Theory of Business StrategyCarl Shapiro — Wiley — Spring 1989
  59. 66Psychological Pricing in Mergers & Acquisitions using Game TheoryN. Agarwal et al. — December 11–12, 2011
  60. 67BookAgent-Based Computational Economics: A Constructive Approach to Economic TheoryLeigh Tesfatsion — 2006
  61. 68BookThe New Palgrave Dictionary of EconomicsJoseph Y. Halpern — 2008
  62. 69BookThe New Palgrave Dictionary of EconomicsRoger B. Myerson — 2008
  63. 70BookThe New Palgrave Dictionary of EconomicsTuomas Sandholm — 2008
  64. 71JournalAlgorithmic Mechanism DesignNoam Nisan et al. — April 2001
  65. 72BookAlgorithmic Game TheoryCambridge University Press — 2007
  66. 73BookChapter 30 Voting proceduresSteven J. Brams — 1994
  67. 74JournalGame Theory and Experimental Economics: Beginnings and Early InfluencesVernon L. Smith — December 1992
  68. 75BookInternational Encyclopedia of the Social & Behavioral SciencesVernon L. Smith — 2001
  69. 76BookHandbook of Experimental Economics ResultsElsevier — 2008
  70. 78BookHandbook of Game Theory with Economic Applications Volume 3Martin Shubik — 2002
  71. 79BookThe New Palgrave Dictionary of Economics2008
  72. 80BookThe New Palgrave Dictionary of EconomicsColin F. Camerer — 2008
  73. 81JournalProgress in Behavioral Game TheoryColin F. Camerer — 1997
  74. 82BookBehavioral Game TheoryColin F. Camerer — Princeton — 2003
  75. 83BookAdvances in Behavioral EconomicsPrinceton University Press — 2011
  76. 85BookGames and InformationEric Rasmusen — Wiley — 2007
  77. 86BookGame Theory and Economic ModellingDavid M. Kreps — Oxford University Press — 1990
  78. 87BookHandbook of Game Theory with Economic ApplicationsElsevier — 1992
  79. 88BookHandbook of Game Theory with Economic Applications Volume 3Robert J. Aumann et al. — 2002
  80. 89BookThe Theory of Industrial OrganizationJean Tirole — MIT Press — 1988
  81. 90BookHandbook of Game Theory with Economic Applications Volume 3Kyle Bagwell et al. — 2002
  82. 91JournalReview of Strategy and Market Structure: Competition, Oligopoly, and the Theory of GamesE. M. Fels — 1961
  83. 92JournalReview of Market Structure and BehaviorGavin C. Reid — 1982
  84. 95Options Games: Balancing the trade-off between flexibility and commitmentBenoît Chevalier-Roignant et al. — 15 February 2012
  85. 96BookManagerial EconomicsNick Wilkinson — 2005
  86. 99JournalApplications of Game Theory in Project Management: A Structured Review and AnalysisMahendra Piraveenan — 2019
  87. 101Game theory and the Cuban missile crisisSteven J. Brams — 1 January 2001
  88. 103JournalIt Takes Two: An Explanation for the Democratic PeaceGilat Levy et al. — March 2004
  89. 104JournalRationalist Explanations for WarJames D. Fearon — 1 January 1995
  90. 105JournalClimate change and game theoryPeter John Wood — February 2011
  91. 106JournalGame Theory in Defence Applications: A ReviewEdwin Ho et al. — 28 January 2022
  92. 107StEVe: A Rational Verification Tool for Stackelberg Security GamesSurasak Phetmanee et al. — Springer-Verlag — 2024
  93. 109Evolutionary Game TheoryJ. McKenzie Alexander — Stanford University — 19 July 2009
  94. 110Biological AltruismSamir Okasha — Stanford University — 3 June 2003
  95. 111BookMultiagent Systems: Algorithmic, Game-Theoretic, and Logical FoundationsYoav Shoham et al. — Cambridge University Press — 2008
  96. 112BookThe New Palgrave Dictionary of EconomicsJoseph Y. Halpern — 2008
  97. 113JournalComputer science and game theoryYoav Shoham — August 2008
  98. 114JournalIntroduction to the Special Issue on Learning and Computational Game TheoryAmy Littman et al. — 2007
  99. 115JournalGAMES, game theory and artificial intelligenceJohn T. Hanley — 14 December 2021
  100. 116BookMulti-Agent Reinforcement Learning: Foundations and Modern ApproachesStefano V. Albrecht et al. — MIT Press — 2024
  101. 117NewsWhat is Game Theory in AI?Nilesh Parashar — 15 August 2022
  102. 118JournalApplications of game theory in deep learning: a surveyTanmoy Hazra et al. — March 2022
  103. 119The Emergence of NormsE. Ullmann-Margalit — Oxford University Press — 1977
  104. 120The Grammar of Society: the Nature and Dynamics of Social NormsCristina Bicchieri — Cambridge University Press — 2006
  105. 121JournalSelf-Refuting Theories of Strategic Interaction: A Paradox of Common KnowledgeCristina Bicchieri — 1989
  106. 122Rationality and CoordinationCristina Bicchieri — Cambridge University Press — 1993
  107. 123The Dynamics of Rational DeliberationBrian Skyrms — Harvard University Press — 1990
  108. 124JournalKnowledge, Belief and Counterfactual Reasoning in GamesRobert Stalnaker — October 1996
  109. 125BookTheory of Games as a Tool for the Moral Philosopher. An Inaugural Lecture Delivered in Cambridge on 2 December 1954Richard Bevan Braithwaite — University Press — 1955
  110. 126JournalReflections on Ethics and Game TheorySteven T. Kuhn — July 2004
  111. 127JournalGame theoretic modelling of infectious disease dynamics and intervention methods: a reviewSheryl L. Chang et al. — 2020
  112. 128News'The Pandemic Is a Prisoner's Dilemma Game'Siobhan Roberts — 20 December 2020
  113. 129BookThe New Palgrave Dictionary of EconomicsAnatol Rapoport — 1987
  114. 132JournalOn the rationality postulates underlying the theory of cooperative gamesJohn C. Harsanyi — June 1961
  115. 133JournalThe neural bases for valuing social equalityRyuta Aoki et al. — January 2015
  116. 134JournalTrust, Reciprocity, and Social HistoryJoyce Berg et al. — July 1995
  117. 135JournalTrust games: A meta-analysisNoel D. Johnson et al. — October 2011
  118. 136BookGame Theory for Applied EconomistsRobert Gibbons — Princeton University Press — 1992
  119. 138JournalBertrand Competition when Rivals' Costs are UnknownDaniel F. Spulber — 1995
  120. 139NewsBetween Genius and MadnessSimon Singh — 14 June 1998
  121. 140Starship TroopersRobert A. Heinlein — 1959
  122. 142NewsStar on hold: Faithful following, meager salesRafer Guzman — 6 March 1996
  123. 144Poker and Game Theory Featured in Hit Film 'Crazy Rich Asians'Sean Chaffin — PokerNews.com — August 20, 2018