Skip to content
— CH. 1 · INTRODUCTION —

Game theory

~8 min read · Ch. 1 of 8
8 sections
  • Game theory is the study of mathematical models of strategic interactions, and it began with a question about what a rational person should do when someone else is trying to outmaneuver them. The field started narrow. At first it addressed two-person zero-sum games, where one participant's gains are exactly balanced by the other's losses. By the 1950s it had stretched far past that, into non zero-sum situations, and eventually into a wide range of behavioral relations. Today it is an umbrella term for the science of rational decision making in humans, animals, and computers. How did a tool built to solve card games end up explaining the stability of monarchies, the sex ratios of animals, and the logic of nuclear deterrence? Why did fifteen of its practitioners win the Nobel Prize in economics? And why, according to one of its pioneers, does it fit biology better than the economics it was designed for?

  • Cardano wrote on games of chance in Liber de ludo aleae, the Book on Games of Chance, composed around 1564 but only published posthumously in 1663. Long before anyone spoke of modern game theory, the mathematics of games drew careful minds toward the structure of luck and choice. Influenced by Fermat and Pascal working on the problem of points, Huygens developed the concept of expectation by reasoning about games of chance. He published his gambling calculus in De ratiociniis in ludo aleae, On Reasoning in Games of Chance, in 1657. In 1713, a letter attributed to Charles Waldegrave, an active Jacobite and uncle to the British diplomat James Waldegrave, analyzed a card game called le her. Waldegrave gave a minimax mixed strategy solution to a two-person version of the game. That puzzle is now known as the Waldegrave problem. In 1838, Antoine Augustin Cournot built a model of competition in oligopolies in his Recherches sur les principes mathematiques de la theorie des richesses. He did not use the term, but his solution is what we now call the Nash equilibrium. In 1883, Joseph Bertrand attacked Cournot's model as unrealistic and offered an alternative model of price competition, later formalized by Francis Ysidro Edgeworth. In 1913, Ernst Zermelo published a paper on set theory applied to chess, proving that optimal chess strategy is strictly determined.

  • John von Neumann published On the Theory of Games of Strategy in 1928, and with it game theory became its own independent field. His original proof used Brouwer's fixed-point theorem on continuous mappings into compact convex sets. That technique became a standard method in game theory and mathematical economics. Emile Borel had circled the same territory. In his 1938 book Applications aux Jeux de Hasard and earlier notes, Borel proved a minimax theorem for two-person zero-sum matrix games, but only when the pay-off matrix is symmetric. He even conjectured that mixed-strategy equilibria do not exist in finite two-person zero-sum games. Von Neumann proved that conjecture false. Von Neumann's work culminated in the 1944 book Theory of Games and Economic Behavior, co-authored with Oskar Morgenstern, which considered cooperative games of several players. The second edition supplied an axiomatic theory of utility, reviving Daniel Bernoulli's old theory of utility of money as an independent discipline. That step let mathematical statisticians and economists treat decision-making under uncertainty as a formal problem rather than a guess.

  • In 1950, John Nash proposed a criterion for the mutual consistency of players' strategies, now called the Nash equilibrium. It applies to a far wider variety of games than the earlier von Neumann and Morgenstern criterion. Nash proved that every finite n-player, non-zero-sum, non-cooperative game has a Nash equilibrium in mixed strategies. A Nash equilibrium is a set of strategies, one for each player, such that no player can improve their payoff by unilaterally changing strategy. The 1950s brought a flurry of new ideas. Game theorists developed the core, the extensive form game, fictitious play, repeated games, and the Shapley value. The decade also saw the first applications of game theory to philosophy and political science. The first mathematical discussion of the prisoner's dilemma appeared during this period. Mathematicians Merrill M. Flood and Melvin Dresher ran an experiment on it as part of the RAND Corporation's investigations. RAND pursued these studies because of their possible applications to global nuclear strategy.

  • Reinhard Selten introduced the solution concept of subgame perfect equilibria in 1965, a refinement of the Nash equilibrium, and he later added trembling hand perfection. In 1994, Nash, Selten, and John Harsanyi shared the Nobel Memorial Prize in the Economic Sciences for their contributions to economic game theory. The honors kept coming as the field matured. In 2005, Thomas Schelling and Robert Aumann became laureates. Schelling worked on dynamic models, early examples of evolutionary game theory, while Aumann introduced correlated equilibria and built a formal analysis of common knowledge and its consequences. In 2007, Leonid Hurwicz, Eric Maskin, and Roger Myerson won for laying the foundations of mechanism design theory. Myerson contributed the notion of proper equilibrium and an influential graduate text, Game Theory, Analysis of Conflict, while Hurwicz formalized the concept of incentive compatibility. In 2012, Alvin E. Roth and Lloyd S. Shapley won for the theory of stable allocations and the practice of market design. In 2014, the prize went to Jean Tirole. Outside economics, John Maynard Smith received the Crafoord Prize in 1999 for applying evolutionary game theory.

  • Eric Rasmusen names four essential elements of any game with the acronym PAPI: the players, the actions, the payoffs, and the information. A game must specify the players, the information and actions available to each one at every decision point, and the payoffs for each outcome. Games split along several axes. A game is cooperative when players can form binding commitments enforced externally, for instance through contract law, and non-cooperative when all agreements must be self-enforcing through credible threats. Zero-sum games are those in which choices can neither increase nor decrease available resources, so a player benefits only at the equal expense of others. Poker exemplifies a zero-sum game if you ignore the house's cut, since one wins exactly what opponents lose. Other zero-sum games include matching pennies, Go, and chess. Many studied games, including the prisoner's dilemma, are non-zero-sum, because outcomes can net more or less than zero. Symmetric games pay each player the same for the same choice, and the standard versions of chicken, the prisoner's dilemma, and the stag hunt are all symmetric. Asymmetric games, like the ultimatum game and the dictator game, give players different strategies. Games also divide into simultaneous and sequential, and into perfect and imperfect information. Tic-tac-toe, checkers, chess, and Go are perfect-information games. Poker and bridge are imperfect-information games, because players do not know all the moves already made.

  • The extensive form represents games with a time sequencing of moves, drawn as a game tree where each vertex is a point of choice for a player. The lines out of a vertex are possible actions, and the payoffs sit at the bottom of the tree. To solve an extensive form game, you use backward induction, working up from the last vertex to decide what a rational player would do, then what the prior player would do given that, and so on to the first vertex. Consider a two-player tree where Player 1 moves first, choosing fair or unfair, and Player 2 then chooses accept or reject. If Player 1 chooses one branch and Player 2 the other, Player 1 might get a payoff of eight and Player 2 a payoff of two, where eight could mean money, days of vacation, or even countries conquered. The normal form, by contrast, is usually a matrix showing players, strategies, and payoffs. One player picks the row and the other picks the column, with payoffs in the interior. Suppose Player 1 plays Up and Player 2 plays Left, giving Player 1 a payoff of 4 and Player 2 a payoff of 3. Cooperative games are usually written in characteristic function form, which lists the payoff of each coalition and traces its origin to the von Neumann and Morgenstern book. Every extensive-form game has an equivalent normal-form game, but the transformation can cause an exponential blowup in the size of the representation. Newer representations exist too, including congestion games from 1973, graphical games from 2001, and action graph games from 2012.

  • John Maynard Smith wrote in the preface to Evolution and the Theory of Games that, paradoxically, game theory turned out to be more readily applied to biology than to the economic behavior for which it was designed. In biology, payoffs are interpreted as fitness, and the central concept is the evolutionarily stable strategy, or ESS. Every ESS is a Nash equilibrium, yet its original motivation involved none of the mental requirements of rationality. The reach is extraordinary. Game theory has been used to explain the roughly 1:1 sex ratios in many species, the mobbing behavior in which prey animals swarm a larger predator, and the evolution of animal communication through signaling games. It even explains biological altruism through kin selection. Hamilton's rule states that the cost to the altruist must be less than the benefit to the recipient multiplied by the coefficient of relatedness. Vampire bats regurgitate blood for group members who failed to feed, worker bees tend the queen for life and never mate, and vervet monkeys warn the group of a predator even at risk to themselves. In political science, Anthony Downs applied the Hotelling firm location model to elections in his 1957 book An Economic Theory of Democracy, showing candidates converging on the median voter. Game theory was applied in 1962 to the Cuban Missile Crisis during the presidency of John F. Kennedy. It has even been used to explain why a king, who cannot physically control his subjects, retains authority through a coordination problem resembling the prisoner's dilemma. Peter John Wood's 2013 research found that climate treaties to cut greenhouse gas emissions could falter because they create a prisoner's dilemma for nations. The same ideas reached cinema. The 1964 film Dr. Strangelove satirizes deterrence by having the Soviet Union irrevocably commit to a catastrophic nuclear response without making the threat public.

Common questions

What is game theory and what is it used for?

Game theory is the study of mathematical models of strategic interactions. It has applications across the social sciences and is used extensively in economics, logic, systems science, and computer science. It is now an umbrella term for the science of rational decision making in humans, animals, and computers.

Who founded modern game theory?

John von Neumann founded modern game theory, publishing On the Theory of Games of Strategy in 1928 and using Brouwer's fixed-point theorem in his proof. His work culminated in the 1944 book Theory of Games and Economic Behavior, co-authored with Oskar Morgenstern.

What is the Nash equilibrium in game theory?

The Nash equilibrium is a set of strategies, one for each player, such that no player can improve their payoff by unilaterally changing their strategy. John Nash developed it in 1950 and proved that every finite n-player, non-zero-sum, non-cooperative game has a Nash equilibrium in mixed strategies.

How many game theorists have won the Nobel Prize in economics?

Fifteen game theorists had won the Nobel Prize in economics as of 2020. They include John Nash, Reinhard Selten, and John Harsanyi in 1994, and most recently Paul Milgrom and Robert B. Wilson.

What is the prisoner's dilemma in game theory?

The prisoner's dilemma is a non-zero-sum game in which two arrested gang members each face the choice to stay silent or betray the other. The dominant strategy is to betray, yet both staying silent would yield a greater reward for both than mutual betrayal.

How is game theory applied to biology?

In biology, game theory interprets payoffs as fitness and centers on the evolutionarily stable strategy, where every ESS is a Nash equilibrium. It has been used to explain roughly 1:1 sex ratios, animal communication, and biological altruism through kin selection and Hamilton's rule. John Maynard Smith applied it in his 1982 book Evolution and the Theory of Games.

All sources

146 references cited across the entry

  1. 1bookGame Theory: Analysis of ConflictRoger B. Myerson — Harvard University Press — 1991
  2. 2bookGame Theory in EconomicsLloyd S. Shapley et al. — 1971-01-01
  3. 3bookTheory of Games and Economic BehaviorJohn von Neumann et al. — Princeton University Press — 2007-04-08
  4. 4journalChance Is 350 Years OldStephen M. Stigler — 2007
  5. 5citationChristiaan HuygensIvo Schneider — Springer — 2001
  6. 6citationThe Problem of WaldegraveBellhouse, David R. — 2007
  7. 7journalLe Her and Other Problems in Probability Discussed by Bernoulli, Montmort and WaldegraveDavid R. Bellhouse — Institute of Mathematical Statistics — 2015
  8. 8journalBertrand versus Cournot RevisitedCheng-Zhong Qin et al. — 1997
  9. 9conferenceÜber eine Anwendung der Mengenlehre auf die Theorie des SchachspielsErnst Zermelo — Cambridge University Press — 1913
  10. 10journalZur Theorie der GesellschaftsspieleJohn von Neumann — 1928
  11. 11bookContributions to the Theory of GamesJohn von Neumann — Princeton University Press — 1959
  12. 12bookToward a History of Game TheoryPhilip Mirowski — Duke University Press — 1992
  13. 13citationVon Neumann, Morgenstern, and the Creation of Game TheoryRobert Leonard — Cambridge University Press — 2010
  14. 15webPrisoner's DilemmaSteven Kuhn — Stanford University — 4 September 1997
  15. 16webNon-Cooperative GameMike Shor
  16. 17webCooperative Game TheoryRamaswamy Chandrasekaran — University of Texas at Dallas
  17. 19webSymmetric GameMike Shor — 2006
  18. 20bookGame Theory: Third EditionGuillermo Owen — Emerald Group Publishing — 1995
  19. 21bookDesign Theory and Methods Using CAD/CAEKuang-Hua Chang — 2015
  20. 22webGame TheoryThomas S. Ferguson — UCLA Department of Mathematics
  21. 23bookHandbook of Game Theory with Economic ApplicationsJan Mycielski — 1992
  22. 24webInfinite Chess2 March 2017
  23. 25bookGame TheoryLeonard J. Mirman — 1989
  24. 26bookPerfect InformationLeonard Mirman — Palgrave Macmillan — 1989
  25. 27bookAn Introduction to Game TheoryMartin J. Osborne — Oxford University Press — 2000
  26. 28bookAn Introduction to Game TheoryMartin J Osborne — Oxford University Press — 2020
  27. 29citationLessons in Play: In Introduction to Combinatorial Game TheoryMichael H. Albert et al. — A K Peters Ltd — 2007
  28. 30bookCombinatorial Games: Tic-Tac-Toe TheoryJózsef Beck — Cambridge University Press — 2008
  29. 31citationGames, Puzzles, and ComputationRobert A. Hearn et al. — A K Peters, Ltd. — 2009
  30. 32bookLuck, logic, and white lies: the mathematics of gamesJörg Bewersdorff — A K Peters, Ltd. — 2005
  31. 33bookArtificial Intelligence: A Systems ApproachM. Tim Jones — Jones & Bartlett Learning — 2008
  32. 34journalGame-theoretic problems of mechanicsL. A. Petrosjan et al. — 1966
  33. 35journalEvolutionary Game Theory: A RenaissanceJonathan Newton — 2018
  34. 36bookA Game-Theoretical Approach to Markov Decision Processes, Stochastic Positional Games and Multicriteria Control ModelsD Lozovanu et al. — Springer, Cham — 2015
  35. 37thesisRobust Planning in Domains with Stochastic Outcomes, Adversaries, and Partial ObservabilityHugh Brendan McMahan — Carnegie Mellon University — 2006
  36. 38bookGame TheoryDrew Fudenberg et al. — MIT Press — 1991
  37. 39bookSecurity Studies: an IntroductionPaul D. Williams — Routledge — 2013
  38. 41arxivIf more than Analytical Modeling is Needed to Predict Real Agents' Strategic InteractionRustam Tagiew — 3 May 2011
  39. 42journalA class of games possessing pure-strategy Nash equilibriaRobert W. Rosenthal — December 1973
  40. 43bookProceedings of the twenty-sixth annual ACM symposium on Theory of computing – STOC '94Daphne Koller et al. — 1994
  41. 44journalA theory of timed automataRajeev Alur et al. — April 1994
  42. 45journalA game theoretic approach to controller design for hybrid systemsC.J. Tomlin et al. — July 2000
  43. 46journalRepresentations and solutions for game-theoretic problemsDaphne Koller et al. — July 1997
  44. 47journalGraphical Models for Game TheoryMichael Kearns Michael et al. — 2001
  45. 48arxivGraphical Models for Game TheoryMichael Kearns et al. — 7 March 2011
  46. 49conferenceLocal-Effect GamesKevin Leyton-Brown et al. — Schloss Dagstuhl-Leibniz-Zentrum für Informatik — 2005
  47. 50journalGeneral Game Playing: Overview of the AAAI CompetitionMichael Genesereth et al. — 15 June 2005
  48. 52journalGames with Imperfectly Observable Actions in Continuous TimeYuliy Sannikov — September 2007
  49. 53book2008 International Conference on Computational Intelligence for Modelling Control & AutomationRustam Tagiew — December 2008
  50. 54bookNew Challenges in Computational Collective IntelligenceRustam Tagiew — Springer — 2009
  51. 55arxivComputing Nash Equilibria of Action-Graph GamesNavin Bhat et al. — 11 July 2012
  52. 56journalNetworks of Conflict and CooperationJennifer M. Larson — 11 May 2021
  53. 59journalGame Theory in PhilosophyBoudewijn de Bruin — September 2005
  54. 60encyclopediaGame TheoryDon Ross — Stanford University — 10 March 2006
  55. 61journalChemical Game TheoryDarrell Velegol et al. — 17 October 2018
  56. 62journalThe Confusion of Is and Ought in Game Theoretic ContextsJoseph B. Kadane et al. — December 1983
  57. 63bookThe New Palgrave Dictionary of EconomicsRobert J. Aumann — 2008
  58. 64bookHandbook of Mathematical Economics, v. 1Martin Shubik — 1981
  59. 65journalThe Theory of Business StrategyCarl Shapiro — Wiley — Spring 1989
  60. 66conferencePsychological Pricing in Mergers & Acquisitions using Game TheoryN. Agarwal et al. — December 11–12, 2011
  61. 67bookAgent-Based Computational Economics: A Constructive Approach to Economic TheoryLeigh Tesfatsion — 2006
  62. 68bookThe New Palgrave Dictionary of EconomicsJoseph Y. Halpern — 2008
  63. 69bookThe New Palgrave Dictionary of EconomicsRoger B. Myerson — 2008
  64. 70bookThe New Palgrave Dictionary of EconomicsTuomas Sandholm — 2008
  65. 71journalAlgorithmic Mechanism DesignNoam Nisan et al. — April 2001
  66. 72bookAlgorithmic Game TheoryCambridge University Press — 2007
  67. 73bookChapter 30 Voting proceduresSteven J. Brams — 1994
  68. 74journalGame Theory and Experimental Economics: Beginnings and Early InfluencesVernon L. Smith — December 1992
  69. 75bookInternational Encyclopedia of the Social & Behavioral SciencesVernon L. Smith — 2001
  70. 76bookHandbook of Experimental Economics ResultsElsevier — 2008
  71. 78bookHandbook of Game Theory with Economic Applications Volume 3Martin Shubik — 2002
  72. 79bookThe New Palgrave Dictionary of Economics2008
  73. 80bookThe New Palgrave Dictionary of EconomicsColin F. Camerer — 2008
  74. 81journalProgress in Behavioral Game TheoryColin F. Camerer — 1997
  75. 82bookBehavioral Game TheoryColin F. Camerer — Princeton — 2003
  76. 83bookAdvances in Behavioral EconomicsPrinceton University Press — 2011
  77. 85bookGames and InformationEric Rasmusen — Wiley — 2007
  78. 86bookGame Theory and Economic ModellingDavid M. Kreps — Oxford University Press — 1990
  79. 87bookHandbook of Game Theory with Economic ApplicationsElsevier — 1992
  80. 88bookHandbook of Game Theory with Economic Applications Volume 3Robert J. Aumann et al. — 2002
  81. 89bookThe Theory of Industrial OrganizationJean Tirole — MIT Press — 1988
  82. 90bookHandbook of Game Theory with Economic Applications Volume 3Kyle Bagwell et al. — 2002
  83. 91journalReview of Strategy and Market Structure: Competition, Oligopoly, and the Theory of GamesE. M. Fels — 1961
  84. 92journalReview of Market Structure and BehaviorGavin C. Reid — 1982
  85. 95webOptions Games: Balancing the trade-off between flexibility and commitmentBenoît Chevalier-Roignant et al. — 15 February 2012
  86. 96bookManagerial EconomicsNick Wilkinson — 2005
  87. 99journalApplications of Game Theory in Project Management: A Structured Review and AnalysisMahendra Piraveenan — 2019
  88. 101webGame theory and the Cuban missile crisisSteven J. Brams — 1 January 2001
  89. 103journalIt Takes Two: An Explanation for the Democratic PeaceGilat Levy et al. — March 2004
  90. 104journalRationalist Explanations for WarJames D. Fearon — 1 January 1995
  91. 105journalClimate change and game theoryPeter John Wood — February 2011
  92. 106journalGame Theory in Defence Applications: A ReviewEdwin Ho et al. — 28 January 2022
  93. 107conferenceStEVe: A Rational Verification Tool for Stackelberg Security GamesSurasak Phetmanee et al. — Springer-Verlag — 2024
  94. 109encyclopediaEvolutionary Game TheoryJ. McKenzie Alexander — Stanford University — 19 July 2009
  95. 110encyclopediaBiological AltruismSamir Okasha — Stanford University — 3 June 2003
  96. 111bookMultiagent Systems: Algorithmic, Game-Theoretic, and Logical FoundationsYoav Shoham et al. — Cambridge University Press — 2008
  97. 112bookThe New Palgrave Dictionary of EconomicsJoseph Y. Halpern — 2008
  98. 113journalComputer science and game theoryYoav Shoham — August 2008
  99. 114journalIntroduction to the Special Issue on Learning and Computational Game TheoryAmy Littman et al. — 2007
  100. 115journalGAMES, game theory and artificial intelligenceJohn T. Hanley — 14 December 2021
  101. 116bookMulti-Agent Reinforcement Learning: Foundations and Modern ApproachesStefano V. Albrecht et al. — MIT Press — 2024
  102. 117newsWhat is Game Theory in AI?Nilesh Parashar — 15 August 2022
  103. 118journalApplications of game theory in deep learning: a surveyTanmoy Hazra et al. — March 2022
  104. 119citationThe Emergence of NormsE. Ullmann-Margalit — Oxford University Press — 1977
  105. 120citationThe Grammar of Society: the Nature and Dynamics of Social NormsCristina Bicchieri — Cambridge University Press — 2006
  106. 121journalSelf-Refuting Theories of Strategic Interaction: A Paradox of Common KnowledgeCristina Bicchieri — 1989
  107. 122citationRationality and CoordinationCristina Bicchieri — Cambridge University Press — 1993
  108. 123citationThe Dynamics of Rational DeliberationBrian Skyrms — Harvard University Press — 1990
  109. 124journalKnowledge, Belief and Counterfactual Reasoning in GamesRobert Stalnaker — October 1996
  110. 125bookTheory of Games as a Tool for the Moral Philosopher. An Inaugural Lecture Delivered in Cambridge on 2 December 1954Richard Bevan Braithwaite — University Press — 1955
  111. 126journalReflections on Ethics and Game TheorySteven T. Kuhn — July 2004
  112. 127journalGame theoretic modelling of infectious disease dynamics and intervention methods: a reviewSheryl L. Chang et al. — 2020
  113. 128news'The Pandemic Is a Prisoner's Dilemma Game'Siobhan Roberts — 20 December 2020
  114. 129bookThe New Palgrave Dictionary of EconomicsAnatol Rapoport — 1987
  115. 132journalOn the rationality postulates underlying the theory of cooperative gamesJohn C. Harsanyi — June 1961
  116. 133journalThe neural bases for valuing social equalityRyuta Aoki et al. — January 2015
  117. 134journalTrust, Reciprocity, and Social HistoryJoyce Berg et al. — July 1995
  118. 135journalTrust games: A meta-analysisNoel D. Johnson et al. — October 2011
  119. 136bookGame Theory for Applied EconomistsRobert Gibbons — Princeton University Press — 1992
  120. 137webCournot (Nash) Equilibrium18 April 2013
  121. 138journalBertrand Competition when Rivals' Costs are UnknownDaniel F. Spulber — 1995
  122. 139newsBetween Genius and MadnessSimon Singh — 14 June 1998
  123. 140citationStarship TroopersRobert A. Heinlein — 1959
  124. 142newsStar on hold: Faithful following, meager salesRafer Guzman — 6 March 1996
  125. 144webPoker and Game Theory Featured in Hit Film 'Crazy Rich Asians'Sean Chaffin — PokerNews.com — August 20, 2018