{
  "id": "backward-induction",
  "title": "Backward Induction",
  "lang": "en",
  "source_lang": "en",
  "summary": "Backward induction solves sequential decision problems by determining optimal choices at the end and working backward to earlier decisions.",
  "category": "mathematics",
  "subcategory": "applied",
  "type": "concept",
  "aliases": [
    "Backward reasoning",
    "Backward induction procedure"
  ],
  "generated_at": "2026-11-05",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/backward-induction/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/backward-induction/",
      "json": "https://aiwiki.page/zh/backward-induction.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "Backward induction is a method for solving sequential decision problems by analyzing the final decisions first and then working backward to the initial decision. At each stage, the consequences of later choices are treated as already determined. In game theory, it identifies strategies in finite games with perfect information; in mathematical optimization and decision theory, it computes optimal choices over a finite planning horizon. Its central principle is that a present action should be evaluated using the behavior or optimal decisions that will follow it, rather than treating future choices as independent of the present one."
    },
    {
      "heading": "Basic procedure",
      "text": "Consider a decision problem represented by a finite tree. The root represents the initial situation, branches represent available actions, and terminal nodes represent completed sequences of actions. Each terminal node has a payoff, or a vector of payoffs when several decision-makers are involved.\n\nBackward induction proceeds as follows:\n\n- Evaluate terminal outcomes. Assign each terminal node its payoff.\n- Solve the last decisions. At each decision node whose successors have already been evaluated, choose an action that maximizes the payoff of the decision-maker acting there.\n- Replace the solved continuation by its value. Associate the chosen continuation’s payoff with the current node.\n- Repeat toward the root. Continue until the initial decision has been evaluated.\n\nThe result is not merely an initial action. It is a contingent plan specifying what to do at every decision point, including points that will not be reached if the plan is followed.\n\nThe procedure is justified by mathematical induction on the number of decisions remaining. At a final decision, the best action can be found directly. If the continuation of every available action has already been solved, the current decision can also be solved by comparing those continuations."
    },
    {
      "heading": "Formulation in game theory",
      "text": "Extensive-form games and perfect information\n\nAn extensive-form game describes players, the order of moves, available actions, information, and terminal payoffs. A game has perfect information when the player making each decision knows the complete history of previous moves. Equivalently, every information set contains a single decision node.\n\nFor a finite perfect-information game without chance moves, let:\n\n- \\(h\\) denote a decision history;\n- \\(i(h)\\) denote the player who moves after \\(h\\);\n- \\(A(h)\\) denote the actions available there;\n- \\(ha\\) denote the history obtained by taking action \\(a\\);\n- \\(u_i(z)\\) denote player \\(i\\)'s payoff at terminal history \\(z\\).\n\nLet \\(U(h)\\) be the vector of continuation payoffs assigned to history \\(h\\). At a terminal history,\n\n\\[U(z)=\\bigl(u_1(z),\\ldots,u_n(z)\\bigr).\\]\n\nAt a decision history, choose\n\n\\[a^*(h)\\in \\operatorname*{arg\\,max}_{a\\in A(h)} U_{i(h)}(ha),\\]\n\nand set\n\n\\[U(h)=U\\bigl(ha^*(h)\\bigr).\\]\n\nThe important feature is that each player maximizes that player’s own payoff. Backward induction does not generally maximize total welfare or the payoff of the player who moves first.\n\nSubgame-perfect equilibrium\n\nA Nash equilibrium requires that no player can profit by changing strategy unilaterally, holding the other players’ strategies fixed. This condition alone can permit prescriptions for unreached situations that would not be optimal if those situations actually occurred.\n\nA subgame-perfect equilibrium is a strategy profile that forms a Nash equilibrium in every subgame. Backward induction imposes this requirement recursively: prescribed behavior must be optimal not only along the realized path but also in every continuation that could arise.\n\nEvery finite perfect-information game has a subgame-perfect equilibrium in pure strategies, and backward induction constructs one. In such games, the pure-strategy subgame-perfect equilibria are precisely the strategy profiles obtainable through appropriate choices among tied maximizing actions during backward induction.\n\nThis does not imply that all finite games have pure-strategy equilibria. The perfect-information assumption is essential to this particular result.\n\nTies and multiplicity\n\nIf a player is indifferent between two actions at a decision node, either action may be selected. Different selections can change earlier incentives, so ties may produce multiple equilibrium strategies and multiple equilibrium outcomes.\n\nTo enumerate all pure-strategy backward-induction solutions, the procedure must retain alternative optimal continuations rather than arbitrarily discarding them. Equilibria involving a mixed strategy may additionally randomize among actions that are optimal given the continuation strategies.\n\nThus, backward induction is a solution procedure, not a general guarantee of a unique prediction."
    },
    {
      "heading": "Example: entry and a non-credible threat",
      "text": "Suppose an entrant first chooses whether to enter a market. If the entrant stays out, the payoffs are\n\n\\[(0,2),\\]\n\nwhere the first number is the entrant’s payoff and the second is the incumbent’s.\n\nIf entry occurs, the incumbent chooses between:\n\n- Accommodate: payoffs \\((1,1)\\);\n- Fight: payoffs \\((-1,-1)\\).\n\nBackward induction begins with the incumbent’s decision after entry. Accommodation gives the incumbent \\(1\\), whereas fighting gives \\(-1\\), so the incumbent accommodates. Anticipating this, the entrant compares the payoff \\(1\\) from entering with \\(0\\) from staying out and chooses entry.\n\nThe resulting strategy profile is:\n\n- the entrant enters;\n- the incumbent accommodates if entry occurs.\n\nThere is also a Nash equilibrium in which the entrant stays out and the incumbent’s strategy specifies fighting after entry. Given that prescribed response, entering would be unprofitable; given that entry does not occur, changing the incumbent’s prescribed response does not affect its payoff. But this equilibrium is not subgame-perfect: fighting would not be optimal if the incumbent actually faced entry.\n\nBackward induction therefore distinguishes a strategically relevant response from a non-credible threat. A commitment mechanism that genuinely changed the incumbent’s later options or payoffs could change the analysis, but a threat by itself does not."
    },
    {
      "heading": "Chance moves and expected payoffs",
      "text": "Random events can be incorporated when their probabilities are specified. At a chance node, the continuation payoff is the expected value of the successor payoffs:\n\n\\[U(h)=\\sum_{a\\in A(h)}p(a\\mid h)\\,U(ha),\\]\n\nwhere \\(p(a\\mid h)\\) is the probability of chance outcome \\(a\\).\n\nAt player nodes, the acting player still chooses the action with the highest continuation payoff. If the payoff numbers represent utility, this is expected-utility maximization; it need not coincide with maximizing expected money.\n\nRandomness and imperfect information are different issues. A publicly observed random event can occur in a perfect-information game. An unobserved action or hidden state can instead create information sets containing several nodes, preventing those nodes from being optimized independently."
    },
    {
      "heading": "Connection with dynamic programming",
      "text": "Backward induction is closely related to dynamic programming. In a finite-horizon optimization problem, the future consequences of a decision can be summarized by a value function.\n\nSuppose the state at time \\(t\\) is \\(s\\), an action \\(a\\) gives reward \\(r_t(s,a)\\), and the next state \\(S_{t+1}\\) follows a specified transition law. With terminal reward \\(g\\),\n\n\\[V_T(s)=g(s).\\]\n\nThe earlier values satisfy a finite-horizon Bellman equation:\n\n\\[V_t(s)= \\max_{a\\in A_t(s)} \\left\\{ r_t(s,a)+ \\mathbb{E}\\!\\left[ V_{t+1}(S_{t+1}) \\mid S_t=s,\\ A_t=a \\right] \\right\\}.\\]\n\nComputing \\(V_{T-1},V_{T-2},\\ldots,V_0\\) is a backward-induction calculation. An optimal action is recorded at each time and state, producing a policy rather than just an optimal value.\n\nFor this state-based recursion to be valid, the state must contain all information needed to determine future feasible actions, rewards, and transition probabilities. This is the role of the Markov property in a Markov decision process. If the current state omits relevant history, additional state variables may be necessary.\n\nThe distinction between the methods is mainly one of representation and reuse:\n\n- Backward induction on a tree evaluates decision histories from their endpoints.\n- Dynamic programming exploits shared subproblems, storing a continuation value once when multiple histories lead to the same relevant state.\n\nDynamic programming is broader than finite-horizon backward induction. Infinite-horizon methods such as value iteration generally use repeated updates or fixed-point arguments rather than starting from a final decision date."
    },
    {
      "heading": "Applications and computational requirements",
      "text": "Backward induction is used in sequential bargaining, market entry, finite repeated games, investment timing, inventory control, and other multistage planning problems.\n\nIn a two-player zero-sum game, maximizing the acting player’s payoff corresponds to alternating maximization and minimization of one player’s payoff. This yields the minimax recursion used in game-tree search. Exact evaluation can be infeasible for large trees, so practical search may use pruning, limited search depth, and approximate evaluations. Such approximations need not recover the exact backward-induction solution.\n\nIn operations research, a backward pass can solve scheduling, resource-allocation, and finite-horizon control problems. In financial mathematics, backward valuation appears in discrete-time derivative-pricing models and in the valuation of early-exercise opportunities.\n\nA single backward pass through an explicitly represented finite tree requires work proportional to the number of nodes and branches, apart from the cost of evaluating payoffs and comparing actions. The principal difficulty is often the size of the tree: with several possible actions at every stage, the number of histories can grow exponentially with the horizon. State-based dynamic programming reduces repeated work, but large state spaces can still produce the curse of dimensionality."
    },
    {
      "heading": "Assumptions and limitations",
      "text": "Imperfect information\n\nWhen a player cannot distinguish between several decision nodes, the player must use the same action distribution at all nodes in the information set. Optimizing each node separately may therefore prescribe behavior that is not feasible.\n\nBackward reasoning can still contribute to the analysis of imperfect-information games, but generally must be combined with beliefs about hidden histories and an appropriate equilibrium concept. It is not a substitute for handling the informational constraints explicitly.\n\nInfinite horizons\n\nAn infinite game may have no final decision from which to start. Direct finite backward induction is then unavailable. Infinite-horizon problems may instead require fixed-point methods, limits of finite-horizon solutions, or other equilibrium arguments.\n\nSolutions to finite truncations need not converge to a solution of the infinite problem. Assumptions about discounting, continuity, and terminal conditions can be decisive.\n\nRationality and beliefs\n\nAs an algorithm applied to a specified game, backward induction is a mathematical construction. As a prediction of behavior, it also relies on assumptions about how players choose and what they believe about one another’s future choices.\n\nIndividual payoff maximization alone does not justify every step of a long chain of backward reasoning. Earlier players must anticipate later players’ responses, including responses at histories that the predicted strategies would never reach. The epistemic foundations of these expectations are a substantial subject within game theory.\n\nBehavioral evidence\n\nThe centipede game illustrates the difference between equilibrium analysis and observed play. In its standard finite form, backward induction predicts stopping at the first opportunity, although experimental participants frequently continue for some time.\n\nSuch findings do not refute the recursive calculation for the specified model. They show that its behavioral predictions depend on whether the model adequately represents preferences, expectations, understanding, and decision processes."
    },
    {
      "heading": "Historical development",
      "text": "Backward reasoning has antecedents in mathematical problem solving and the analysis of board games. Ernst Zermelo’s 1913 work on chess is an early landmark in the mathematical study of finite games and forced outcomes.\n\nThe method became central to twentieth-century game theory as extensive-form models made sequential choice explicit. Reinhard Selten’s introduction of subgame perfection in 1965 formalized the requirement that equilibrium behavior remain optimal in every subgame.\n\nIn optimization, Richard Bellman’s development of dynamic programming during the 1950s established a general framework for solving multistage problems through recursive value functions. This connected end-to-beginning reasoning with systematic methods for computation and control."
    }
  ],
  "links": [
    "game-theory",
    "mathematical-optimization",
    "decision-theory",
    "mathematical-induction",
    "extensive-form-game",
    "perfect-information",
    "nash-equilibrium",
    "subgame-perfect-equilibrium",
    "mixed-strategy",
    "expected-value",
    "dynamic-programming",
    "value-function",
    "bellman-equation",
    "markov-property",
    "markov-decision-process",
    "value-iteration",
    "zero-sum-game",
    "minimax",
    "operations-research",
    "curse-of-dimensionality"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}