{
  "id": "lagrangian-duality",
  "title": "Lagrangian duality",
  "lang": "en",
  "source_lang": "en",
  "summary": "Lagrangian duality associates a constrained optimization problem with a multiplier-based problem that provides bounds and, under suitable conditions, optimality certificates.",
  "category": "mathematics",
  "subcategory": "applied",
  "type": "concept",
  "aliases": [
    "Lagrange duality",
    "Lagrangean duality"
  ],
  "generated_at": "2026-10-04",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/lagrangian-duality/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/lagrangian-duality/",
      "json": "https://aiwiki.page/zh/lagrangian-duality.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "Lagrangian duality is a framework in mathematical optimization that associates a constrained problem, called the primal problem, with a dual problem whose variables weight the original constraints. For a minimization problem, dual feasible points provide lower bounds on the primal optimal value. Under suitable conditions, the best bound equals that value. The framework connects optimization bounds, optimality conditions, and algorithms, including methods for nonconvex problems. (mit.edu)"
    },
    {
      "heading": "Primal problem and dual construction",
      "text": "Consider the primal problem\n\n\\[p^\\star=\\inf_{x\\in D} f_0(x) \\quad\\text{subject to}\\quad f_i(x)\\leq0,\\quad h_j(x)=0,\\]\n\nwhere \\(i=1,\\ldots,m\\), \\(j=1,\\ldots,r\\), and \\(D\\) is the common domain of the functions. The objective function is \\(f_0\\); the constraints determine the feasible set. Its Lagrangian is\n\n\\[L(x,\\lambda,\\nu) =f_0(x)+\\sum_{i=1}^{m}\\lambda_i f_i(x) +\\sum_{j=1}^{r}\\nu_j h_j(x).\\]\n\nThe Lagrange multipliers satisfy \\(\\lambda_i\\geq0\\), while equality multipliers \\(\\nu_j\\) are unrestricted. These signs correspond specifically to inequalities written as \\(f_i(x)\\leq0\\). (mit.edu)\n\nThe dual function and dual optimal value are\n\n\\[g(\\lambda,\\nu)=\\inf_{x\\in D}L(x,\\lambda,\\nu), \\qquad d^\\star=\\sup_{\\lambda\\geq0,\\nu}g(\\lambda,\\nu).\\]\n\nThe inner minimization retains the domain \\(D\\), but removes the constraints incorporated into \\(L\\). The dual function can equal \\(-\\infty\\), so its effective domain consists of multiplier choices giving finite values. It is concave even when the primal problem is nonconvex: it is a pointwise infimum of functions affine in the multipliers. Thus maximizing it is a convex optimization problem, although evaluating it may remain difficult. (mit.edu)"
    },
    {
      "heading": "Weak duality and bounds",
      "text": "For any primal feasible \\(x\\) and multipliers with \\(\\lambda\\geq0\\),\n\n\\[g(\\lambda,\\nu)\\leq L(x,\\lambda,\\nu)\\leq f_0(x).\\]\n\nThe second inequality follows because equality terms vanish and inequality terms are nonpositive. Taking the supremum over multipliers and infimum over feasible points establishes weak duality:\n\n\\[d^\\star\\leq p^\\star.\\]\n\nThis requires neither convexity nor differentiability. (mit.edu)\n\nWhen the optimal values are finite, \\(p^\\star-d^\\star\\) is the duality gap. More practically, a primal feasible point and dual feasible multipliers give\n\n\\[0\\leq f_0(x)-p^\\star \\leq f_0(x)-g(\\lambda,\\nu).\\]\n\nTheir objective difference therefore certifies an upper bound on suboptimality. Equality of their objective values proves that both are optimal, without requiring a separate computation of the unknown optimum. (mit.edu)"
    },
    {
      "heading": "Strong duality and constraint qualifications",
      "text": "Strong duality means \\(d^\\star=p^\\star\\). It does not hold automatically, even for every convex problem. For convex optimization, the objective and inequality functions are convex functions, equality functions are affine, and the domain is a convex set. Additional assumptions called constraint qualifications can guarantee equality of the optimal values. (stanford.edu)\n\nA central sufficient condition is Slater’s condition: there exists a point in the relative interior of the common domain satisfying the equalities and all inequalities strictly. With a finite primal optimum, this also guarantees attainment of the dual optimum. Refined versions do not require affine inequalities to hold strictly. Strong duality itself concerns optimal values and should be distinguished from whether either optimum is attained. (stanford.edu)"
    },
    {
      "heading": "Optimality conditions and saddle points",
      "text": "For differentiable functions on an open domain, the Karush–Kuhn–Tucker conditions comprise primal feasibility, dual feasibility, complementary slackness,\n\n\\[\\lambda_i f_i(x)=0,\\]\n\nand stationarity,\n\n\\[\\nabla f_0(x)+\\sum_i\\lambda_i\\nabla f_i(x) +\\sum_j\\nu_j\\nabla h_j(x)=0.\\]\n\nStationarity sets the gradient of the Lagrangian with respect to the primal variable to zero. Complementary slackness means a strictly satisfied inequality has zero multiplier. (stanford.edu)\n\nFor convex problems, these conditions are sufficient for global optimality; under Slater’s condition they also characterize optimal solutions through the existence of suitable multipliers. More generally, primal and dual optima with zero gap form a saddle point:\n\n\\[L(x^\\star,\\lambda,\\nu) \\leq L(x^\\star,\\lambda^\\star,\\nu^\\star) \\leq L(x,\\lambda^\\star,\\nu^\\star),\\]\n\nfor admissible \\(x,\\lambda,\\nu\\). (stanford.edu)"
    },
    {
      "heading": "Example",
      "text": "For \\(\\min x^2\\) subject to \\(x\\geq1\\), write the constraint as \\(1-x\\leq0\\). Direct calculation gives\n\n\\[L(x,\\lambda)=x^2+\\lambda(1-x), \\qquad g(\\lambda)=\\lambda-\\frac{\\lambda^2}{4}.\\]\n\nThe infimum over \\(x\\) occurs at \\(x=\\lambda/2\\). Maximizing over \\(\\lambda\\geq0\\) gives \\(\\lambda^\\star=2\\) and \\(d^\\star=1\\), matching \\(x^\\star=1\\) and \\(p^\\star=1\\). This illustrates the quadratic dual construction and an exact optimality certificate. (stanford.edu)"
    },
    {
      "heading": "Sensitivity and computation",
      "text": "Dual multipliers support sensitivity analysis. If inequalities are perturbed to \\(f_i(x)\\leq u_i\\), and strong duality holds at \\(u=0\\), optimal multipliers imply\n\n\\[p^\\star(u)\\geq p^\\star(0)-(\\lambda^\\star)^Tu.\\]\n\nWhen the optimal-value function is differentiable at zero, its derivative is \\(-\\lambda^\\star\\). The multiplier thus measures marginal sensitivity to relaxing the corresponding bound. (stanford.edu)\n\nIn dual decomposition, multipliers separate a problem with a separable objective and coupling constraints into smaller optimization subproblems. A coordinating algorithm updates the multipliers using constraint residuals. This supports distributed computing, but minimizing the Lagrangian at optimal multipliers does not necessarily recover a feasible primal point; primal recovery may require additional procedures. (see.stanford.edu)"
    }
  ],
  "links": [
    "mathematical-optimization",
    "objective-function",
    "feasible-set",
    "lagrange-multipliers",
    "strong-duality",
    "convex-optimization",
    "convex-function",
    "affine-map",
    "convex-set",
    "karush-kuhn-tucker-conditions",
    "gradient",
    "saddle-point",
    "sensitivity-analysis",
    "algorithm",
    "distributed-computing"
  ],
  "sources": [
    {
      "title": "mit.edu/~dimitrib/Chapter_1_NEW_ALG.pdf",
      "url": "https://www.mit.edu/~dimitrib/Chapter_1_NEW_ALG.pdf"
    },
    {
      "title": "mit.edu/~gfarina/2025/67220s25_L08_lagrangian_duality/L08.pdf",
      "url": "https://www.mit.edu/~gfarina/2025/67220s25_L08_lagrangian_duality/L08.pdf"
    },
    {
      "title": "stanford.edu/class/ee364a/lectures/duality.pdf",
      "url": "https://stanford.edu/class/ee364a/lectures/duality.pdf"
    },
    {
      "title": "stanford.edu/~boyd/cvxbook/bv_cvxbook.pdf",
      "url": "https://www.stanford.edu/~boyd/cvxbook/bv_cvxbook.pdf"
    },
    {
      "title": "see.stanford.edu/materials/lsocoee364b/08-decomposition_notes.pdf",
      "url": "https://see.stanford.edu/materials/lsocoee364b/08-decomposition_notes.pdf"
    }
  ],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}