{
  "id": "interior-point-method",
  "title": "Interior-point method",
  "lang": "en",
  "source_lang": "en",
  "summary": "An interior-point method solves constrained optimization problems by approaching a solution through the interior of inequality constraints, typically using barrier functions and primal–dual Newton steps.",
  "category": "mathematics",
  "subcategory": "applied",
  "type": "concept",
  "aliases": [
    "Interior-point algorithm",
    "interior method"
  ],
  "generated_at": "2026-11-06",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/interior-point-method/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/interior-point-method/",
      "json": "https://aiwiki.page/zh/interior-point-method.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "An interior-point method is a class of algorithms for mathematical optimization that approaches an optimal solution while keeping selected inequality-constrained variables strictly inside their permitted region. These methods are especially important in linear programming, convex optimization, and conic optimization, and are also used for nonlinear problems. Modern implementations commonly combine barrier functions, primal–dual optimality conditions, and Newton-type steps. The term describes a family of methods rather than a single algorithm: some maintain feasibility throughout, while others allow constraint violations during intermediate iterations."
    },
    {
      "heading": "Basic idea",
      "text": "Consider the constrained problem\n\n\\[\\begin{aligned} \\operatorname{minimize}\\quad & f_0(x),\\\\ \\text{subject to}\\quad & f_i(x)\\leq 0,\\qquad i=1,\\ldots,m,\\\\ & Ax=b. \\end{aligned}\\]\n\nHere \\(f_0\\) is the objective function, the inequalities describe restrictions, and the equalities restrict \\(x\\) to an affine subspace. A strictly feasible point satisfies \\(f_i(x)<0\\) for every inequality as well as \\(Ax=b\\).\n\nAn interior-point method discourages or prevents contact with the inequality boundary until the limiting solution is approached. In contrast, the simplex method for linear programming moves between basic feasible solutions, which, under standard assumptions, correspond to vertices of the feasible polyhedron.\n\n“Interior” does not necessarily mean interior in the full ambient space. Equality constraints may confine the feasible set to a lower-dimensional affine space. Moreover, infeasible-start algorithms may initially violate equalities or other constraints while maintaining positivity of slack variables and dual variables."
    },
    {
      "heading": "Barrier formulation",
      "text": "A standard construction uses a logarithmic barrier:\n\n\\[\\phi(x)=-\\sum_{i=1}^{m}\\log\\bigl(-f_i(x)\\bigr).\\]\n\nIt is defined where every \\(f_i(x)<0\\) and tends to \\(+\\infty\\) as any inequality approaches equality from the feasible side.\n\nInstead of solving the original problem directly, a barrier method solves a sequence of problems\n\n\\[\\begin{aligned} \\operatorname{minimize}\\quad & f_0(x)+\\mu\\phi(x),\\\\ \\text{subject to}\\quad & Ax=b, \\end{aligned}\\]\n\nwhere \\(\\mu>0\\). As \\(\\mu\\) decreases, the barrier contributes less to the objective, allowing the minimizer to approach the boundary.\n\nAn equivalent convention minimizes \\(t f_0(x)+\\phi(x)\\), with \\(t=1/\\mu\\) increasing. Both parameterizations describe the same family of minimizers.\n\nFor differentiable convex \\(f_i\\), the logarithmic barrier is convex on its domain. Its gradient and Hessian are\n\n\\[\\nabla\\phi(x) = \\sum_{i=1}^{m} \\frac{\\nabla f_i(x)}{-f_i(x)},\\]\n\nand\n\n\\[\\nabla^2\\phi(x) = \\sum_{i=1}^{m} \\left[ \\frac{\\nabla^2 f_i(x)}{-f_i(x)} + \\frac{\\nabla f_i(x)\\nabla f_i(x)^\\mathsf{T}}{f_i(x)^2} \\right].\\]\n\nThe second term introduces increasing curvature near the boundary. This helps keep iterates inside the barrier domain, but can also make the numerical systems harder to solve as the barrier parameter becomes small.\n\nThe central path\n\nUnder suitable existence and regularity assumptions, the minimizers \\(x(\\mu)\\) form the central path. The path balances improvement in the original objective against avoidance of the boundary.\n\nDefine inequality multipliers by\n\n\\[\\lambda_i(\\mu)=\\frac{\\mu}{-f_i(x(\\mu))}.\\]\n\nThe barrier optimality conditions then take the form\n\n\\[\\nabla f_0(x) + \\sum_{i=1}^{m}\\lambda_i\\nabla f_i(x) + A^\\mathsf{T}y=0,\\]\n\n\\[Ax=b,\\qquad \\lambda_i[-f_i(x)]=\\mu.\\]\n\nThese are perturbed Karush–Kuhn–Tucker conditions. Ordinary complementary slackness requires each product to be zero; the barrier replaces zero by a positive parameter.\n\nFor a convex problem, an exact barrier minimizer and these multipliers produce feasible primal and dual points with duality gap\n\n\\[f_0(x)-g(\\lambda,y)=m\\mu,\\]\n\nwhere \\(g\\) is the dual objective. Consequently,\n\n\\[0\\leq f_0(x)-p^\\star\\leq m\\mu,\\]\n\nprovided the original optimal value \\(p^\\star\\) is finite. This gives a quantitative stopping criterion. Approximate inner solves require corresponding allowances for residual errors."
    },
    {
      "heading": "Primal–dual methods for linear programming",
      "text": "A standard primal linear program is\n\n\\[\\begin{aligned} \\operatorname{minimize}\\quad & c^\\mathsf{T}x,\\\\ \\text{subject to}\\quad & Ax=b,\\qquad x\\geq0. \\end{aligned}\\]\n\nIts dual is\n\n\\[\\begin{aligned} \\operatorname{maximize}\\quad & b^\\mathsf{T}y,\\\\ \\text{subject to}\\quad & A^\\mathsf{T}y+s=c,\\qquad s\\geq0. \\end{aligned}\\]\n\nHere \\(s\\) is the dual slack vector. When primal and dual optima exist, their optimality conditions include\n\n\\[Ax=b,\\qquad A^\\mathsf{T}y+s=c,\\qquad x,s\\geq0, \\qquad x_i s_i=0.\\]\n\nA primal–dual interior-point method instead works with \\(x>0\\), \\(s>0\\), and perturbed complementarity:\n\n\\[Xs=\\mu\\mathbf 1,\\]\n\nwhere \\(X=\\operatorname{diag}(x)\\) and \\(\\mathbf 1\\) is the all-ones vector. For primal- and dual-feasible iterates,\n\n\\[c^\\mathsf{T}x-b^\\mathsf{T}y=x^\\mathsf{T}s.\\]\n\nThus complementarity directly measures the duality gap.\n\nNewton equations\n\nApplying Newton’s method to the perturbed conditions gives\n\n\\[\\begin{bmatrix} 0&A^\\mathsf{T}&I\\\\ A&0&0\\\\ S&0&X \\end{bmatrix} \\begin{bmatrix} \\Delta x\\\\ \\Delta y\\\\ \\Delta s \\end{bmatrix} = \\begin{bmatrix} r_d\\\\ r_p\\\\ \\sigma\\bar\\mu\\mathbf 1-Xs \\end{bmatrix},\\]\n\nwhere\n\n\\[r_d=c-A^\\mathsf{T}y-s,\\qquad r_p=b-Ax,\\qquad \\bar\\mu=\\frac{x^\\mathsf{T}s}{n},\\]\n\nand \\(S=\\operatorname{diag}(s)\\).\n\nThe centering parameter \\(\\sigma\\) controls the balance between reducing complementarity and remaining near the central path. A suitable step-length rule keeps the updated primal variables and dual slacks positive.\n\nThe equations show why primal–dual methods need not solve each barrier subproblem accurately before reducing the barrier parameter: feasibility, complementarity, and centering can improve together.\n\nPredictor–corrector methods\n\nA common practical approach first computes an affine-scaling predictor, estimating progress toward zero complementarity without explicit centering. A corrector step then compensates for nonlinear complementarity terms and introduces an appropriate centering component.\n\nMehrotra-type predictor–corrector methods are widely used in linear and convex quadratic programming. Their effectiveness depends partly on reusing a matrix factorization for multiple right-hand sides, making correction steps relatively inexpensive compared with the main factorization."
    },
    {
      "heading": "Main variants",
      "text": "Interior-point methods can be classified along several overlapping dimensions:\n\n- Primal barrier methods approximately minimize a sequence of barrier-augmented objectives.\n- Primal–dual methods update primal variables and dual multipliers together using perturbed optimality conditions.\n- Path-following methods keep iterates in a neighborhood of the central path while reducing the barrier parameter.\n- Potential-reduction methods decrease a function combining objective progress and measures of centrality.\n- Feasible-start methods begin from points satisfying the relevant feasibility conditions.\n- Infeasible-start methods reduce feasibility residuals while preserving positivity of selected variables.\n- Homogeneous self-dual methods solve an embedding that can, under appropriate conditions, yield an optimal solution or a certificate of infeasibility or unboundedness.\n\nThese categories are not mutually exclusive. A solver may simultaneously be primal–dual, infeasible-start, path-following, and predictor–corrector."
    },
    {
      "heading": "Complexity and self-concordant barriers",
      "text": "Interior-point methods are notable for combining strong practical performance with polynomial worst-case complexity guarantees for important problem classes.\n\nA central theoretical concept is the self-concordant barrier. Self-concordance bounds changes in local curvature in a way that supports reliable analysis of Newton steps. Its barrier parameter, usually denoted \\(\\nu\\), quantifies an aspect of the barrier’s complexity.\n\nFor suitable short-step path-following methods, a typical bound on the number of Newton iterations has the form\n\n\\[O\\!\\left(\\sqrt{\\nu} \\log\\frac{\\nu\\mu_0}{\\varepsilon}\\right),\\]\n\nwhere \\(\\mu_0\\) is an initial barrier parameter and \\(\\varepsilon\\) is the target absolute duality gap. The precise statement depends on initialization, the central-path neighborhood, and the stopping criterion.\n\nFor the nonnegative orthant in \\(n\\) variables, the standard logarithmic barrier has parameter \\(\\nu=n\\). These iteration bounds should not be confused with total computational cost: every iteration requires linear algebra, and bit-complexity analysis must also account for data encoding, precision, and initialization.\n\nPolynomial-time solvability also does not imply a strongly polynomial algorithm. General linear programming is not known to admit a strongly polynomial algorithm."
    },
    {
      "heading": "Extensions beyond linear programming",
      "text": "Convex quadratic and conic optimization\n\nFor convex quadratic programs, the quadratic objective contributes a positive semidefinite Hessian to the Newton system. Much of the primal–dual framework remains applicable.\n\nIn conic optimization, the nonnegative orthant is replaced by a more general convex cone. Important cases include:\n\n- Second-order cone programming, which includes constraints involving Euclidean norms.\n- Semidefinite programming, whose variables include symmetric positive semidefinite matrices.\n\nFor a symmetric positive definite matrix \\(X\\), a standard barrier for the positive semidefinite cone is\n\n\\[-\\log\\det X.\\]\n\nThe barrier is finite only in the positive definite interior. This extends the scalar logarithmic barrier to matrix-valued constraints.\n\nConic interior-point methods support applications in control, estimation, experimental design, and convex relaxations of difficult discrete optimization problems.\n\nNonlinear and nonconvex optimization\n\nInterior-point methods also apply to smooth nonlinear problems, often after introducing positive slack variables. For nonconvex objectives or constraints, however, the Newton system may involve indefinite curvature, and convergence to a global optimum is generally not guaranteed.\n\nPractical methods use devices such as regularized linear systems, merit functions, filter methods, or trust regions to obtain useful convergence behavior. Even convergence to a stationary point requires assumptions about smoothness, constraint qualifications, and the handling of infeasibility. Guarantees from convex barrier theory do not automatically extend to arbitrary nonlinear programs."
    },
    {
      "heading": "Numerical implementation",
      "text": "The dominant cost is usually the solution of a large linear system. Eliminating variables can produce normal equations or an augmented saddle-point system.\n\nFor linear programming, elimination often yields a matrix of the form\n\n\\[A D A^\\mathsf{T},\\]\n\nwhere \\(D\\) is positive diagonal. If \\(A\\) has full row rank, this matrix is positive definite and can be treated using Cholesky factorization. Alternative formulations preserve a larger indefinite system.\n\nEfficient implementations exploit sparsity, ordering strategies, scaling, and reusable symbolic factorizations. Important numerical issues include:\n\n- Ill-conditioning near a solution. Complementary primal and dual variables can develop very different magnitudes.\n- Rank deficiency and degeneracy. Dependent constraints or poorly determined solutions may require preprocessing or regularization.\n- Finite precision. Extremely small barrier parameters can make residual reduction unreliable in floating-point arithmetic.\n- Initialization. Strictly feasible starting points may be difficult to construct.\n- Stopping criteria. Solvers generally check primal residuals, dual residuals, and a scaled complementarity gap together.\n\nIf strict feasibility is absent, a cone-constrained problem may lie entirely on a proper face of its cone. Facial reduction can sometimes reformulate the problem over a smaller cone with a more suitable interior."
    },
    {
      "heading": "Historical development",
      "text": "Barrier approaches to constrained optimization predate the modern complexity theory of interior-point methods. Work on sequential unconstrained minimization, including that of Anthony Fiacco and Garth McCormick in the 1960s, established influential barrier and penalty formulations.\n\nIn 1984, Narendra Karmarkar introduced a polynomial-time projective algorithm for linear programming. It stimulated extensive research into interior algorithms and their practical implementation. Karmarkar’s method was not the first polynomial-time algorithm for linear programming—the ellipsoid method had already established that result—but it helped make interior methods a major computational alternative to simplex algorithms.\n\nDuring the late 1980s and 1990s, path-following and primal–dual methods developed rapidly. Yurii Nesterov and Arkadii Nemirovskii established a broad theory based on self-concordant barriers, while predictor–corrector techniques helped shape practical solvers."
    },
    {
      "heading": "Applications and limitations",
      "text": "Interior-point methods are used in operations research, engineering design, energy-system optimization, finance, and statistical estimation. They are especially effective when a problem has exploitable matrix structure and accurate solutions are required.\n\nTheir advantages include broad applicability, informative primal–dual stopping criteria, and strong theory for convex problems. Their limitations are equally important:\n\n- Sparse factorizations can require substantial memory because of fill-in.\n- Warm-starting after small problem changes can be less straightforward than reusing a simplex basis.\n- Barrier iterates do not inherently provide an optimal basis; linear-programming solvers may use a crossover procedure when a basic solution is needed.\n- For extremely large problems requiring only moderate accuracy, first-order methods such as gradient descent or operator-splitting methods may have lower per-iteration costs.\n- For integer programming, interior-point methods normally solve continuous relaxations rather than enforce integrality directly.\n- Degeneracy, weak feasibility, and poor scaling can substantially affect robustness despite favorable theoretical iteration bounds."
    }
  ],
  "links": [
    "mathematical-optimization",
    "linear-programming",
    "convex-optimization",
    "objective-function",
    "simplex-method",
    "feasible-set",
    "gradient",
    "hessian-matrix",
    "karush-kuhn-tucker-conditions",
    "lagrangian-duality",
    "newtons-method",
    "line-search",
    "semidefinite-programming",
    "positive-definite-matrix",
    "system-of-linear-equations",
    "cholesky-decomposition",
    "sparse-matrix",
    "floating-point-arithmetic",
    "operations-research",
    "gradient-descent",
    "integer-programming"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}