Linear approximation is a method of approximating a function near a chosen point by retaining its value and its first-order variation. For a real-valued function differentiable at , the approximation is
Geometrically, it replaces the graph near by its tangent line. In several variables, the derivative supplies a linear transformation that describes small changes in the output. Linear approximation is fundamental to calculus, numerical computation, uncertainty propagation, and the local analysis of nonlinear systems.
Definition and mathematical meaning
For a function with a derivative at , its linear approximation at is
Writing gives the equivalent form
The approximation is justified by the defining property of differentiability:
Thus, the approximation error becomes negligible relative to the size of the displacement . This is stronger than merely requiring the absolute error to tend to zero.
The function is generally an affine map, rather than a linear map in the strict algebraic sense: it need not send zero to zero. The expression “linear approximation” refers to its degree-one dependence on the variable, or to the fact that the output change
is a linear map of the input change.
The derivative is the unique coefficient with this first-order approximation property. If a number satisfies
then .
Geometric interpretation and examples
The graph of passes through and has slope . It is therefore the tangent line to the graph of at that point. Differentiability means that, under sufficiently strong magnification near the point, the difference between the curve and this line is small compared with horizontal displacement.
For example, let and choose . Since
the approximation is
Consequently,
whereas the actual value is approximately .
Several familiar small-argument formulas are linear approximations at zero:
The trigonometric formula assumes that angles are measured in radians. Each approximation is local; its usefulness depends on the size of and the accuracy required.
When , the linear approximation is constant. For at , it gives . This remains a valid first-order approximation because , although it does not describe the leading nonzero variation of the function.
Error estimates and Taylor expansion
Linear approximation is the first-degree truncation of a Taylor expansion, but its validity requires only differentiability, not the existence or convergence of an infinite Taylor series.
Differentiability alone gives
It does not, by itself, imply that the error is proportional to .
If has a continuous second derivative on an interval containing and , Taylor’s theorem gives
for some between and . Hence, if throughout that interval,
In asymptotic notation, the error is then .
The second derivative measures how rapidly the slope changes. A large displacement or substantial variation in slope can make the tangent-line model inaccurate. For a differentiable convex function on an interval, every tangent line lies at or below the graph throughout that interval; for a concave function, it lies at or above the graph.
Absolute and relative accuracy must also be distinguished. If , an approximation can have a small absolute error while having a large relative error. For example, the constant approximation to has relative error at every nonzero .
Several variables
For a differentiable function , the approximation at a point is
where is the gradient and the dot denotes the dot product. In coordinates,
For example, if , then near ,
The linear approximation retains and discards the second-order product .
Geometrically, for a scalar-valued function of variables, this affine approximation describes a tangent hyperplane to its graph.
More generally, let . Its derivative at is represented by the Jacobian matrix , giving
The derivative therefore describes the local action of a possibly nonlinear function through a matrix.
The existence of all partial derivatives at a point is not sufficient to establish this approximation. Differentiability requires a single linear map whose error is negligible for displacements approaching zero in every direction. Continuous partial derivatives in a neighborhood provide a standard sufficient condition.
If a scalar-valued function has continuous second derivatives near , its Hessian matrix describes the leading error:
Applications
Numerical root finding
Newton’s method approximates a function locally and finds where that approximation vanishes. Setting
gives
For systems of equations, the corresponding step is obtained by solving a linear system involving the Jacobian. This is a local procedure: convergence depends on the function, the starting point, and the behavior of its derivative.
Sensitivity and uncertainty propagation
In sensitivity analysis, a small input perturbation produces the approximate output change
The derivative identifies which input changes most strongly affect the output near the operating point.
If a random input is concentrated near its mean , with covariance matrix , first-order uncertainty propagation gives
For scalar output, this becomes
These formulas neglect nonlinear contributions, which may be important when uncertainty is large or the derivative vanishes.
Differential equations and local dynamics
For a dynamical system
let be an equilibrium, so that . Writing yields the linearized system
The eigenvalues of the Jacobian help determine local stability. For a continuously differentiable system, eigenvalues with strictly negative real parts imply local asymptotic stability; an eigenvalue with positive real part implies instability. When eigenvalues have zero real part and none have positive real part, linearization alone generally does not decide stability.
Optimization
In optimization, the local model
identifies first-order directions of increase and decrease. It underlies gradient-based algorithms and linearized constraints. At a point where the gradient vanishes, second-order or higher-order information is generally needed to distinguish a minimum, maximum, or saddle point.
Distinctions and limitations
Linear approximation is not the same as linear regression. A tangent approximation is determined by a function’s value and derivative at one point. A regression line is fitted to observations according to a statistical criterion and need not be tangent to an underlying function.
It also differs from linear interpolation. An interpolating line passes through two specified points; a tangent approximation matches the value and slope at one point. Piecewise linear approximations use multiple affine pieces to cover a wider domain.
A local model need not remain accurate far from its expansion point. It can miss curvature, turning points, constraints, and changes in qualitative behavior. At a nondifferentiable point, such as at zero, no single linear map provides a first-order approximation valid from both sides. Even where an approximation exists, the identity function
near zero illustrates why local agreement cannot justify extrapolation toward a singularity at .