A Lyapunov function is a scalar-valued function used to study the stability of an equilibrium of a dynamical system without explicitly solving its equations of motion. It is typically positive away from the equilibrium and nonincreasing along system trajectories, behaving like a generalized measure of energy or distance from equilibrium. Suitable additional conditions establish convergence to the equilibrium, convergence rates, or bounds on the set of initial states that approach it. The method is named after Aleksandr Lyapunov, who developed the foundations of his direct method in his 1892 work on the stability of motion.
Definition for continuous-time systems
Consider the autonomous system of ordinary differential equations
where is an open neighborhood of the origin and . Assume that is locally Lipschitz continuous, so that each initial state has a unique local solution. An equilibrium at another point can be moved to the origin by a change of coordinates.
A continuously differentiable function is a Lyapunov function for the origin, in a common convention, if:
;
for every nonzero ;
its derivative along the system satisfies
The first two conditions say that is positive definite relative to the equilibrium. This terminology applies to scalar functions and does not require to be a quadratic expression.
The derivative along trajectories is
where is the gradient of . By the chain rule, this expression equals
Thus, measures change along the actual motion, rather than variation in an arbitrary direction.
If
the function is often called a strict Lyapunov function. Terminology varies: some authors reserve “Lyapunov function” for this strict case and call the non-strict case a weak Lyapunov function. A function proposed for testing, before its required properties have been established, is a Lyapunov candidate.
Stability conclusions
Lyapunov functions provide sufficient conditions for several different forms of stability.
Stability in the sense of Lyapunov
The origin is stable in the sense of Lyapunov if, for every , there is a such that
Here denotes a norm. Stability means that sufficiently small initial disturbances remain small; it does not by itself imply that they decay.
A positive-definite with establishes this form of stability. The geometric reason is that a trajectory cannot escape an appropriate small sublevel set of : escaping would require the value of to increase.
Asymptotic stability
An equilibrium is asymptotically stable if it is stable and all trajectories starting sufficiently close to it satisfy
For an autonomous system under the regularity assumptions above, a positive-definite whose derivative is negative definite establishes local asymptotic stability.
Negative semidefiniteness alone is insufficient. A trajectory may remain indefinitely on a level set of , as occurs in an undamped oscillator.
Global asymptotic stability
A local Lyapunov argument concerns only initial states in a neighborhood of the equilibrium. To establish global asymptotic stability on , a standard sufficient condition is that be positive definite everywhere, have a negative-definite derivative, and be radially unbounded:
For a continuous function on , radial unboundedness ensures that its sublevel sets are compact. A trajectory confined to such a set cannot escape to infinity in finite time; with local Lipschitz continuity of , its solution therefore continues for all future time.
A globally defined positive-definite function is not necessarily radially unbounded. Consequently, global convergence cannot generally be inferred merely by checking positivity and strict decrease everywhere.
Exponential stability
Quantitative inequalities yield convergence rates. Suppose that, in a neighborhood of the origin,
where . Then
and hence
These estimates establish exponential stability. If the inequalities hold globally, the conclusion is global exponential stability.
Geometric interpretation and regions of attraction
The level sets
can be viewed as generalized energy contours. The condition means that the vector field points inward or tangentially at their boundaries; strict decrease excludes tangency away from the equilibrium.
A sublevel set
is positively invariant when trajectories starting in it cannot leave it in forward time. If is compact, lies within the domain where the Lyapunov conditions hold, and except at the origin, then it provides an inner estimate of the region of attraction: every state in converges to the origin.
Different Lyapunov functions can certify different regions for the same system. A small certified region is therefore a limitation of the particular certificate, not necessarily the true boundary of attraction.
LaSalle’s invariance principle
Strict decrease is sufficient for convergence but is not always necessary. LaSalle’s invariance principle handles important cases where is only negative semidefinite.
Let be a compact, positively invariant set, and suppose that is continuously differentiable on a neighborhood of , with there. Define
Every trajectory starting in approaches the largest invariant subset of . “Invariant” here requires more than satisfying at one instant: the motion must remain in that set.
If the largest invariant subset is just the equilibrium, the principle proves convergence to that equilibrium. This distinction is essential in mechanical systems, where instantaneous dissipation may vanish at states that do not represent stationary motion.
Examples
Scalar nonlinear decay
For
choose
Then
The function is positive definite and radially unbounded, so the origin is globally asymptotically stable.
The equilibrium is not exponentially stable. The solution is
which decays algebraically rather than exponentially. This example shows why strict decrease alone does not establish an exponential rate.
Undamped oscillator
For
take
Then . The origin is stable, but every nonzero trajectory remains on a closed constant-energy curve and does not converge to the origin.
Damped oscillator
For
the same candidate gives
The derivative vanishes on the entire line , not only at the origin. However, a point with and immediately leaves that line because . The largest invariant subset of is therefore the origin.
The compact energy sublevel sets and LaSalle’s principle establish global asymptotic stability.
Linear systems and the Lyapunov equation
For the linear system
a standard candidate is the quadratic form
where is a positive-definite matrix. Its derivative is
The continuous-time Lyapunov equation is
where is symmetric positive definite. If a positive-definite solution exists, the origin is globally exponentially stable.
More precisely, the following are equivalent:
- every eigenvalue of has strictly negative real part;
- for every symmetric positive-definite , the Lyapunov equation has a unique symmetric positive-definite solution .
A matrix satisfying the first condition is called a Hurwitz matrix. Its solution can be represented as
where is the matrix exponential.
For a differentiable nonlinear system, a Hurwitz Jacobian matrix at an equilibrium also yields a local quadratic Lyapunov function: sufficiently near the equilibrium, the strictly decreasing quadratic contribution dominates higher-order terms. When the linearization has eigenvalues on the imaginary axis, this argument is generally inconclusive, as the system illustrates.
Discrete-time and time-dependent systems
Discrete time
For
the derivative is replaced by the one-step difference
Positive definiteness together with establishes stability, while strict negativity away from the origin gives asymptotic stability under the usual continuity assumptions.
For , the corresponding matrix equation is
For every symmetric positive-definite , it has a unique symmetric positive-definite solution precisely when every eigenvalue of has modulus less than one.
Time-dependent systems
For a nonautonomous system
a Lyapunov function may depend explicitly on time:
Its total derivative is
Uniform stability conclusions require bounds that are uniform in time. A common formulation uses continuous, strictly increasing functions , with , such that
Suitable local bounds of this form establish uniform asymptotic stability. Pointwise positivity and negativity without appropriate uniform bounds do not generally provide the same conclusion.
Construction and applications
There is no universal simple procedure for finding a useful Lyapunov function. Common approaches include:
- Physical energy: kinetic plus potential energy often supplies a candidate for mechanical or electrical systems, with dissipation determining its derivative.
- Quadratic construction: solving a Lyapunov equation gives a systematic method for stable linear systems and local analysis of nonlinear systems.
- Weighted combinations: combining subsystem functions can establish stability of interconnected systems.
- Polynomial search: for polynomial dynamics, structured searches for a polynomial candidate can use sum-of-squares certificates and semidefinite programming, a form of convex optimization.
- Optimization-based constructions: objective gaps, distances to minimizers, or combinations of objective and momentum terms can certify convergence of optimization algorithms.
In control theory, a control Lyapunov function concerns a system
and expresses the possibility of choosing an admissible control that makes decrease. Turning this condition into a feedback law requires attention to input constraints and the regularity needed for well-defined closed-loop trajectories.
A common Lyapunov function decreases for every member of a family of systems. It can establish stability despite switching between those systems, subject to the appropriate strictness and comparison bounds. Stability of each subsystem separately does not imply stability under arbitrary switching.
For stochastic differential equations, analogous methods apply a process’s infinitesimal generator to . The resulting drift condition replaces the deterministic trajectory derivative. Depending on the hypotheses, it can establish moment bounds or particular probabilistic forms of stability; it does not automatically imply monotonic decrease along every sample path.
Converse theorems and limitations
The direct method starts with a function and deduces stability. Converse Lyapunov theorems proceed in the opposite direction: under appropriate regularity assumptions, asymptotic stability implies the existence of a Lyapunov function. Important versions guarantee smooth functions for smooth autonomous systems.
These theorems do not necessarily provide a practical construction or guarantee a function in a restricted class, such as quadratic forms or polynomials of a chosen degree. Failure to find a certificate within that class is therefore not proof of instability.
Other limitations concern interpretation and verification:
- A Lyapunov function generally does not uniquely characterize a system; many different functions may certify the same equilibrium.
- A nonincreasing function does not necessarily prove convergence to a single point.
- A certificate valid only on a restricted domain cannot establish behavior outside it.
- Floating-point sampling of cannot by itself verify an inequality over a continuous region.
- Learned or numerically fitted candidates require additional verification before they become rigorous stability certificates.
- Nonsmooth systems, discontinuous feedback laws, and infinite-dimensional systems require versions of the theory adapted to their solution concepts and analytical setting.