A norm on a vector space is a real-valued function that assigns a nonnegative size to each vector. It generalizes the absolute value of a number and the ordinary length of a vector in Euclidean space. The defining requirements are that only the zero vector has size zero, scalar multiplication scales size by the absolute value of the scalar, and the size of a sum does not exceed the sum of the sizes. These requirements allow vectors to be compared by magnitude without requiring coordinates, angles, or an inner product.
Norms connect linear algebra with mathematical analysis. A norm defines a distance and therefore notions of convergence, continuity, approximation, and completeness. Depending on the vector space, its elements may be finite coordinate lists, infinite sequences, functions, matrices, or linear operators. Choosing a norm determines which features of these objects are controlled: maximum error, average magnitude, energy, total variation in coefficients, or sensitivity to perturbations.
Different norms can describe the same underlying vector space while producing different geometries. In finite dimensions, all norms yield the same topology, although their numerical values and associated optimization problems differ. In infinite dimensions, the choice can change which sequences converge, which operators are continuous, and whether the space is complete. These distinctions make norms central to functional analysis, differential equations, numerical computation, and optimization.
Definition and elementary consequences
Let be a vector space over the real numbers or the complex numbers, denoted by . A norm is a function
satisfying, for every and every ,
These properties are called positive definiteness, absolute homogeneity, and the triangle inequality. A vector space equipped with a specified norm is a normed vector space. The double-bar notation distinguishes a norm from scalar absolute value, although the two notions coincide on the one-dimensional scalar space with its usual norm.
Absolute homogeneity implies , so a vector and its negative have the same size. Combining the triangle inequality with gives the reverse triangle inequality:
Thus, if two vectors are close in norm, their norms are close as real numbers. This estimate is often more useful than the defining triangle inequality when passing to limits or establishing error bounds.
For any finite collection of vectors and scalars,
A norm is consequently a convex function: for ,
Convexity is weaker than the full set of norm axioms. For example, the squared Euclidean length is convex but is not a norm, because scaling by multiplies it by , rather than by .
A norm determines a distance by
This turns into a metric space. Its distance is translation invariant, since , and scales linearly under scalar multiplication. Not every metric on a vector space comes from a norm. For example,
is a metric with the same convergent sequences as the original norm metric, but it lacks the required scaling law.
The term “norm” also occurs in algebra, including norms of field extensions. Such constructions have different defining properties and should not be identified with vector-space norms merely because they share a name.
Coordinate norms and their inequalities
For and a real exponent , the standard -norm is
The limiting case is
The most frequently used choices are , , and . They measure, respectively, total absolute coordinate magnitude, Euclidean length, and the largest absolute coordinate.
For the vector , these give
The value follows from the Pythagorean theorem. The other values are not approximations to Euclidean length: they are exact measurements under different definitions of size. The associated distances are useful when travel is constrained to coordinate directions, when errors accumulate across coordinates, or when a bound must hold for every coordinate individually.
The triangle inequality for general -norms is Minkowski’s inequality. A closely related result, Hölder’s inequality, states that
where and the reversed endpoint convention are included. When , this becomes the familiar Cauchy–Schwarz inequality. These inequalities explain why the range is structurally important.
For ,
with . The dimension-dependent factor is sharp, as can be seen from vectors whose coordinates all have the same magnitude. A vector supported on a single coordinate shows that the first inequality can also be an equality. In particular,
The factor matters when comparing error criteria across increasing dimensions.
Positive coordinate weights produce further norms:
Weights allow coordinates with different units or relative significance to be rescaled. If a weight is zero, positive definiteness fails on the full coordinate space.
For , the same formula does not define a norm when . Taking and gives
Such expressions belong instead to the theory of quasi-norms.
Unit balls and convex geometry
The closed unit ball of a normed space is
and its unit sphere is . An open ball of radius centered at is
Translation and scaling therefore recover every ball from the unit ball. Conversely, the shape of the unit ball determines the norm completely.
Every norm unit ball is a convex set. It is also balanced: if and , then . Over the real numbers, balancedness includes symmetry about the origin; over the complex numbers, it also includes invariance under multiplication by scalars of modulus one. The ball is absorbing, meaning that every vector lies in for some positive real number .
In a finite-dimensional real space, any compact convex set that is symmetric about the origin and has the origin in its interior is the closed unit ball of a unique norm. The norm is recovered by the Minkowski functional:
Convexity yields the triangle inequality, symmetry gives absolute homogeneity over real scalars, and boundedness together with an interior neighborhood yields positive definiteness. In complex spaces, the corresponding construction requires balancedness, not merely symmetry under negation.
In , the unit balls of the -, -, and -norms are a diamond, a disk, and an axis-aligned square. For , the -norm unit ball has no nontrivial line segment on its boundary. This property is called strict convexity. For the - and -norms in dimensions at least two, boundary line segments are present, so strict convexity fails.
These shapes govern equality in the triangle inequality. In a strictly convex real normed space, equality
for nonzero and forces them to be positive scalar multiples of one another. Without strict convexity, equality may hold in many additional directions. For instance, under the -norm, the coordinate vectors and attain equality despite being linearly independent.
Strict convexity also influences approximation. If a point has a nearest point in a convex subset of a strictly convex space, that nearest point is unique. Existence is a separate matter: it follows for nonempty closed subsets in finite dimensions, but requires additional hypotheses in infinite-dimensional settings.
Norms induced by inner products
An inner product determines a norm through
The Cauchy–Schwarz inequality establishes the triangle inequality for this expression. Such norms have additional structure: they support angles, orthogonality, and the identities associated with Euclidean geometry. A norm alone does not generally provide these notions.
The standard inner product on gives the Euclidean norm. On , the standard Hermitian inner product gives
More generally, if is a real symmetric or complex Hermitian positive-definite matrix, then
is an inner-product norm. Here denotes the conjugate transpose. Its unit ball is an ellipsoid. The eigenvalues and eigenvectors of determine the lengths and orientations of its principal axes.
Not every norm arises this way. The exact criterion is the parallelogram law:
The Jordan–von Neumann theorem states that a real or complex norm is induced by an inner product if and only if this identity holds for every pair of vectors. In the real case, the inner product is then recovered by polarization:
An analogous identity using recovers the imaginary part in the complex case.
For example, in with the -norm, let and . Both and equal , so the left side of the parallelogram identity is , while the right side is . This norm therefore cannot come from any inner product.
Completeness adds another distinction. A complete inner-product space is a Hilbert space, whereas a complete normed space is a Banach space. Every Hilbert space is a Banach space under its induced norm, but many Banach spaces have norms incompatible with any inner product.
Inner-product geometry also gives a particularly strong approximation theory. In a Hilbert space, every nonempty closed convex set admits a unique nearest point to each vector. For a closed linear subspace, this nearest-point map is the orthogonal projection. General normed spaces need not have projections with the same existence, uniqueness, or linearity properties.
Topology, convergence, and equivalence of norms
A norm supplies a topology through its open balls. A sequence converges to precisely when
The reverse triangle inequality makes the norm function itself continuous; more specifically, it is Lipschitz with constant one relative to its own metric. Addition and scalar multiplication are also continuous, so every normed space is a topological vector space.
Two norms and on the same vector space are called equivalent if there are constants such that
for all . Equivalent norms have the same open sets and convergent sequences. They also have the same Cauchy sequences, the same bounded subsets, and the same continuous linear maps. For norms, equality of the induced topologies is equivalent to the existence of these two-sided bounds, because continuity at zero can be extended to all vectors by homogeneity.
Every pair of norms on a finite-dimensional real or complex vector space is equivalent. One proof chooses a basis and compares an arbitrary norm with the Euclidean norm of the coordinates. The triangle inequality gives an upper bound. Continuity and compactness of the Euclidean unit sphere then give a strictly positive lower bound. The Heine–Borel theorem supplies the compactness needed for this argument.
Consequently, finite-dimensional questions about convergence and continuity do not depend on the chosen norm. Numerical constants do depend on it, however. Equivalent norms can assign very different magnitudes to the same vector, and comparison constants can increase with dimension. Thus finite-dimensional equivalence does not justify ignoring norm choice in high-dimensional error bounds or computational complexity estimates.
In infinite dimensions, norms can fail to be equivalent. On the space of continuous functions, consider
Although , no positive constant gives the reverse inequality uniformly over all continuous functions. The sequence satisfies
Thus it converges to zero in the integral norm but not in the uniform norm. Narrow peaks provide the same phenomenon: their total area may approach zero while their maximum height remains fixed.
Infinite-dimensional norms and completeness
Sequence and function spaces provide the principal infinite-dimensional examples. For , the sequence space consists of scalar sequences satisfying
with norm
The space consists of bounded sequences with the supremum norm. Unlike finite coordinate spaces, these spaces do not all contain the same vectors: for example, belongs to but not to .
On a measure space , the corresponding spaces use the Lebesgue integral:
For , the norm is the essential supremum, which disregards exceptional sets of measure zero. Functions equal almost everywhere are identified. Without this identification, a nonzero function supported on a null set could have zero size, contradicting positive definiteness.
A Cauchy sequence in a normed space satisfies
If every such sequence converges to an element of the space, the space is complete and is called a Banach space. The spaces and , for , are Banach spaces. So is with the supremum norm: a uniformly Cauchy sequence of continuous functions has a continuous uniform limit.
Completeness depends on both the underlying collection and its norm. The space of finite-support sequences is not complete in the norm; truncations of an infinite square-summable sequence form a Cauchy sequence whose limit has infinitely many nonzero coordinates. Its completion is . Similarly, is not complete under the integral -norm, and its completion can be identified with .
Norms can control derivatives as well as function values. A typical first-order Sobolev norm is
for , where derivatives are understood weakly. Such norms measure regularity and are fundamental in the study of partial differential equations. They distinguish functions that may be close in total magnitude but have very different oscillations or rates of variation.
Operator norms and dual norms
Given normed spaces and , a linear map is bounded if some satisfies
for every . Its operator norm is
This is the smallest admissible bound . For a linear map between normed spaces, boundedness is equivalent to continuity, and continuity at zero already suffices.
Operator norms quantify the largest amplification of an input. They satisfy
whenever the composition is defined. For a matrix acting between coordinate spaces with the same chosen -norm, the induced matrix norms include
The induced -norm is the largest singular value:
This connects norm estimates with the singular value decomposition.
A matrix can also be treated simply as a vector of entries. The Frobenius norm,
arises this way. It differs from the induced -norm and equals the square root of the sum of squared singular values. For the identity matrix, the induced -norm is , while the Frobenius norm is .
The continuous dual space consists of continuous scalar-valued linear functionals. Its norm is
Under the standard coordinate pairing, the dual of a finite-dimensional -norm is the -norm with . Thus the - and -norms are dual to one another, while the Euclidean norm is self-dual.
The Hahn–Banach theorem supplies a deeper relation:
For every nonzero , a norm-one functional attains this value at , after a suitable normalization of its phase in the complex case. This expresses a vector’s size entirely through scalar measurements and explains why duality is so effective in optimization and functional analysis. The dual space is Banach under its operator norm even when the original normed space is incomplete.
Seminorms, quotient norms, and related constructions
A seminorm satisfies nonnegativity, absolute homogeneity, and the triangle inequality, but may vanish on nonzero vectors. Its zero set
is a linear subspace. Seminorms occur naturally when a measurement deliberately ignores some features. For example, on differentiable functions,
is a seminorm on : every constant function has value zero.
A seminorm becomes a norm on the quotient vector space by setting
The expression is independent of the representative because adding a vector in does not change the seminorm. This construction treats vectors as equivalent when the measurement cannot distinguish them. The passage from measurable functions to almost-everywhere equivalence classes in is an important instance.
A different quotient construction starts with a normed space and a linear subspace . Define
This is always a seminorm on the quotient and is a norm precisely when is closed. If is not closed, a vector in its closure but outside represents a nonzero coset with zero quotient size. When is Banach and is closed, the quotient is also Banach. The infimum need not be achieved by any representative.
Norms can also be combined on product spaces. If and are normed, then
and
are norms on . More generally, a finite -sum combines the component norms by the usual -norm formula. For finitely many components these choices are equivalent, although their unit balls differ.
A quasi-norm relaxes the triangle inequality to
for a fixed , while retaining positive definiteness and absolute homogeneity. For , the usual expression is a quasi-norm and satisfies
These spaces remain important but lack some geometric properties of normed spaces, including convexity of their unit balls.
The quantity commonly called the “ norm” counts nonzero coordinates. It is not a norm: multiplication by any nonzero scalar leaves the count unchanged, violating absolute homogeneity.
Optimization, approximation, and numerical computation
Norms serve as objective functions, constraints, and error measures in optimization. A problem of the form
seeks a vector whose image approximates the data . The selected norm determines what “best” means. The -norm minimizes total absolute residual, the -norm minimizes Euclidean residual magnitude, and the -norm minimizes the largest absolute residual.
Minimizing the squared -norm gives least squares:
For real matrices, differentiating yields the normal equations
Squaring preserves minimizers because is increasing for . The squared norm is differentiable everywhere, whereas the Euclidean norm itself is not differentiable at zero. If has full column rank, the least-squares minimizer is unique.
Norm penalties are central to regularization. Ridge regression uses a squared Euclidean penalty,
while lasso regression uses
The corners of the -norm ball help explain why lasso solutions can have exactly zero coordinates. The effect depends on the interaction between the objective’s level sets and the constraint geometry; it is not simply a consequence of the -norm assigning larger values than the -norm.
Dual norms describe worst-case linear effects. Under the standard real coordinate pairing,
Thus a bound on perturbations in one norm produces a sensitivity bound in its dual norm. This identity is used in robust optimization and in first-order estimates of how an objective changes under a small input displacement.
In numerical linear algebra, norms quantify residuals, forward errors, and backward errors. For an invertible square matrix,
is the normwise condition number, using a compatible induced norm. If and , then
for nonzero . A small residual therefore need not imply a small solution error when the matrix is ill-conditioned.
Actual norm evaluation also requires care in floating-point arithmetic. Directly summing can overflow or underflow even when the final Euclidean norm is representable. Stable implementations rescale intermediate quantities, separating the overall magnitude from a sum of normalized squares.
Historical development and structural limits
The concept of norm emerged from efforts to extend geometric and analytic reasoning beyond finite coordinate spaces. Nineteenth-century analysis increasingly treated functions and sequences as objects in their own right, while integral equations and infinite systems required precise meanings for size and convergence. The modern abstraction separated those measurements from any particular formula or coordinate representation.
Maurice Fréchet’s 1906 work on abstract spaces helped establish the metric-space approach, in which distance is specified axiomatically. Normed spaces add linear structure and compatibility with scaling. In 1922, Stefan Banach published foundational work on operations in abstract spaces; his 1932 book Théorie des opérations linéaires organized much of the theory of complete normed spaces and bounded linear operators. These developments established Banach spaces as a general setting for analysis rather than a collection of unrelated function-space examples.
Inner-product spaces formed a related but more restrictive branch. Work associated with David Hilbert on integral equations made infinite-dimensional analogues of Euclidean geometry central to analysis. In 1935, Pascual Jordan and John von Neumann characterized inner-product norms through the parallelogram law. Their result precisely identified which norm geometries admit a compatible inner product.
The distinction between normed and more general topological vector spaces became equally important. A Hausdorff locally convex topological vector space is normable exactly when it has a bounded neighborhood of zero, where boundedness is understood in the topological-vector-space sense. Many useful spaces instead require families of seminorms. For example, the standard topology on is generated by
It controls every derivative separately and cannot be represented by a single norm inducing that topology.
Infinite-dimensional norm geometry also imposes limits that have no finite-dimensional counterpart. The closed unit ball of an infinite-dimensional normed space is never compact in the norm topology. Consequently, bounded sequences need not contain norm-convergent subsequences. In , the standard coordinate vectors all have norm one, but
so no subsequence can converge in norm.
Weaker notions of convergence partly compensate for this loss. A sequence converges weakly when every continuous linear functional converges on it. The vectors converge weakly to zero in , despite having constant norm one. Norm convergence always implies weak convergence, but the reverse implication fails in general. This separation underlies compactness methods in functional analysis and explains why infinite-dimensional existence proofs often use a topology weaker than the one directly defined by the norm.