{
  "id": "norm-vector",
  "title": "Norm (vector spaces)",
  "lang": "en",
  "source_lang": "en",
  "summary": "A norm measures vector magnitude in a way compatible with scalar multiplication and addition, providing the foundation for normed spaces, convergence, and functional analysis.",
  "category": "mathematics",
  "subcategory": "analysis",
  "type": "concept",
  "aliases": [
    "Vector norm",
    "vector-space norm"
  ],
  "generated_at": "2026-11-03",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/norm-vector/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/norm-vector/",
      "json": "https://aiwiki.page/zh/norm-vector.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "A norm on a vector space is a real-valued function that assigns a nonnegative size to each vector. It generalizes the absolute value of a number and the ordinary length of a vector in Euclidean space. The defining requirements are that only the zero vector has size zero, scalar multiplication scales size by the absolute value of the scalar, and the size of a sum does not exceed the sum of the sizes. These requirements allow vectors to be compared by magnitude without requiring coordinates, angles, or an inner product.\n\nNorms connect linear algebra with mathematical analysis. A norm defines a distance and therefore notions of convergence, continuity, approximation, and completeness. Depending on the vector space, its elements may be finite coordinate lists, infinite sequences, functions, matrices, or linear operators. Choosing a norm determines which features of these objects are controlled: maximum error, average magnitude, energy, total variation in coefficients, or sensitivity to perturbations.\n\nDifferent norms can describe the same underlying vector space while producing different geometries. In finite dimensions, all norms yield the same topology, although their numerical values and associated optimization problems differ. In infinite dimensions, the choice can change which sequences converge, which operators are continuous, and whether the space is complete. These distinctions make norms central to functional analysis, differential equations, numerical computation, and optimization."
    },
    {
      "heading": "Definition and elementary consequences",
      "text": "Let \\(V\\) be a vector space over the real numbers or the complex numbers, denoted by \\(\\mathbb F\\). A norm is a function\n\n\\[\\|\\cdot\\|:V\\longrightarrow[0,\\infty)\\]\n\nsatisfying, for every \\(x,y\\in V\\) and every \\(\\alpha\\in\\mathbb F\\),\n\n\\[\\begin{aligned} \\|x\\|=0&\\quad\\Longleftrightarrow\\quad x=0,\\\\ \\|\\alpha x\\|&=|\\alpha|\\,\\|x\\|,\\\\ \\|x+y\\|&\\leq \\|x\\|+\\|y\\|. \\end{aligned}\\]\n\nThese properties are called positive definiteness, absolute homogeneity, and the triangle inequality. A vector space equipped with a specified norm is a normed vector space. The double-bar notation distinguishes a norm from scalar absolute value, although the two notions coincide on the one-dimensional scalar space with its usual norm.\n\nAbsolute homogeneity implies \\(\\|-x\\|=\\|x\\|\\), so a vector and its negative have the same size. Combining the triangle inequality with \\(x=(x-y)+y\\) gives the reverse triangle inequality:\n\n\\[\\bigl|\\|x\\|-\\|y\\|\\bigr|\\leq \\|x-y\\|.\\]\n\nThus, if two vectors are close in norm, their norms are close as real numbers. This estimate is often more useful than the defining triangle inequality when passing to limits or establishing error bounds.\n\nFor any finite collection of vectors and scalars,\n\n\\[\\left\\|\\sum_{j=1}^{m}\\alpha_jx_j\\right\\| \\leq \\sum_{j=1}^{m}|\\alpha_j|\\,\\|x_j\\|.\\]\n\nA norm is consequently a convex function: for \\(0\\leq t\\leq1\\),\n\n\\[\\|tx+(1-t)y\\|\\leq t\\|x\\|+(1-t)\\|y\\|.\\]\n\nConvexity is weaker than the full set of norm axioms. For example, the squared Euclidean length is convex but is not a norm, because scaling by \\(\\alpha\\) multiplies it by \\(|\\alpha|^2\\), rather than by \\(|\\alpha|\\).\n\nA norm determines a distance by\n\n\\[d(x,y)=\\|x-y\\|.\\]\n\nThis turns \\(V\\) into a metric space. Its distance is translation invariant, since \\(d(x+z,y+z)=d(x,y)\\), and scales linearly under scalar multiplication. Not every metric on a vector space comes from a norm. For example,\n\n\\[d(x,y)=\\min\\{1,\\|x-y\\|\\}\\]\n\nis a metric with the same convergent sequences as the original norm metric, but it lacks the required scaling law.\n\nThe term “norm” also occurs in algebra, including norms of field extensions. Such constructions have different defining properties and should not be identified with vector-space norms merely because they share a name."
    },
    {
      "heading": "Coordinate norms and their inequalities",
      "text": "For \\(x=(x_1,\\ldots,x_n)\\in\\mathbb F^n\\) and a real exponent \\(1\\leq p<\\infty\\), the standard \\(p\\)-norm is\n\n\\[\\|x\\|_p=\\left(\\sum_{j=1}^{n}|x_j|^p\\right)^{1/p}.\\]\n\nThe limiting case is\n\n\\[\\|x\\|_\\infty=\\max_{1\\leq j\\leq n}|x_j|.\\]\n\nThe most frequently used choices are \\(p=1\\), \\(p=2\\), and \\(p=\\infty\\). They measure, respectively, total absolute coordinate magnitude, Euclidean length, and the largest absolute coordinate.\n\nFor the vector \\(x=(3,4)\\), these give\n\n\\[\\|x\\|_1=7,\\qquad \\|x\\|_2=5,\\qquad \\|x\\|_\\infty=4.\\]\n\nThe value \\(5\\) follows from the Pythagorean theorem. The other values are not approximations to Euclidean length: they are exact measurements under different definitions of size. The associated distances are useful when travel is constrained to coordinate directions, when errors accumulate across coordinates, or when a bound must hold for every coordinate individually.\n\nThe triangle inequality for general \\(p\\)-norms is Minkowski’s inequality. A closely related result, Hölder’s inequality, states that\n\n\\[\\sum_{j=1}^{n}|x_jy_j| \\leq \\|x\\|_p\\|y\\|_q, \\qquad \\frac1p+\\frac1q=1,\\]\n\nwhere \\(p=1,q=\\infty\\) and the reversed endpoint convention are included. When \\(p=q=2\\), this becomes the familiar Cauchy–Schwarz inequality. These inequalities explain why the range \\(p\\geq1\\) is structurally important.\n\nFor \\(1\\leq p\\leq q\\leq\\infty\\),\n\n\\[\\|x\\|_q\\leq\\|x\\|_p \\leq n^{\\,1/p-1/q}\\|x\\|_q,\\]\n\nwith \\(1/\\infty=0\\). The dimension-dependent factor is sharp, as can be seen from vectors whose coordinates all have the same magnitude. A vector supported on a single coordinate shows that the first inequality can also be an equality. In particular,\n\n\\[\\|x\\|_\\infty\\leq\\|x\\|_2\\leq\\sqrt n\\,\\|x\\|_\\infty.\\]\n\nThe factor \\(\\sqrt n\\) matters when comparing error criteria across increasing dimensions.\n\nPositive coordinate weights produce further norms:\n\n\\[\\|x\\|_{p,w} =\\left(\\sum_{j=1}^{n}w_j|x_j|^p\\right)^{1/p}, \\qquad w_j>0.\\]\n\nWeights allow coordinates with different units or relative significance to be rescaled. If a weight is zero, positive definiteness fails on the full coordinate space.\n\nFor \\(0<p<1\\), the same formula does not define a norm when \\(n\\geq2\\). Taking \\(x=(1,0)\\) and \\(y=(0,1)\\) gives\n\n\\[\\|x+y\\|_p=2^{1/p}>2=\\|x\\|_p+\\|y\\|_p.\\]\n\nSuch expressions belong instead to the theory of quasi-norms."
    },
    {
      "heading": "Unit balls and convex geometry",
      "text": "The closed unit ball of a normed space is\n\n\\[B=\\{x\\in V:\\|x\\|\\leq1\\},\\]\n\nand its unit sphere is \\(\\{x:\\|x\\|=1\\}\\). An open ball of radius \\(r>0\\) centered at \\(a\\) is\n\n\\[B(a,r)=\\{x:\\|x-a\\|<r\\}.\\]\n\nTranslation and scaling therefore recover every ball from the unit ball. Conversely, the shape of the unit ball determines the norm completely.\n\nEvery norm unit ball is a convex set. It is also balanced: if \\(x\\in B\\) and \\(|\\alpha|\\leq1\\), then \\(\\alpha x\\in B\\). Over the real numbers, balancedness includes symmetry about the origin; over the complex numbers, it also includes invariance under multiplication by scalars of modulus one. The ball is absorbing, meaning that every vector lies in \\(tB\\) for some positive real number \\(t\\).\n\nIn a finite-dimensional real space, any compact convex set \\(K\\) that is symmetric about the origin and has the origin in its interior is the closed unit ball of a unique norm. The norm is recovered by the Minkowski functional:\n\n\\[p_K(x)=\\inf\\{t>0:x\\in tK\\}.\\]\n\nConvexity yields the triangle inequality, symmetry gives absolute homogeneity over real scalars, and boundedness together with an interior neighborhood yields positive definiteness. In complex spaces, the corresponding construction requires balancedness, not merely symmetry under negation.\n\nIn \\(\\mathbb R^2\\), the unit balls of the \\(1\\)-, \\(2\\)-, and \\(\\infty\\)-norms are a diamond, a disk, and an axis-aligned square. For \\(1<p<\\infty\\), the \\(p\\)-norm unit ball has no nontrivial line segment on its boundary. This property is called strict convexity. For the \\(1\\)- and \\(\\infty\\)-norms in dimensions at least two, boundary line segments are present, so strict convexity fails.\n\nThese shapes govern equality in the triangle inequality. In a strictly convex real normed space, equality\n\n\\[\\|x+y\\|=\\|x\\|+\\|y\\|\\]\n\nfor nonzero \\(x\\) and \\(y\\) forces them to be positive scalar multiples of one another. Without strict convexity, equality may hold in many additional directions. For instance, under the \\(1\\)-norm, the coordinate vectors \\((1,0)\\) and \\((0,1)\\) attain equality despite being linearly independent.\n\nStrict convexity also influences approximation. If a point has a nearest point in a convex subset of a strictly convex space, that nearest point is unique. Existence is a separate matter: it follows for nonempty closed subsets in finite dimensions, but requires additional hypotheses in infinite-dimensional settings."
    },
    {
      "heading": "Norms induced by inner products",
      "text": "An inner product determines a norm through\n\n\\[\\|x\\|=\\sqrt{\\langle x,x\\rangle}.\\]\n\nThe Cauchy–Schwarz inequality establishes the triangle inequality for this expression. Such norms have additional structure: they support angles, orthogonality, and the identities associated with Euclidean geometry. A norm alone does not generally provide these notions.\n\nThe standard inner product on \\(\\mathbb R^n\\) gives the Euclidean norm. On \\(\\mathbb C^n\\), the standard Hermitian inner product gives\n\n\\[\\|x\\|_2=\\left(\\sum_{j=1}^{n}|x_j|^2\\right)^{1/2}.\\]\n\nMore generally, if \\(A\\) is a real symmetric or complex Hermitian positive-definite matrix, then\n\n\\[\\|x\\|_A=\\sqrt{x^*Ax}\\]\n\nis an inner-product norm. Here \\(x^*\\) denotes the conjugate transpose. Its unit ball is an ellipsoid. The eigenvalues and eigenvectors of \\(A\\) determine the lengths and orientations of its principal axes.\n\nNot every norm arises this way. The exact criterion is the parallelogram law:\n\n\\[\\|x+y\\|^2+\\|x-y\\|^2 =2\\|x\\|^2+2\\|y\\|^2.\\]\n\nThe Jordan–von Neumann theorem states that a real or complex norm is induced by an inner product if and only if this identity holds for every pair of vectors. In the real case, the inner product is then recovered by polarization:\n\n\\[\\langle x,y\\rangle =\\frac14\\left(\\|x+y\\|^2-\\|x-y\\|^2\\right).\\]\n\nAn analogous identity using \\(x\\pm iy\\) recovers the imaginary part in the complex case.\n\nFor example, in \\(\\mathbb R^2\\) with the \\(1\\)-norm, let \\(x=(1,0)\\) and \\(y=(0,1)\\). Both \\(\\|x+y\\|_1\\) and \\(\\|x-y\\|_1\\) equal \\(2\\), so the left side of the parallelogram identity is \\(8\\), while the right side is \\(4\\). This norm therefore cannot come from any inner product.\n\nCompleteness adds another distinction. A complete inner-product space is a Hilbert space, whereas a complete normed space is a Banach space. Every Hilbert space is a Banach space under its induced norm, but many Banach spaces have norms incompatible with any inner product.\n\nInner-product geometry also gives a particularly strong approximation theory. In a Hilbert space, every nonempty closed convex set admits a unique nearest point to each vector. For a closed linear subspace, this nearest-point map is the orthogonal projection. General normed spaces need not have projections with the same existence, uniqueness, or linearity properties."
    },
    {
      "heading": "Topology, convergence, and equivalence of norms",
      "text": "A norm supplies a topology through its open balls. A sequence \\(x_k\\) converges to \\(x\\) precisely when\n\n\\[\\|x_k-x\\|\\longrightarrow0.\\]\n\nThe reverse triangle inequality makes the norm function itself continuous; more specifically, it is Lipschitz with constant one relative to its own metric. Addition and scalar multiplication are also continuous, so every normed space is a topological vector space.\n\nTwo norms \\(\\|\\cdot\\|_a\\) and \\(\\|\\cdot\\|_b\\) on the same vector space are called equivalent if there are constants \\(c,C>0\\) such that\n\n\\[c\\|x\\|_a\\leq\\|x\\|_b\\leq C\\|x\\|_a\\]\n\nfor all \\(x\\). Equivalent norms have the same open sets and convergent sequences. They also have the same Cauchy sequences, the same bounded subsets, and the same continuous linear maps. For norms, equality of the induced topologies is equivalent to the existence of these two-sided bounds, because continuity at zero can be extended to all vectors by homogeneity.\n\nEvery pair of norms on a finite-dimensional real or complex vector space is equivalent. One proof chooses a basis and compares an arbitrary norm with the Euclidean norm of the coordinates. The triangle inequality gives an upper bound. Continuity and compactness of the Euclidean unit sphere then give a strictly positive lower bound. The Heine–Borel theorem supplies the compactness needed for this argument.\n\nConsequently, finite-dimensional questions about convergence and continuity do not depend on the chosen norm. Numerical constants do depend on it, however. Equivalent norms can assign very different magnitudes to the same vector, and comparison constants can increase with dimension. Thus finite-dimensional equivalence does not justify ignoring norm choice in high-dimensional error bounds or computational complexity estimates.\n\nIn infinite dimensions, norms can fail to be equivalent. On the space \\(C[0,1]\\) of continuous functions, consider\n\n\\[\\|f\\|_\\infty=\\max_{0\\leq t\\leq1}|f(t)|, \\qquad \\|f\\|_1=\\int_0^1|f(t)|\\,dt.\\]\n\nAlthough \\(\\|f\\|_1\\leq\\|f\\|_\\infty\\), no positive constant gives the reverse inequality uniformly over all continuous functions. The sequence \\(f_n(t)=t^n\\) satisfies\n\n\\[\\|f_n\\|_\\infty=1,\\qquad \\|f_n\\|_1=\\frac1{n+1}\\longrightarrow0.\\]\n\nThus it converges to zero in the integral norm but not in the uniform norm. Narrow peaks provide the same phenomenon: their total area may approach zero while their maximum height remains fixed."
    },
    {
      "heading": "Infinite-dimensional norms and completeness",
      "text": "Sequence and function spaces provide the principal infinite-dimensional examples. For \\(1\\leq p<\\infty\\), the sequence space \\(\\ell^p\\) consists of scalar sequences \\(x=(x_j)_{j\\geq1}\\) satisfying\n\n\\[\\sum_{j=1}^{\\infty}|x_j|^p<\\infty,\\]\n\nwith norm\n\n\\[\\|x\\|_p=\\left(\\sum_{j=1}^{\\infty}|x_j|^p\\right)^{1/p}.\\]\n\nThe space \\(\\ell^\\infty\\) consists of bounded sequences with the supremum norm. Unlike finite coordinate spaces, these spaces do not all contain the same vectors: for example, \\((1/j)_{j\\geq1}\\) belongs to \\(\\ell^2\\) but not to \\(\\ell^1\\).\n\nOn a measure space \\((X,\\Sigma,\\mu)\\), the corresponding L^p spaces use the Lebesgue integral:\n\n\\[\\|f\\|_p=\\left(\\int_X|f|^p\\,d\\mu\\right)^{1/p}, \\qquad 1\\leq p<\\infty.\\]\n\nFor \\(p=\\infty\\), the norm is the essential supremum, which disregards exceptional sets of measure zero. Functions equal almost everywhere are identified. Without this identification, a nonzero function supported on a null set could have zero size, contradicting positive definiteness.\n\nA Cauchy sequence in a normed space satisfies\n\n\\[\\|x_m-x_n\\|\\longrightarrow0 \\quad\\text{as }m,n\\longrightarrow\\infty.\\]\n\nIf every such sequence converges to an element of the space, the space is complete and is called a Banach space. The spaces \\(\\ell^p\\) and \\(L^p\\), for \\(1\\leq p\\leq\\infty\\), are Banach spaces. So is \\(C[0,1]\\) with the supremum norm: a uniformly Cauchy sequence of continuous functions has a continuous uniform limit.\n\nCompleteness depends on both the underlying collection and its norm. The space of finite-support sequences is not complete in the \\(\\ell^2\\) norm; truncations of an infinite square-summable sequence form a Cauchy sequence whose limit has infinitely many nonzero coordinates. Its completion is \\(\\ell^2\\). Similarly, \\(C[0,1]\\) is not complete under the integral \\(1\\)-norm, and its completion can be identified with \\(L^1[0,1]\\).\n\nNorms can control derivatives as well as function values. A typical first-order Sobolev norm is\n\n\\[\\|u\\|_{W^{1,p}(\\Omega)} = \\left( \\|u\\|_{L^p(\\Omega)}^p+ \\sum_{j=1}^{d}\\|\\partial_j u\\|_{L^p(\\Omega)}^p \\right)^{1/p},\\]\n\nfor \\(1\\leq p<\\infty\\), where derivatives are understood weakly. Such norms measure regularity and are fundamental in the study of partial differential equations. They distinguish functions that may be close in total magnitude but have very different oscillations or rates of variation."
    },
    {
      "heading": "Operator norms and dual norms",
      "text": "Given normed spaces \\(X\\) and \\(Y\\), a linear map \\(T:X\\to Y\\) is bounded if some \\(M\\geq0\\) satisfies\n\n\\[\\|Tx\\|_Y\\leq M\\|x\\|_X\\]\n\nfor every \\(x\\in X\\). Its operator norm is\n\n\\[\\|T\\| =\\sup_{x\\ne0}\\frac{\\|Tx\\|_Y}{\\|x\\|_X} =\\sup_{\\|x\\|_X\\leq1}\\|Tx\\|_Y.\\]\n\nThis is the smallest admissible bound \\(M\\). For a linear map between normed spaces, boundedness is equivalent to continuity, and continuity at zero already suffices.\n\nOperator norms quantify the largest amplification of an input. They satisfy\n\n\\[\\|ST\\|\\leq\\|S\\|\\,\\|T\\|\\]\n\nwhenever the composition is defined. For a matrix acting between coordinate spaces with the same chosen \\(p\\)-norm, the induced matrix norms include\n\n\\[\\|A\\|_1=\\max_j\\sum_i|a_{ij}|, \\qquad \\|A\\|_\\infty=\\max_i\\sum_j|a_{ij}|.\\]\n\nThe induced \\(2\\)-norm is the largest singular value:\n\n\\[\\|A\\|_2=\\sigma_{\\max}(A).\\]\n\nThis connects norm estimates with the singular value decomposition.\n\nA matrix can also be treated simply as a vector of entries. The Frobenius norm,\n\n\\[\\|A\\|_{\\mathrm F} =\\left(\\sum_{i,j}|a_{ij}|^2\\right)^{1/2},\\]\n\narises this way. It differs from the induced \\(2\\)-norm and equals the square root of the sum of squared singular values. For the \\(n\\times n\\) identity matrix, the induced \\(2\\)-norm is \\(1\\), while the Frobenius norm is \\(\\sqrt n\\).\n\nThe continuous dual space \\(X^*\\) consists of continuous scalar-valued linear functionals. Its norm is\n\n\\[\\|f\\|_*=\\sup_{\\|x\\|\\leq1}|f(x)|.\\]\n\nUnder the standard coordinate pairing, the dual of a finite-dimensional \\(p\\)-norm is the \\(q\\)-norm with \\(1/p+1/q=1\\). Thus the \\(1\\)- and \\(\\infty\\)-norms are dual to one another, while the Euclidean norm is self-dual.\n\nThe Hahn–Banach theorem supplies a deeper relation:\n\n\\[\\|x\\|=\\sup_{\\|f\\|_*\\leq1}|f(x)|.\\]\n\nFor every nonzero \\(x\\), a norm-one functional attains this value at \\(x\\), after a suitable normalization of its phase in the complex case. This expresses a vector’s size entirely through scalar measurements and explains why duality is so effective in optimization and functional analysis. The dual space is Banach under its operator norm even when the original normed space is incomplete."
    },
    {
      "heading": "Seminorms, quotient norms, and related constructions",
      "text": "A seminorm satisfies nonnegativity, absolute homogeneity, and the triangle inequality, but may vanish on nonzero vectors. Its zero set\n\n\\[N=\\{x:p(x)=0\\}\\]\n\nis a linear subspace. Seminorms occur naturally when a measurement deliberately ignores some features. For example, on differentiable functions,\n\n\\[p(f)=\\sup_{t\\in[0,1]}|f'(t)|\\]\n\nis a seminorm on \\(C^1[0,1]\\): every constant function has value zero.\n\nA seminorm becomes a norm on the quotient vector space \\(V/N\\) by setting\n\n\\[\\|x+N\\|=p(x).\\]\n\nThe expression is independent of the representative because adding a vector in \\(N\\) does not change the seminorm. This construction treats vectors as equivalent when the measurement cannot distinguish them. The passage from measurable functions to almost-everywhere equivalence classes in \\(L^p\\) is an important instance.\n\nA different quotient construction starts with a normed space \\(V\\) and a linear subspace \\(M\\). Define\n\n\\[\\|x+M\\|_{V/M} =\\inf_{m\\in M}\\|x+m\\|.\\]\n\nThis is always a seminorm on the quotient and is a norm precisely when \\(M\\) is closed. If \\(M\\) is not closed, a vector in its closure but outside \\(M\\) represents a nonzero coset with zero quotient size. When \\(V\\) is Banach and \\(M\\) is closed, the quotient is also Banach. The infimum need not be achieved by any representative.\n\nNorms can also be combined on product spaces. If \\(X\\) and \\(Y\\) are normed, then\n\n\\[\\|(x,y)\\|=\\|x\\|_X+\\|y\\|_Y\\]\n\nand\n\n\\[\\|(x,y)\\|=\\max\\{\\|x\\|_X,\\|y\\|_Y\\}\\]\n\nare norms on \\(X\\times Y\\). More generally, a finite \\(p\\)-sum combines the component norms by the usual \\(p\\)-norm formula. For finitely many components these choices are equivalent, although their unit balls differ.\n\nA quasi-norm relaxes the triangle inequality to\n\n\\[\\|x+y\\|\\leq C(\\|x\\|+\\|y\\|)\\]\n\nfor a fixed \\(C\\geq1\\), while retaining positive definiteness and absolute homogeneity. For \\(0<p<1\\), the usual \\(L^p\\) expression is a quasi-norm and satisfies\n\n\\[\\|f+g\\|_p^p\\leq\\|f\\|_p^p+\\|g\\|_p^p.\\]\n\nThese spaces remain important but lack some geometric properties of normed spaces, including convexity of their unit balls.\n\nThe quantity commonly called the “\\(\\ell^0\\) norm” counts nonzero coordinates. It is not a norm: multiplication by any nonzero scalar leaves the count unchanged, violating absolute homogeneity."
    },
    {
      "heading": "Optimization, approximation, and numerical computation",
      "text": "Norms serve as objective functions, constraints, and error measures in optimization. A problem of the form\n\n\\[\\min_x\\|Ax-b\\|\\]\n\nseeks a vector whose image approximates the data \\(b\\). The selected norm determines what “best” means. The \\(1\\)-norm minimizes total absolute residual, the \\(2\\)-norm minimizes Euclidean residual magnitude, and the \\(\\infty\\)-norm minimizes the largest absolute residual.\n\nMinimizing the squared \\(2\\)-norm gives least squares:\n\n\\[\\min_x\\|Ax-b\\|_2^2.\\]\n\nFor real matrices, differentiating yields the normal equations\n\n\\[A^{\\mathsf T}Ax=A^{\\mathsf T}b.\\]\n\nSquaring preserves minimizers because \\(t\\mapsto t^2\\) is increasing for \\(t\\geq0\\). The squared norm is differentiable everywhere, whereas the Euclidean norm itself is not differentiable at zero. If \\(A\\) has full column rank, the least-squares minimizer is unique.\n\nNorm penalties are central to regularization. Ridge regression uses a squared Euclidean penalty,\n\n\\[\\min_\\beta \\|X\\beta-y\\|_2^2+\\lambda\\|\\beta\\|_2^2,\\]\n\nwhile lasso regression uses\n\n\\[\\min_\\beta \\|X\\beta-y\\|_2^2+\\lambda\\|\\beta\\|_1.\\]\n\nThe corners of the \\(1\\)-norm ball help explain why lasso solutions can have exactly zero coordinates. The effect depends on the interaction between the objective’s level sets and the constraint geometry; it is not simply a consequence of the \\(1\\)-norm assigning larger values than the \\(2\\)-norm.\n\nDual norms describe worst-case linear effects. Under the standard real coordinate pairing,\n\n\\[\\sup_{\\|\\delta\\|\\leq\\varepsilon}g^{\\mathsf T}\\delta =\\varepsilon\\|g\\|_*.\\]\n\nThus a bound on perturbations in one norm produces a sensitivity bound in its dual norm. This identity is used in robust optimization and in first-order estimates of how an objective changes under a small input displacement.\n\nIn numerical linear algebra, norms quantify residuals, forward errors, and backward errors. For an invertible square matrix,\n\n\\[\\kappa(A)=\\|A\\|\\,\\|A^{-1}\\|\\]\n\nis the normwise condition number, using a compatible induced norm. If \\(Ax=b\\) and \\(A\\widehat x=b+\\delta b\\), then\n\n\\[\\frac{\\|\\widehat x-x\\|}{\\|x\\|} \\leq \\kappa(A)\\frac{\\|\\delta b\\|}{\\|b\\|},\\]\n\nfor nonzero \\(b\\). A small residual therefore need not imply a small solution error when the matrix is ill-conditioned.\n\nActual norm evaluation also requires care in floating-point arithmetic. Directly summing \\(x_j^2\\) can overflow or underflow even when the final Euclidean norm is representable. Stable implementations rescale intermediate quantities, separating the overall magnitude from a sum of normalized squares."
    },
    {
      "heading": "Historical development and structural limits",
      "text": "The concept of norm emerged from efforts to extend geometric and analytic reasoning beyond finite coordinate spaces. Nineteenth-century analysis increasingly treated functions and sequences as objects in their own right, while integral equations and infinite systems required precise meanings for size and convergence. The modern abstraction separated those measurements from any particular formula or coordinate representation.\n\nMaurice Fréchet’s 1906 work on abstract spaces helped establish the metric-space approach, in which distance is specified axiomatically. Normed spaces add linear structure and compatibility with scaling. In 1922, Stefan Banach published foundational work on operations in abstract spaces; his 1932 book Théorie des opérations linéaires organized much of the theory of complete normed spaces and bounded linear operators. These developments established Banach spaces as a general setting for analysis rather than a collection of unrelated function-space examples.\n\nInner-product spaces formed a related but more restrictive branch. Work associated with David Hilbert on integral equations made infinite-dimensional analogues of Euclidean geometry central to analysis. In 1935, Pascual Jordan and John von Neumann characterized inner-product norms through the parallelogram law. Their result precisely identified which norm geometries admit a compatible inner product.\n\nThe distinction between normed and more general topological vector spaces became equally important. A Hausdorff locally convex topological vector space is normable exactly when it has a bounded neighborhood of zero, where boundedness is understood in the topological-vector-space sense. Many useful spaces instead require families of seminorms. For example, the standard topology on \\(C^\\infty[0,1]\\) is generated by\n\n\\[p_k(f)=\\max_{0\\leq j\\leq k}\\sup_{t\\in[0,1]}|f^{(j)}(t)|, \\qquad k=0,1,2,\\ldots.\\]\n\nIt controls every derivative separately and cannot be represented by a single norm inducing that topology.\n\nInfinite-dimensional norm geometry also imposes limits that have no finite-dimensional counterpart. The closed unit ball of an infinite-dimensional normed space is never compact in the norm topology. Consequently, bounded sequences need not contain norm-convergent subsequences. In \\(\\ell^2\\), the standard coordinate vectors \\(e_n\\) all have norm one, but\n\n\\[\\|e_n-e_m\\|_2=\\sqrt2 \\qquad(n\\ne m),\\]\n\nso no subsequence can converge in norm.\n\nWeaker notions of convergence partly compensate for this loss. A sequence converges weakly when every continuous linear functional converges on it. The vectors \\(e_n\\) converge weakly to zero in \\(\\ell^2\\), despite having constant norm one. Norm convergence always implies weak convergence, but the reverse implication fails in general. This separation underlies compactness methods in functional analysis and explains why infinite-dimensional existence proofs often use a topology weaker than the one directly defined by the norm."
    }
  ],
  "links": [
    "vector-space",
    "absolute-value",
    "euclidean-space",
    "linear-algebra",
    "mathematical-analysis",
    "functional-analysis",
    "real-number",
    "complex-number",
    "triangle-inequality",
    "normed-vector-space",
    "convex-function",
    "metric-space",
    "pythagorean-theorem",
    "minkowski-inequality",
    "holders-inequality",
    "cauchy-schwarz-inequality",
    "open-ball",
    "convex-set",
    "inner-product",
    "positive-definite-matrix",
    "conjugate-transpose",
    "parallelogram-law",
    "hilbert-space",
    "orthogonal-projection",
    "topology",
    "basis-linear-algebra",
    "heine-borel-theorem",
    "lp-space",
    "lebesgue-integral",
    "almost-everywhere",
    "cauchy-sequence",
    "banach-space",
    "sobolev-space",
    "linear-map",
    "matrix",
    "singular-value-decomposition",
    "dual-space",
    "hahn-banach-theorem",
    "quotient-vector-space",
    "mathematical-optimization",
    "least-squares",
    "regularization",
    "ridge-regression",
    "lasso-regression",
    "condition-number",
    "floating-point-arithmetic",
    "david-hilbert",
    "john-von-neumann"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}