{
  "id": "orthogonality",
  "title": "Orthogonality",
  "lang": "en",
  "source_lang": "en",
  "summary": "Orthogonality generalizes perpendicularity through inner products, enabling geometric decomposition, function expansions, statistical estimation, and stable numerical computation.",
  "category": "mathematics",
  "subcategory": "geometry",
  "type": "concept",
  "aliases": [
    "Perpendicularity in inner-product spaces"
  ],
  "generated_at": "2026-11-03",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/orthogonality/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/orthogonality/",
      "json": "https://aiwiki.page/zh/orthogonality.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "Orthogonality is a mathematical relation that generalizes the perpendicularity of lines and vectors. In its standard formulation, two elements of a vector space are orthogonal when their inner product is zero. This definition applies not only to arrows in ordinary space but also to matrices, functions, random variables, and quantum states. Its importance lies in the way it separates components: orthogonal components contribute independently to squared length, allowing complicated objects to be decomposed, measured, and approximated systematically.\n\nOrthogonality connects geometry, linear algebra, and analysis. It underlies coordinate systems, least-squares fitting, Fourier expansions, spectral methods, and many numerical algorithms. The precise meaning depends on the surrounding structure: changing an inner product can change which vectors are orthogonal, and extensions to indefinite forms or non-Euclidean settings require qualifications that are unnecessary in ordinary Euclidean geometry."
    },
    {
      "heading": "Inner products and the generalization of perpendicularity",
      "text": "In Euclidean space \\(\\mathbb R^n\\), vectors \\(x=(x_1,\\ldots,x_n)\\) and \\(y=(y_1,\\ldots,y_n)\\) are orthogonal if their dot product vanishes:\n\n\\[x\\cdot y=\\sum_{j=1}^{n}x_jy_j=0.\\]\n\nFor nonzero vectors, the identity\n\n\\[x\\cdot y=\\|x\\|\\|y\\|\\cos\\theta\\]\n\nmakes this equivalent to an angle of \\(90^\\circ\\). For example, \\((1,2)\\) and \\((2,-1)\\) are orthogonal because \\(2-2=0\\). The zero vector is orthogonal to every vector, although an angle involving the zero vector is undefined. Thus the algebraic relation extends perpendicularity beyond the cases in which an angle can be drawn.\n\nAn inner product abstracts the properties responsible for this geometry. Over the real numbers it is a symmetric, positive-definite bilinear form. Over the complex numbers it is conjugate symmetric and sesquilinear. Using the convention that the first argument is linear,\n\n\\[\\langle x,y\\rangle=\\overline{\\langle y,x\\rangle}, \\qquad \\langle x,x\\rangle>0\\quad\\text{if }x\\ne0.\\]\n\nThe associated norm is \\(\\|x\\|=\\sqrt{\\langle x,x\\rangle}\\), and orthogonality is written \\(x\\perp y\\). Some literature instead makes the second argument linear; formulas for coefficients must then be adjusted by complex conjugation, but the relation of orthogonality is unchanged.\n\nA decisive consequence is the Pythagorean theorem:\n\n\\[x\\perp y \\quad\\Longrightarrow\\quad \\|x+y\\|^2=\\|x\\|^2+\\|y\\|^2.\\]\n\nFor a finite family of pairwise orthogonal vectors, the squared norm of their sum is the sum of their squared norms. In real inner-product spaces, the displayed equality also implies orthogonality. In complex spaces, it establishes only \\(\\operatorname{Re}\\langle x,y\\rangle=0\\); an additional condition, such as the analogous equality for \\(x+iy\\), is needed to force the imaginary part to vanish. This distinction matters because complex orthogonality contains more information than a single real length identity.\n\nOrthogonality is relative to the chosen inner product, not solely to the underlying coordinates. If \\(G\\) is a real symmetric positive-definite matrix, then\n\n\\[\\langle x,y\\rangle_G=x^{\\mathsf T}Gy\\]\n\ndefines another inner product. With \\(G=\\operatorname{diag}(1,4)\\), the vectors \\((1,1)\\) and \\((4,-1)\\) are orthogonal in this weighted geometry, although their ordinary dot product is \\(3\\). Such weights represent unequal coordinate scales, material properties, or statistical precision.\n\nNot every norm arises from an inner product. The exact criterion is the parallelogram identity,\n\n\\[\\|x+y\\|^2+\\|x-y\\|^2 =2\\|x\\|^2+2\\|y\\|^2.\\]\n\nWhen this identity holds, polarization reconstructs an inner product from the norm. More general normed spaces admit other notions of orthogonality, but these need not be symmetric or share the familiar projection properties. Positive definiteness and inner-product structure are therefore substantive assumptions, rather than incidental notation."
    },
    {
      "heading": "Orthogonal complements and nearest-point projections",
      "text": "For a subset \\(S\\) of an inner-product space \\(H\\), its orthogonal complement is\n\n\\[S^\\perp=\\{x\\in H:\\langle x,s\\rangle=0 \\text{ for every }s\\in S\\}.\\]\n\nThis is a linear subspace, even if \\(S\\) itself is not. It depends only on the linear span of \\(S\\), and, in a Hilbert space, only on the closure of that span. In an \\(n\\)-dimensional space, every subspace \\(M\\) satisfies\n\n\\[\\dim M+\\dim M^\\perp=n, \\qquad H=M\\oplus M^\\perp.\\]\n\nThe direct sum means that each vector has a unique decomposition into one component in \\(M\\) and another perpendicular to \\(M\\).\n\nThe component in \\(M\\) is the orthogonal projection \\(P_Mx\\). Its defining condition is\n\n\\[P_Mx\\in M, \\qquad x-P_Mx\\in M^\\perp.\\]\n\nIt is also the unique point of \\(M\\) nearest to \\(x\\). Indeed, for any \\(m\\in M\\), orthogonality gives\n\n\\[\\|x-m\\|^2 = \\|x-P_Mx\\|^2+\\|P_Mx-m\\|^2.\\]\n\nThe second term cannot be negative and vanishes only when \\(m=P_Mx\\). The geometric problem of finding a nearest point is thus equivalent to making a residual orthogonal to all admissible directions.\n\nIn a Hilbert space, which is an inner-product space complete in its induced norm, this projection theorem holds for every closed linear subspace. Closedness cannot be omitted. In the space of square-integrable functions on \\([0,1]\\), polynomials form a dense but nonclosed subspace. A function outside that polynomial subspace can be approximated arbitrarily well in squared-integral error without having a nearest polynomial. The relevant identities are\n\n\\[(M^\\perp)^\\perp=\\overline M, \\qquad H=\\overline M\\oplus M^\\perp.\\]\n\nThey explain why topological closure enters naturally when finite-dimensional geometry is extended to infinite dimensions.\n\nProjection operators satisfy\n\n\\[P_M^2=P_M,\\qquad P_M^*=P_M.\\]\n\nThe first property is idempotence; the second states that the operator is self-adjoint. Together they characterize orthogonal projections among bounded operators on a Hilbert space. An idempotent operator alone may instead project along an oblique direction. Orthogonal projections have norm at most one, so they cannot increase distances, and their complementary projections are \\(I-P_M=P_{M^\\perp}\\).\n\nThese ideas organize the fundamental subspaces of a matrix. If \\(A\\) is a real \\(m\\times n\\) matrix, then\n\n\\[(\\operatorname{im}A)^\\perp=\\ker A^{\\mathsf T}, \\qquad (\\operatorname{im}A^{\\mathsf T})^\\perp=\\ker A.\\]\n\nConsequently, the equation \\(Ax=b\\) is solvable exactly when \\(b\\) is orthogonal to every vector in \\(\\ker A^{\\mathsf T}\\). When it is not solvable, projection onto the column space produces the closest attainable right-hand side. This is the geometric foundation of least squares, rather than merely a convenient interpretation of its algebraic equations."
    },
    {
      "heading": "Orthogonal systems, coordinates, and completeness",
      "text": "A family \\((e_j)\\) is orthonormal if\n\n\\[\\langle e_j,e_k\\rangle=\\delta_{jk},\\]\n\nwhere \\(\\delta_{jk}\\) equals one when \\(j=k\\) and zero otherwise. Orthogonal vectors need not have unit length; normalization turns each nonzero member into a unit vector. Every family of nonzero pairwise orthogonal vectors is linearly independent. Taking the inner product of a finite linear relation with each family member isolates its coefficient, because all cross terms vanish.\n\nAn orthonormal basis makes coordinates especially simple. In finite dimensions,\n\n\\[x=\\sum_{j=1}^{n}\\langle x,e_j\\rangle e_j.\\]\n\nEach coefficient is obtained independently by one inner product, without solving a simultaneous system. If an orthogonal basis \\((u_j)\\) has not been normalized, its corresponding coefficient is\n\n\\[\\frac{\\langle x,u_j\\rangle}{\\langle u_j,u_j\\rangle}.\\]\n\nThis denominator is essential: orthogonality eliminates interactions between basis vectors but does not itself make their lengths equal.\n\nThe Gram–Schmidt process constructs an orthonormal family from a linearly independent list \\(v_1,\\ldots,v_n\\). At the \\(k\\)-th step it removes the projections onto all previously constructed directions:\n\n\\[w_k=v_k-\\sum_{j<k}\\langle v_k,e_j\\rangle e_j, \\qquad e_k=\\frac{w_k}{\\|w_k\\|}.\\]\n\nLinear independence ensures \\(w_k\\ne0\\) in exact arithmetic. The construction preserves the span of every initial segment, so it is useful when a prescribed order has mathematical meaning—for example, when orthogonalizing \\(1,x,x^2,\\ldots\\) to obtain polynomials of successive degrees.\n\nFor an orthonormal sequence in a Hilbert space, finite projections yield Bessel’s inequality:\n\n\\[\\sum_j|\\langle x,e_j\\rangle|^2\\leq\\|x\\|^2.\\]\n\nThe difference between the two sides measures energy not captured by the chosen directions. If the closed linear span of the sequence is the whole space, then\n\n\\[x=\\sum_j\\langle x,e_j\\rangle e_j, \\qquad \\|x\\|^2=\\sum_j|\\langle x,e_j\\rangle|^2.\\]\n\nThe latter identity is Parseval’s identity, and the series converges in norm. An orthonormal sequence need not be complete: retaining only every second element of an orthonormal basis generally leaves an entire orthogonal subspace unrepresented.\n\nIn infinite dimensions, “basis” requires care. An orthonormal Hilbert-space basis provides convergent series expansions, whereas an algebraic basis represents vectors by finite linear combinations only. A separable Hilbert space has a countable orthonormal basis, but nonseparable spaces can require uncountable families. Even then, any particular vector has at most countably many nonzero coefficients. Orthogonality also gives a practical approximation rule: among all vectors in the span of \\(e_1,\\ldots,e_N\\), the truncated expansion is the unique best approximation in norm, and its squared error is exactly the omitted squared-coefficient sum when the full system is complete."
    },
    {
      "heading": "Orthogonal transformations and spectral structure",
      "text": "A real square matrix \\(Q\\) is an orthogonal matrix if\n\n\\[Q^{\\mathsf T}Q=I.\\]\n\nIts columns form an orthonormal basis, and \\(Q^{-1}=Q^{\\mathsf T}\\). Such matrices preserve inner products:\n\n\\[(Qx)^{\\mathsf T}(Qy)=x^{\\mathsf T}y.\\]\n\nThey therefore preserve lengths, angles, and orthogonality itself. The complex analogue is a unitary matrix, satisfying \\(U^*U=I\\), where \\(U^*\\) is the conjugate transpose. A rectangular matrix with orthonormal columns preserves lengths on its input space but is not an invertible orthogonal matrix unless it is square.\n\nRotations and reflections are the principal geometric examples. In two dimensions,\n\n\\[Q(\\theta)= \\begin{pmatrix} \\cos\\theta&-\\sin\\theta\\\\ \\sin\\theta&\\cos\\theta \\end{pmatrix}\\]\n\nrotates vectors through \\(\\theta\\). A reflection across the hyperplane perpendicular to a unit vector \\(u\\) has matrix\n\n\\[H=I-2uu^{\\mathsf T}.\\]\n\nEvery real orthogonal matrix has determinant \\(+1\\) or \\(-1\\). The determinant records whether orientation is preserved or reversed; its absolute value of one also means that Euclidean volume is preserved. Orthogonal matrices form the group \\(O(n)\\), and those with determinant \\(+1\\) form \\(SO(n)\\).\n\nOrthogonality is central to the spectral theorem. If \\(A\\) is real symmetric, eigenvectors belonging to distinct eigenvalues are orthogonal. For \\(Ax=\\lambda x\\) and \\(Ay=\\mu y\\), symmetry gives\n\n\\[\\lambda\\langle x,y\\rangle =\\langle Ax,y\\rangle =\\langle x,Ay\\rangle =\\mu\\langle x,y\\rangle.\\]\n\nThus \\(\\lambda\\ne\\mu\\) forces \\(\\langle x,y\\rangle=0\\). Within a repeated eigenspace, eigenvectors are not automatically orthogonal, but an orthonormal basis can be chosen there. Altogether,\n\n\\[A=Q\\Lambda Q^{\\mathsf T},\\]\n\nwith \\(Q\\) orthogonal and \\(\\Lambda\\) real diagonal. Hermitian matrices admit the corresponding unitary decomposition.\n\nFor a general matrix, the singular value decomposition\n\n\\[A=U\\Sigma V^*\\]\n\nprovides orthonormal input and output directions. If \\(v_j\\) and \\(u_j\\) are corresponding singular vectors, then \\(Av_j=\\sigma_j u_j\\). The transformation can therefore be understood as an orthogonal or unitary coordinate change, independent stretching along perpendicular directions, and another coordinate change. This interpretation supports low-rank approximation and the diagnosis of poorly determined directions in inverse problems.\n\nOrthogonality also defines coordinates for matrices themselves. The Frobenius inner product is\n\n\\[\\langle A,B\\rangle_F=\\operatorname{tr}(B^*A).\\]\n\nThus matrices can be orthogonal as vectors in a matrix space without either being an orthogonal matrix. For instance, the elementary matrices with a single entry equal to one form an orthonormal basis under this inner product. Distinguishing “an orthogonal matrix” from “two orthogonal matrices viewed as vectors” prevents a common ambiguity between a transformation property and a relation between objects."
    },
    {
      "heading": "Orthogonal functions, Fourier analysis, and differential equations",
      "text": "Functions become geometric objects when equipped with an inner product. A standard example is\n\n\\[\\langle f,g\\rangle =\\int_a^b f(x)\\overline{g(x)}\\,w(x)\\,dx,\\]\n\nwhere \\(w\\) is a positive weight almost everywhere. Functions differing only on a set of measure zero represent the same element of the resulting \\(L^2\\) space. Orthogonality means that the weighted integral of their product vanishes, not that the functions have disjoint graphs or never take nonzero values simultaneously. Positive and negative, or complex-phase, contributions may cancel across the interval.\n\nOn \\([-\\pi,\\pi]\\), the functions\n\n\\[e_n(x)=\\frac{e^{inx}}{\\sqrt{2\\pi}}, \\qquad n\\in\\mathbb Z,\\]\n\nform an orthonormal basis of complex \\(L^2\\). Their orthogonality follows from integrating \\(e^{i(n-m)x}\\): the integral is zero for different integer frequencies and \\(2\\pi\\) for equal frequencies. A Fourier series is therefore an orthogonal-coordinate expansion. Its squared coefficients sum to the squared \\(L^2\\) norm. This norm convergence does not, by itself, imply pointwise or uniform convergence; those are distinct questions requiring additional results or hypotheses.\n\nOrthogonal polynomials arise by applying Gram–Schmidt to powers of \\(x\\) with an appropriate weight. Legendre, Chebyshev, Hermite, and Laguerre polynomials use different intervals and weights. Legendre polynomials are orthogonal on \\([-1,1]\\) with weight one; Chebyshev polynomials of the first kind use weight \\((1-x^2)^{-1/2}\\). For example, the first three Legendre polynomials are\n\n\\[P_0(x)=1,\\qquad P_1(x)=x,\\qquad P_2(x)=\\frac{3x^2-1}{2},\\]\n\nand\n\n\\[\\int_{-1}^{1}P_n(x)P_m(x)\\,dx =\\frac{2}{2n+1}\\delta_{nm}.\\]\n\nThese systems are important in polynomial approximation and quadrature because their coefficients and error decompositions inherit orthogonal geometry.\n\nA major source of orthogonal function systems is Sturm–Liouville theory. A regular problem has the form\n\n\\[-\\frac{d}{dx}\\left(p(x)y'(x)\\right)+q(x)y(x) =\\lambda w(x)y(x),\\]\n\nwith suitable boundary conditions. Multiplying equations for two eigenfunctions by the other function, subtracting, and integrating by parts gives\n\n\\[(\\lambda_m-\\lambda_n) \\int_a^b w(x)y_m(x)y_n(x)\\,dx=0\\]\n\nwhen the boundary term vanishes. Distinct eigenvalues therefore produce orthogonal eigenfunctions. The boundary conditions are indispensable: the differential expression alone does not guarantee a self-adjoint problem or orthogonality.\n\nThese methods connect directly to mathematical physics. In the heat equation on a finite interval with fixed zero endpoint temperatures, sine functions provide orthogonal spatial modes, each decaying at a rate determined by its eigenvalue. For the wave equation, analogous modes oscillate at characteristic frequencies. Joseph Fourier developed trigonometric expansions in his study of heat, presented in his 1822 Théorie analytique de la chaleur. Their later rigorous treatment helped motivate function-space geometry and the Hilbert-space framework developed around the beginning of the twentieth century."
    },
    {
      "heading": "Numerical orthogonality and stable computation",
      "text": "Orthogonality is valuable computationally because orthogonal transformations preserve the Euclidean norm. In that norm, an orthogonal matrix has condition number one. Applying it does not intrinsically amplify perturbations in a vector, unlike multiplication by an ill-conditioned change-of-basis matrix. This does not mean that every algorithm using orthogonal matrices is automatically accurate: errors in forming the transformations, rounding, and the conditioning of the original problem still matter. Nevertheless, orthogonal operations provide a particularly reliable foundation for numerical linear algebra.\n\nA central example is the QR decomposition,\n\n\\[A=QR,\\]\n\nwhere \\(Q\\) has orthonormal columns and \\(R\\) is upper triangular. For a full-column-rank matrix, minimizing \\(\\|Ax-b\\|_2\\) reduces to solving\n\n\\[Rx=Q^{\\mathsf T}b.\\]\n\nThe component \\(QQ^{\\mathsf T}b\\) lies in the column space, while \\(b-QQ^{\\mathsf T}b\\) is orthogonal to it. QR thus implements the projection geometry of least squares without explicitly forming \\(A^{\\mathsf T}A\\). This is significant because, for a full-column-rank matrix,\n\n\\[\\kappa_2(A^{\\mathsf T}A)=\\kappa_2(A)^2.\\]\n\nForming the normal equations can therefore make a difficult problem substantially more sensitive numerically.\n\nDifferent orthogonalization procedures behave differently in floating-point arithmetic. Classical Gram–Schmidt computes projection coefficients against the original current vector before subtraction; cancellation can cause substantial loss of orthogonality when the columns are nearly dependent. Modified Gram–Schmidt updates the vector after each subtraction and often performs better. Reorthogonalization repeats the removal of already represented components, reducing residual contamination. These distinctions disappear in exact arithmetic but become important when the surviving component is small relative to the quantities being subtracted.\n\nHouseholder transformations construct reflections that annihilate selected vector components. Products of these reflections yield a numerically stable QR factorization, commonly with the orthogonal factor stored implicitly rather than as a dense matrix. Plane rotations provide another method, eliminating one component at a time and proving useful for structured updates. Orthogonal transformations also underlie the QR algorithm for eigenvalue computation and reductions of symmetric matrices to tridiagonal form.\n\nIn large iterative calculations, maintaining an orthogonal family can dominate the cost. Methods that build successive search or approximation spaces repeatedly project new vectors against existing directions. Rounding errors can reintroduce components that should have vanished, causing duplicated spectral information or degraded convergence. A useful diagnostic is the deviation of the computed Gram matrix from the identity:\n\n\\[\\|Q^{\\mathsf T}Q-I\\|.\\]\n\nIts magnitude measures loss of orthonormality in a chosen matrix norm. Acceptable tolerances depend on precision, dimensions, conditioning, and the task; exact symbolic orthogonality and numerical orthogonality are related but operationally different concepts."
    },
    {
      "heading": "Probability, regression, and experimental design",
      "text": "Square-integrable random variables form an inner-product space with\n\n\\[\\langle X,Y\\rangle=\\mathbb E[X\\overline Y].\\]\n\nFor real variables, orthogonality means \\(\\mathbb E[XY]=0\\). It is not generally the same as zero covariance, since\n\n\\[\\operatorname{Cov}(X,Y) =\\mathbb E[XY]-\\mathbb E[X]\\mathbb E[Y].\\]\n\nThe two conditions coincide for centered variables. Centering is therefore an essential step when geometric statements about orthogonality are translated into statements about correlation. A constant nonzero variable, for example, has zero covariance with every variable but need not be orthogonal to it.\n\nIndependence is stronger than uncorrelatedness, not another name for it. If \\(X\\) is uniformly distributed on \\([-1,1]\\) and \\(Y=X^2\\), then symmetry gives\n\n\\[\\operatorname{Cov}(X,Y)=\\mathbb E[X^3]=0,\\]\n\nyet \\(Y\\) is determined by \\(X\\). Equivalently, \\(X\\) and \\(X^2-1/3\\) are orthogonal centered variables that are not independent. A special case occurs for jointly Gaussian variables: zero cross-covariance between Gaussian subvectors implies independence. Marginal normality alone does not provide that conclusion.\n\nConditional expectation has an exact projection interpretation. If \\(X\\) is square-integrable and \\(\\mathcal G\\) is a sub-\\(\\sigma\\)-algebra, then \\(\\mathbb E[X\\mid\\mathcal G]\\) is the orthogonal projection of \\(X\\) onto the closed subspace of square-integrable \\(\\mathcal G\\)-measurable variables. Thus\n\n\\[\\mathbb E\\!\\left[ \\bigl(X-\\mathbb E[X\\mid\\mathcal G]\\bigr)Z \\right]=0\\]\n\nfor every real square-integrable \\(\\mathcal G\\)-measurable \\(Z\\). The unexplained residual is orthogonal to every square-integrable function of the available information. This also proves that conditional expectation minimizes expected squared prediction error among such predictors.\n\nIn ordinary least squares, the fitted vector is the projection of the observation vector onto the design matrix’s column space. The residual \\(r=y-X\\widehat\\beta\\) satisfies\n\n\\[X^{\\mathsf T}r=0.\\]\n\nIf the design includes an intercept, residuals sum to zero because the constant vector is among the columns. If \\(X^{\\mathsf T}X\\) is diagonal, predictor columns are mutually orthogonal, and coefficient calculations decouple. With independent errors of common variance \\(\\sigma^2\\), the coefficient covariance matrix is \\(\\sigma^2(X^{\\mathsf T}X)^{-1}\\), which is diagonal in this case. Independence of the coefficient estimates requires additional distributional assumptions, such as Gaussian errors.\n\nOrthogonality also organizes experimental design. In a balanced full factorial experiment with two factors coded \\(-1\\) and \\(+1\\), the columns for the intercept, each main effect, and their product are mutually orthogonal. This separates the corresponding sums of squares in analysis of variance. Missing observations, unequal replication, or fractional designs can alter that structure; in fractional designs some effect columns may be identical up to sign, producing aliasing instead of separation. In principal component analysis, orthogonal eigenvectors of the covariance matrix similarly define uncorrelated score directions, but the geometric construction alone does not establish their statistical independence."
    },
    {
      "heading": "Geometry, quantum theory, and broader meanings",
      "text": "On a smooth manifold, orthogonality is defined locally within each tangent space. A Riemannian metric tensor assigns a positive-definite inner product \\(g_p\\) at every point \\(p\\). Two tangent vectors \\(u,v\\) at that point are orthogonal when \\(g_p(u,v)=0\\). In coordinates, this becomes\n\n\\[\\sum_{i,j}g_{ij}u^iv^j=0.\\]\n\nA coordinate system is orthogonal when its coordinate tangent directions are pairwise orthogonal, equivalently when the metric matrix is diagonal. Orthogonal coordinate directions need not have unit length, so orthogonal coordinates are not necessarily orthonormal coordinates.\n\nPolar coordinates illustrate the distinction. In the Euclidean plane,\n\n\\[ds^2=dr^2+r^2\\,d\\theta^2.\\]\n\nThe radial and angular coordinate directions are perpendicular away from the coordinate singularity at the origin, but the angular coordinate vector has length \\(r\\), not one. Similar scale factors occur in cylindrical and spherical coordinates and enter formulas for differential operators. More generally, a nonzero gradient is orthogonal to tangent directions along a level surface because the directional derivative along such a direction vanishes:\n\n\\[df(v)=g(\\operatorname{grad}f,v)=0.\\]\n\nThis links orthogonality to normal vectors, constrained extrema, and the geometry of differential equations.\n\nIn quantum mechanics, pure states are represented by unit vectors in a complex Hilbert space, with vectors differing only by an overall phase representing the same physical state. Orthogonal state vectors have zero inner product and can be perfectly distinguished by an appropriate ideal measurement. For a normalized state \\(\\psi\\), the probability associated with an orthogonal projection \\(P\\) is\n\n\\[\\langle P\\psi,\\psi\\rangle=\\|P\\psi\\|^2.\\]\n\nFor a normalized vector \\(\\phi\\), projection onto its one-dimensional subspace gives probability \\(|\\langle\\psi,\\phi\\rangle|^2\\). Orthogonal eigenstates of self-adjoint observables therefore provide both a mathematical decomposition and the alternatives associated with measurement outcomes.\n\nOrthogonality can also be defined using symmetric or Hermitian forms that are not positive definite. This is important in geometries with indefinite metrics. With\n\n\\[B(x,y)=x_0y_0-x_1y_1,\\]\n\nthe nonzero vector \\((1,1)\\) satisfies \\(B(x,x)=0\\): it is orthogonal to itself. Such null vectors cannot occur in a positive-definite inner-product space. Although orthogonal complements still make sense, a subspace can intersect its own orthogonal complement nontrivially, and the usual nearest-point interpretation is unavailable. Results about positive-definite orthogonality must therefore not be transferred automatically to indefinite settings.\n\nOther disciplines use the word through related cancellation or separation principles. In number theory and harmonic analysis, characters may be orthogonal under a finite sum rather than an integral; in coding theory, vectors can be orthogonal under a bilinear form over a finite field. In software design, “orthogonal” often describes features intended to vary independently with little interference. These usages do not all provide angles, lengths, or probabilistic independence. Their shared mathematical model is the suppression of cross terms under a specified pairing, whose precise definition determines which geometric consequences remain valid."
    }
  ],
  "links": [
    "vector-space",
    "inner-product",
    "geometry",
    "linear-algebra",
    "mathematical-analysis",
    "euclidean-space",
    "dot-product",
    "norm-mathematics",
    "pythagorean-theorem",
    "positive-definite-matrix",
    "orthogonal-complement",
    "linear-subspace",
    "direct-sum",
    "orthogonal-projection",
    "hilbert-space",
    "idempotence",
    "least-squares",
    "linear-independence",
    "orthonormal-basis",
    "gram-schmidt-process",
    "separable-space",
    "orthogonal-matrix",
    "unitary-matrix",
    "conjugate-transpose",
    "determinant",
    "spectral-theorem",
    "singular-value-decomposition",
    "fourier-series",
    "orthogonal-polynomials",
    "sturm-liouville-theory",
    "heat-equation",
    "wave-equation",
    "joseph-fourier",
    "condition-number",
    "numerical-linear-algebra",
    "qr-decomposition",
    "floating-point-arithmetic",
    "householder-transformation",
    "qr-algorithm",
    "gram-matrix",
    "random-variable",
    "covariance",
    "correlation",
    "statistical-independence",
    "conditional-expectation",
    "ordinary-least-squares",
    "experimental-design",
    "analysis-of-variance",
    "principal-component-analysis",
    "manifold",
    "tangent-space",
    "metric-tensor",
    "gradient",
    "quantum-mechanics",
    "number-theory"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}