{
  "id": "matrix",
  "title": "Matrix (mathematics)",
  "lang": "en",
  "source_lang": "en",
  "summary": "A matrix is a rectangular array of numbers or symbols, arranged in rows and columns, used to represent linear maps, systems of equations, and data.",
  "category": "mathematics",
  "subcategory": "algebra",
  "type": "concept",
  "aliases": [
    "matrices"
  ],
  "generated_at": "2026-10-08",
  "model": "pro/claude-haiku-5-5",
  "url": "https://aiwiki.page/en/matrix/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/matrix/",
      "json": "https://aiwiki.page/zh/matrix.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "In mathematics, a matrix is a rectangular array of numbers, symbols, or expressions arranged in rows and columns. Matrices are a central object of linear algebra. They encode linear maps between vector spaces, compactly represent systems of linear equations, and organize tabular data. The same notation supports operations such as addition, multiplication, and inversion, and these operations follow rules that differ in important ways from ordinary arithmetic on real numbers. For example, matrix multiplication is generally not commutative.\n\nThe subject combines algebra, geometry, and analysis. Key quantities attached to a square matrix, such as its determinant, rank, and eigenvalues and eigenvectors, reveal structural properties of the linear map it represents, and they remain invariant under changes of basis. Matrices are also studied as elements of rings and Lie groups, which connects them to abstract-algebra and group-theory.\n\nMatrices are indispensable across the sciences and engineering. They describe rotations and quantum states, form the covariance matrices of statistics, underpin principal component analysis, and are the basic data structures of neural networks. The article below covers the definition and basic operations, special classes of matrices, the core theory of determinants, inverses, rank, and eigenvalues, the main matrix decompositions and numerical methods, the historical development of the subject, and its applications and generalizations."
    },
    {
      "heading": "Definition and notation",
      "text": "Matrices and their entries\n\nAn \\(m \\times n\\) matrix is a rectangular array of entries arranged in \\(m\\) horizontal rows and \\(n\\) vertical columns. Each entry is located by a pair of indices, the first giving the row and the second the column. The entry in row \\(i\\) and column \\(j\\) is written \\(a_{ij}\\), and the whole array is written \\(A = (a_{ij})\\), or \\(A = (a_{ij})_{1 \\le i \\le m,\\ 1 \\le j \\le n}\\) when the ranges need to be stated. For example,\n\n\\[A = \\begin{pmatrix} 1 & 2 & 3 \\\\ 4 & 5 & 6 \\end{pmatrix}\\]\n\nis a \\(2 \\times 3\\) matrix with \\(a_{12} = 2\\) and \\(a_{23} = 6\\). Row \\(i\\) consists of the entries \\(a_{i1}, \\dots, a_{in}\\), and column \\(j\\) consists of \\(a_{1j}, \\dots, a_{mj}\\). Mathematical texts usually number rows and columns from 1, whereas many programming environments start from 0.\n\nThe entries are drawn from a fixed set, most often a field. The set of all \\(m \\times n\\) matrices with entries in a field \\(F\\) is written \\(M_{m\\times n}(F)\\) or \\(F^{m\\times n}\\). The cases \\(F = \\mathbb{R}\\) and \\(F = \\mathbb{C}\\) dominate elementary and applied work, so one speaks of the sets \\(\\mathbb{R}^{m\\times n}\\) and \\(\\mathbb{C}^{m\\times n}\\). When \\(m = n\\), the matrix is called square, and the set of square matrices is abbreviated \\(M_n(F)\\). The integers \\(m\\) and \\(n\\) are the dimensions or the size of the matrix, and the size is part of the matrix's identity: a matrix is not just a list of numbers but a list arranged in a specific shape.\n\nRow vectors, column vectors, and scalars\n\nMatrices with a single row or a single column are the most important special cases. A \\(1 \\times n\\) matrix is a row vector, and an \\(m \\times 1\\) matrix is a column vector. By convention, the elements of \\(F^n\\) in the sense of a vector space are identified with column vectors, which is why vectors are so often written vertically. Row vectors appear when a linear functional is written as a matrix acting from the left, and when one computes a row-by-column product that produces a scalar.\n\nA \\(1 \\times 1\\) matrix has exactly one entry, and it is in effect a scalar. Strictly speaking, the matrix \\((a)\\) and the number \\(a\\) are different kinds of object, but the two are routinely identified, particularly in products such as a row vector times a column vector, whose result is a \\(1 \\times 1\\) matrix that is read as a number. In this sense, scalars are the degenerate case \\(m = n = 1\\). The same conventions connect the broader subject of linear algebra to the language of matrices, where vectors and scalars are handled through a single notation.\n\nEquality and the function viewpoint\n\nTwo matrices \\(A = (a_{ij})\\) and \\(B = (b_{ij})\\) are equal exactly when they have the same size and agree in every position. That is, if \\(A\\) is \\(m \\times n\\) and \\(B\\) is \\(p \\times q\\), then \\(A = B\\) holds if and only if \\(m = p\\), \\(n = q\\), and \\(a_{ij} = b_{ij}\\) for all \\(i\\) and \\(j\\). Size is therefore essential. The row \\((1\\ 2)\\) and the column with entries 1 and 2 contain the same numbers but are different matrices, and a \\(2 \\times 3\\) matrix can never equal a \\(3 \\times 2\\) matrix, even if the two contain the same multiset of entries.\n\nBecause every entry is determined by its index pair, an \\(m \\times n\\) matrix can be viewed as a function from \\(\\{1, \\dots, m\\} \\times \\{1, \\dots, n\\}\\) into the entry set \\(F\\), sending the pair \\((i, j)\\) to \\(a_{ij}\\). Under this view, the rectangular layout is only one way of displaying data indexed by two finite sets. The function viewpoint explains the notation for entries and clarifies what it means for two matrices to be equal, since equal functions have equal values at every point of their common domain. It also makes the generalizations straightforward: an infinite matrix is a function on \\(\\mathbb{N} \\times \\mathbb{N}\\), and a tensor is a function on a product of more than two index sets. These extensions are treated in the later Generalizations section."
    },
    {
      "heading": "Matrix operations",
      "text": "Addition and scalar multiplication\n\nTwo matrices can be added only when they have the same size. If \\(A=(a_{ij})\\) and \\(B=(b_{ij})\\) are both \\(m\\times n\\), their sum is the \\(m\\times n\\) matrix whose \\((i,j)\\) entry is \\(a_{ij}+b_{ij}\\). Addition is performed entry by entry, so it is commutative and associative, and the zero matrix (all entries zero) is its neutral element. For a scalar \\(c\\) from the underlying field, the product \\(cA\\) has entries \\(c\\,a_{ij}\\), and this operation is defined for matrices of any size. Together, these two operations make the set of all \\(m\\times n\\) matrices over a field a vector space of dimension \\(mn\\). A basis is given by the matrix units, which have a 1 in one position and zeros elsewhere. This is why matrices are often treated as vectors in their own right, and why the operations of linear algebra apply to them directly.\n\nMatrix multiplication\n\nMultiplication is defined by the row-by-column rule. If \\(A\\) is \\(m\\times n\\) and \\(B\\) is \\(n\\times p\\), the product \\(AB\\) is \\(m\\times p\\), with entries\n\n\\[(AB)_{ij}=\\sum_{k=1}^{n} a_{ik}\\,b_{kj}.\\]\n\nEach entry is the dot product of row \\(i\\) of \\(A\\) with column \\(j\\) of \\(B\\). The number of columns of \\(A\\) must equal the number of rows of \\(B\\), because each term in the sum pairs an entry of a row of \\(A\\) with an entry of a column of \\(B\\). When this condition holds, the product exists even if \\(BA\\) does not, and when both are defined the sizes of \\(AB\\) and \\(BA\\) may differ.\n\nMatrix multiplication is associative, \\((AB)C=A(BC)\\), and it distributes over addition from both sides: \\(A(B+C)=AB+AC\\) and \\((A+B)C=AC+BC\\). These identities make the square matrices of a fixed size into a ring, which is developed in the algebraic-structure section. The operation is not commutative, however. For instance, with\n\n\\[A=\\begin{pmatrix}0&1\\\\0&0\\end{pmatrix},\\qquad B=\\begin{pmatrix}0&0\\\\1&0\\end{pmatrix},\\]\n\none computes \\(AB=\\begin{pmatrix}1&0\\\\0&0\\end{pmatrix}\\) but \\(BA=\\begin{pmatrix}0&0\\\\0&1\\end{pmatrix}\\). Thus \\(AB\\neq BA\\). Commuting pairs exist, such as a matrix and any polynomial in itself, but they are the exception rather than the rule. The identity matrix \\(I\\) satisfies \\(IA=AI=A\\) whenever the sizes allow it.\n\nTranspose and conjugate transpose\n\nThe transpose \\(A^{\\mathsf T}\\) of an \\(m\\times n\\) matrix is the \\(n\\times m\\) matrix with \\((A^{\\mathsf T})_{ij}=a_{ji}\\); rows become columns. The basic identities are\n\n\\[(A^{\\mathsf T})^{\\mathsf T}=A,\\qquad (A+B)^{\\mathsf T}=A^{\\mathsf T}+B^{\\mathsf T},\\qquad (cA)^{\\mathsf T}=c\\,A^{\\mathsf T},\\qquad (AB)^{\\mathsf T}=B^{\\mathsf T}A^{\\mathsf T}.\\]\n\nThe reversal of order in the last identity is important: transposition reverses the order of factors in a product. For complex matrices, the conjugate transpose \\(A^{*}=\\overline{A}^{\\mathsf T}\\) combines transposition with entrywise complex conjugation. It satisfies \\((A^{*})^{*}=A\\), \\((A+B)^{*}=A^{*}+B^{*}\\), \\((cA)^{*}=\\overline{c}\\,A^{*}\\), and \\((AB)^{*}=B^{*}A^{*}\\). For real matrices, the conjugate transpose and the transpose coincide.\n\nBlock matrices\n\nA matrix can be partitioned into rectangular submatrices called blocks, for example\n\n\\[M=\\begin{pmatrix}A_{11}&A_{12}\\\\A_{21}&A_{22}\\end{pmatrix}.\\]\n\nBlock addition works blockwise whenever the blocks have matching sizes. Block multiplication works as if the blocks were scalars, provided the partitions are conformable: the column partition of the left factor must match the row partition of the right factor. If \\(M\\) is partitioned as above and \\(N=\\begin{pmatrix}B_{11}&B_{12}\\\\B_{21}&B_{22}\\end{pmatrix}\\) has conformable blocks, then\n\n\\[MN=\\begin{pmatrix}A_{11}B_{11}+A_{12}B_{21}&A_{11}B_{12}+A_{12}B_{22}\\\\A_{21}B_{11}+A_{22}B_{21}&A_{21}B_{12}+A_{22}B_{22}\\end{pmatrix}.\\]\n\nThe ordering of factors within each block product must be preserved, because the blocks themselves need not commute. Block structure is useful for computation, since a large product can be organized into smaller products that fit into memory or can be computed in parallel, and it is also the natural language for block-diagonal matrices, which represent direct sums of linear maps."
    },
    {
      "heading": "Special types of matrices",
      "text": "A matrix is square when it has as many rows as columns, so \\(A \\in \\mathbb{F}^{n\\times n}\\). Square matrices are the setting in which a single matrix can be multiplied by itself and can act on one vector space, which is why determinants, eigenvalues, and diagonalization are defined only for them. The zero matrix \\(O\\) is the additive identity: \\(A + O = A\\) for every matrix of the same size, and \\(AO = OA = O\\) for square \\(A\\). The identity matrix \\(I_n\\) has entries \\(\\delta_{ij}\\), equal to 1 on the diagonal and 0 elsewhere, and it is the multiplicative identity, so \\(AI_n = I_nA = A\\). Multiplying by a scalar \\(c\\) corresponds to \\(cI_n\\), which scales every vector by the same factor.\n\nA diagonal matrix \\(D = \\operatorname{diag}(d_1,\\dots,d_n)\\) has nonzero entries only on its main diagonal. Multiplying on the left by \\(D\\) scales each row \\(i\\) by \\(d_i\\), and multiplying on the right scales each column. Products and sums of diagonal matrices are again diagonal, and \\(D\\) is invertible exactly when every \\(d_i \\neq 0\\), in which case its inverse is \\(\\operatorname{diag}(1/d_1,\\dots,1/d_n)\\). Diagonal matrices are therefore the simplest model of a coordinate-wise scaling operator.\n\nTriangular matrices generalize this idea. An upper triangular matrix has \\(a_{ij}=0\\) whenever \\(i>j\\), and a lower triangular matrix has \\(a_{ij}=0\\) whenever \\(i<j\\). Both classes are closed under addition and multiplication, the determinant of a triangular matrix is the product of its diagonal entries, and its eigenvalues are exactly those diagonal entries. Triangular linear systems can be solved directly by forward or back substitution, which is the reason that LU decomposition and Gaussian elimination reduce general systems to triangular ones.\n\nSymmetric, skew-symmetric, and Hermitian matrices are defined by the behavior of the matrix under transposition. A real matrix is symmetric when \\(A^{\\mathsf T}=A\\), so \\(a_{ij}=a_{ji}\\). A skew-symmetric matrix satisfies \\(A^{\\mathsf T}=-A\\), which forces zeros on the diagonal. Every odd-order skew-symmetric matrix is singular, and its eigenvalues are zero or purely imaginary. Over the complex numbers, the relevant class is Hermitian matrices, defined by \\(A^{*}=A\\), where \\(A^{*}\\) is the conjugate transpose. Their diagonal entries must be real, and every real symmetric matrix is a special case. Hermitian matrices have real eigenvalues and can be diagonalized by a unitary matrix, as stated by the spectral theorem. The complex counterpart of a real skew-symmetric matrix is the skew-Hermitian matrix, which satisfies \\(A^{*}=-A\\). Multiplying such a matrix by \\(i\\) produces a Hermitian matrix, so the two classes differ by a factor of the imaginary unit.\n\nOrthogonal and unitary matrices are the matrices that preserve geometry. A real square matrix \\(Q\\) is orthogonal when \\(Q^{\\mathsf T}Q=I\\), and a complex square matrix \\(U\\) is unitary when \\(U^{*}U=I\\). Equivalently, their columns form an orthonormal basis. Such matrices preserve inner products, \\(\\langle Ux, Uy\\rangle = \\langle x, y\\rangle\\), and therefore preserve lengths, \\(\\|Ux\\| = \\|x\\|\\), and angles. They are the linear isometries of Euclidean and Hilbert space. In the real case the determinant is \\(\\pm 1\\): matrices with determinant \\(+1\\) are rotations, and those with determinant \\(-1\\) include reflections. In two dimensions, the rotation by an angle \\(\\theta\\) is \\(\\begin{pmatrix}\\cos\\theta & -\\sin\\theta\\\\ \\sin\\theta & \\cos\\theta\\end{pmatrix}\\). The orthogonal matrices of a fixed size form the group \\(O(n)\\), and the unitary matrices form \\(U(n)\\), both of which are important examples of Lie groups.\n\nA sparse matrix is one in which most entries are zero. Such matrices arise naturally from graphs, from discretized partial differential equations, and from large data sets in which each variable interacts with only a few others. Storing the full array requires \\(mn\\) numbers regardless of content, whereas sparse formats store only the nonzero entries together with index information. The coordinate (COO) format stores a list of (row, column, value) triplets, so its storage grows with the number of nonzeros. The compressed sparse row (CSR) format replaces the row indices with a pointer array of length \\(m+1\\), so that the entries of row \\(i\\) occupy a contiguous block of the value array. The compressed sparse column (CSC) format plays the same role for columns, and specialized formats such as DIA exploit banded structure. Because the cost of a matrix–vector product depends on the number of nonzeros rather than on \\(mn\\), sparse storage reduces both memory use and computation time, and it is essential for large-scale numerical methods such as the iterative solvers used for huge systems. The layout of the format also affects memory access patterns and performance on parallel hardware."
    },
    {
      "heading": "Matrices as linear maps",
      "text": "Matrices are the coordinate form of linear maps. Let \\(V\\) be an \\(n\\)-dimensional vector space over a field \\(F\\) with ordered basis \\((v_1,\\dots,v_n)\\), and let \\(W\\) be an \\(m\\)-dimensional space with basis \\((w_1,\\dots,w_m)\\). A linear map \\(T\\colon V\\to W\\) is determined by the images \\(T(v_j)\\), and each image has a unique expansion \\(T(v_j)=\\sum_{i=1}^{m} a_{ij}w_i\\). The scalars \\(a_{ij}\\) form an \\(m\\times n\\) matrix \\(A\\), whose \\(j\\)-th column is the coordinate vector of \\(T(v_j)\\). With this convention, the coordinates of \\(T(x)\\) are obtained from the coordinates of \\(x\\) by \\(A\\), that is, \\([T(x)]_{C}=A\\,[x]_{B}\\). Taking the standard bases of \\(F^n\\) and \\(F^m\\), the map \\(x\\mapsto Ax\\) is itself a linear map, and every linear map \\(F^n\\to F^m\\) arises this way from exactly one matrix. The space of such maps therefore has dimension \\(mn\\), matching the number of entries.\n\nThe row-by-column rule for matrix multiplication was chosen so that it corresponds to composition. If \\(A\\) is an \\(m\\times n\\) matrix representing \\(T\\colon F^n\\to F^m\\), and \\(B\\) is a \\(p\\times m\\) matrix representing \\(S\\colon F^m\\to F^p\\), then \\(BA\\) is a \\(p\\times n\\) matrix representing \\(S\\circ T\\). This follows because \\((BA)x=B(Ax)\\) for every vector \\(x\\). The order of the factors reflects the order in which the maps are applied, which is one conceptual reason matrix multiplication is generally not commutative: \\(S\\circ T\\) and \\(T\\circ S\\) need not coincide, and they need not even be defined on the same spaces.\n\nThe same linear map has different matrices in different bases, so a matrix is always a representation relative to chosen bases. Suppose \\(T\\colon V\\to V\\) has matrix \\(A\\) in a basis \\(\\mathcal{B}\\), and let \\(\\mathcal{B}'\\) be another basis. Let \\(P\\) be the change-of-basis matrix whose columns are the coordinates of the new basis vectors in the old basis, so that \\([x]_{\\mathcal{B}}=P\\,[x]_{\\mathcal{B}'}\\). If \\(A'\\) is the matrix of \\(T\\) in \\(\\mathcal{B}'\\), then comparing \\(A P[x]_{\\mathcal{B}'}\\) with \\(P A'[x]_{\\mathcal{B}'}\\) gives\n\n\\[A' = P^{-1} A P.\\]\n\nFor a map \\(T\\colon V\\to W\\) between different spaces, changing the basis in both gives \\(A' = Q^{-1} A P\\), where \\(Q\\) is the change-of-basis matrix in \\(W\\). Matrices related in this way by invertible factors on both sides are called equivalent, and over a field they are classified exactly by their rank.\n\nWhen \\(V=W\\) and the same basis is used on both sides, the relation \\(B = P^{-1}AP\\) defines similarity of square matrices. Two similar matrices represent the same linear operator in different bases. Several properties are invariant under similarity: the determinant, the trace, the characteristic polynomial and hence the eigenvalues with their algebraic multiplicities, the rank and nullity, invertibility, and diagonalizability. Properties that depend on the coordinate system are not invariant. Entries, symmetry, and orthogonality of the matrix change under similarity, which is why a symmetric matrix can become non-symmetric after a change of basis. Eigenvectors, by contrast, transform in a predictable way: if \\(Av=\\lambda v\\), then the coordinate vector of \\(v\\) in the new basis is \\(P^{-1}v\\).\n\nThe kernel and image of a linear map correspond directly to parts of its matrix. The kernel of \\(T\\) corresponds to the null space \\(\\{x : Ax=0\\}\\), since coordinates of kernel vectors are exactly the solutions of this homogeneous system. The image of \\(T\\) is spanned by the vectors \\(T(v_1),\\dots,T(v_n)\\), so in coordinates it is the column space of \\(A\\), the span of the columns of \\(A\\). The nullity of \\(A\\) is the dimension of its null space, and the rank is the dimension of its column space. These quantities satisfy the rank–nullity theorem: \\(\\operatorname{rank}(A)+\\operatorname{nullity}(A)=n\\). A nonzero kernel vector is a nontrivial linear relation among the columns of \\(A\\), so \\(T\\) is injective exactly when the columns are linearly independent, and surjective exactly when \\(\\operatorname{rank}(A)=m\\).\n\nAs an example, consider the differentiation map \\(D\\) on polynomials of degree at most 3, with basis \\(1,x,x^2,x^3\\), into polynomials of degree at most 2, with basis \\(1,x,x^2\\). Since \\(D(1)=0\\), \\(D(x)=1\\), \\(D(x^2)=2x\\), and \\(D(x^3)=3x^2\\), the matrix is\n\n\\[\\begin{pmatrix} 0 & 1 & 0 & 0 \\\\ 0 & 0 & 2 & 0 \\\\ 0 & 0 & 0 & 3 \\end{pmatrix}.\\]\n\nIts rank is 3, so the image is all of the degree-at-most-2 polynomials, and its nullity is 1, spanned by the constant column. The kernel of \\(D\\) is the set of constant polynomials, and the rank–nullity relation \\(3+1=4\\) holds."
    },
    {
      "heading": "Determinants",
      "text": "The determinant is a scalar attached to each square matrix. For a 2×2 matrix it is \\(\\det\\begin{pmatrix}a&b\\\\c&d\\end{pmatrix}=ad-bc\\). For larger matrices it is defined by a combinatorial sum or by a recursive expansion, and its main uses are testing invertibility, computing volumes, and describing how linear maps scale space.\n\nDefinition: Leibniz formula and cofactor expansion\n\nFor an \\(n\\times n\\) matrix \\(A=(a_{ij})\\), the Leibniz formula is\n\n\\[\\det A=\\sum_{\\sigma\\in S_n}\\operatorname{sgn}(\\sigma)\\prod_{i=1}^{n}a_{i,\\sigma(i)},\\]\n\nwhere \\(S_n\\) is the symmetric group of permutations of \\(\\{1,\\dots,n\\}\\) and \\(\\operatorname{sgn}(\\sigma)\\) is \\(+1\\) for even permutations and \\(-1\\) for odd ones. Each term of the sum picks exactly one entry from each row and each column, so the formula has \\(n!\\) terms. For \\(n=3\\) there are six terms, which is the origin of the familiar diagonal rule.\n\nThe formula can also be organized recursively. The minor \\(M_{ij}\\) is the determinant of the submatrix obtained by deleting row \\(i\\) and column \\(j\\), and the cofactor is \\(C_{ij}=(-1)^{i+j}M_{ij}\\). Expansion along any row \\(i\\) gives\n\n\\[\\det A=\\sum_{j=1}^{n}a_{ij}C_{ij},\\]\n\nand the same value results from expanding along any column. An induction on \\(n\\) shows that this recursive form agrees with the Leibniz sum; this is the cofactor expansion of the determinant. Because the recursion does roughly \\(n!\\) work, it is suited to hand calculation of small matrices, not to large numerical problems.\n\nMain properties\n\nSeveral properties follow from the permutation definition and are used constantly:\n\n- Row operations. Swapping two rows multiplies the determinant by \\(-1\\), and two equal rows force the determinant to be zero. Multiplying one row by a scalar \\(c\\) multiplies the determinant by \\(c\\). Adding a multiple of one row to another leaves the determinant unchanged. These rules make Gaussian elimination a practical way to compute determinants: reduce the matrix to triangular form, track the swaps and scalings, and multiply the diagonal entries.\n- Multilinearity. The determinant is linear in each row (or column) separately when the others are held fixed.\n- Transpose. \\(\\det A^{\\mathsf T}=\\det A\\), so the same properties hold for columns.\n- Multiplicativity. \\(\\det(AB)=\\det A\\,\\det B\\) for square matrices of the same size. Consequently \\(\\det(A^{-1})=1/\\det A\\), and similar matrices have equal determinants.\n- Triangular matrices. The determinant of a triangular matrix is the product of its diagonal entries.\n- Singularity criterion. A square matrix is invertible (see inverse matrix) exactly when its determinant is nonzero. Equivalently, \\(\\det A=0\\) when the rows or columns are linearly dependent, which means the matrix is singular and has a nontrivial null space.\n\nGeometric meaning\n\nFor a real \\(n\\times n\\) matrix, the columns can be treated as edge vectors of a parallelepiped in \\(\\mathbb{R}^n\\). Its volume is \\(|\\det A|\\). In the plane, the parallelogram spanned by \\((a,c)\\) and \\((b,d)\\) has area \\(|ad-bc|\\). The sign records orientation: a positive determinant means the map preserves orientation, and a negative one means it reverses it. A linear map \\(T\\) therefore multiplies all volumes by the same factor \\(|\\det T|\\), which explains why multiplicativity holds: composing two maps multiplies their scaling factors.\n\nThis scaling property is the basis of the change-of-variables formula for integrals. If \\(g\\) is a continuously differentiable map with invertible Jacobian matrix \\(Dg\\), then\n\n\\[\\int_{g(U)}f(\\mathbf y)\\,d\\mathbf y=\\int_U f(g(\\mathbf u))\\,\\bigl|\\det Dg(\\mathbf u)\\bigr|\\,d\\mathbf u.\\]\n\nIn polar coordinates the Jacobian determinant is \\(r\\), which gives the familiar factor \\(r\\,dr\\,d\\theta\\).\n\nHistorical development\n\nThe idea appeared in several places before it had a settled theory. Seki Takakazu in Japan worked with determinant-like arrays in the 1680s, using them for elimination and for finding common roots of polynomials. He handled sizes up to \\(5\\times5\\), though without a term for the concept. In Europe, Gottfried Wilhelm Leibniz wrote in 1693 to the Marquis de l'Hôpital, describing the condition for consistency of a linear system in terms of coefficients indexed by two numbers. Leibniz's letter was not published until much later, and his work was largely unnoticed in his lifetime.\n\nGabriel Cramer's 1750 treatment of algebraic curves gave an explicit rule for solving linear systems with determinants, the rule that now bears his name. Because it was published and widely read, it introduced determinants to a broad audience. Étienne Bézout (1764) established a recursive law for computing them, and Alexandre-Théophile Vandermonde (1771) was the first to study determinants as independent functions. Pierre-Simon Laplace (1772) developed expansion by minors, which generalizes the cofactor expansion. In 1812, Jacques Binet and Augustin-Louis Cauchy presented work on the multiplication theorem; Cauchy's memoir is usually regarded as the point at which determinants were treated as a general theory with the modern meaning of the term. The name \"determinant\" is credited to Carl Friedrich Gauss, who used it for the discriminant of a quadratic form.\n\nIn the nineteenth and early twentieth centuries, determinants were a central topic. Thomas Muir's multi-volume history, completed in the 1920s, summarizes results up to about 1920. Their role in mainstream mathematics declined afterward, as matrix theory, linear transformations over abstract fields, and numerical linear algebra provided more direct methods for many of the problems determinants had addressed."
    },
    {
      "heading": "Inverses and invertibility",
      "text": "A square matrix \\(A\\) of order \\(n\\) is invertible (or non-singular) if there is a matrix \\(A^{-1}\\) with \\(AA^{-1} = A^{-1}A = I_n\\), where \\(I_n\\) is the identity matrix. When it exists, the inverse is unique. If \\(B\\) and \\(C\\) both satisfy the defining equations, then \\(B = B(AC) = (BA)C = C\\). For square matrices, a one-sided inverse is automatically two-sided, so \\(BA = I_n\\) alone implies \\(AB = I_n\\). Inverses reverse the order of products, \\((AB)^{-1} = B^{-1}A^{-1}\\), and commute with transposition, \\((A^{\\mathsf T})^{-1} = (A^{-1})^{\\mathsf T}\\).\n\nEquivalent conditions for invertibility\n\nFor a square matrix over a field, the following statements are equivalent:\n\n- \\(A\\) is invertible.\n- \\(\\det A \\neq 0\\).\n- \\(\\operatorname{rank} A = n\\), so the columns (and rows) are linearly independent and span the whole space.\n- The null space of \\(A\\) is trivial, that is, \\(\\{0\\}\\). Equivalently, the map \\(x \\mapsto Ax\\) is injective.\n- For every right-hand side \\(b\\), the equation \\(Ax = b\\) has exactly one solution.\n- Zero is not an eigenvalue of \\(A\\).\n- \\(A\\) is row equivalent to \\(I_n\\).\n\nThese conditions describe one fact from different angles: the linear map represented by \\(A\\) is a bijection of \\(F^n\\). The rank-nullity theorem links the two dimensions, since rank plus nullity equals \\(n\\), so a trivial kernel and full rank are the same condition. A square matrix that fails these conditions is called singular.\n\nComputing inverses\n\nThe adjugate formula gives the inverse in closed form. The adjugate \\(\\operatorname{adj}(A)\\) is the transpose of the matrix of cofactors, and it satisfies \\(A\\,\\operatorname{adj}(A) = \\operatorname{adj}(A)\\,A = \\det(A)\\,I_n\\). Hence, when \\(\\det A \\neq 0\\),\n\n\\[A^{-1} = \\frac{1}{\\det A}\\operatorname{adj}(A).\\]\n\nFor a \\(2\\times 2\\) matrix this reduces to \\(\\begin{pmatrix} a & b \\\\ c & d \\end{pmatrix}^{-1} = \\frac{1}{ad-bc}\\begin{pmatrix} d & -b \\\\ -c & a \\end{pmatrix}\\). The formula is convenient for small or symbolic matrices, but cofactor expansion grows factorially with \\(n\\), so it is impractical for large matrices.\n\nGauss-Jordan elimination is the standard numerical method. One forms the augmented matrix \\([A \\mid I_n]\\) and applies elementary row operations until the left block becomes \\(I_n\\). The right block then holds \\(A^{-1}\\). If no nonzero pivot can be found in some column, the matrix is singular. The work is on the order of \\(n^3\\) arithmetic operations, the same order as an LU factorization. In practice, software rarely forms \\(A^{-1}\\) explicitly. It factors \\(A\\) once and solves for each right-hand side, which is cheaper and usually more accurate. For the elimination procedure itself, see Gaussian elimination.\n\nCramer's rule\n\nIf \\(\\det A \\neq 0\\), the unique solution of \\(Ax = b\\) has components\n\n\\[x_i = \\frac{\\det A_i}{\\det A}, \\qquad i = 1,\\dots,n,\\]\n\nwhere \\(A_i\\) is obtained from \\(A\\) by replacing its \\(i\\)-th column with \\(b\\). The rule is named after Gabriel Cramer, who published it in 1750. It gives an explicit formula for each unknown, which is useful in theory. It shows, for example, how a solution depends continuously on parameters when the determinant stays away from zero.\n\nAs a computational method, it is rarely used. It requires \\(n+1\\) determinants. Computed by cofactor expansion, the cost is enormous. Even with elimination-based determinants, each costing about \\(n^3\\) operations, the total is roughly \\(n^4\\), compared with about \\(n^3\\) for a single elimination. Its results also depend on accurate determinant values, and in floating-point arithmetic a nearly singular system can produce inaccurate components. Solvers therefore use elimination-based factorizations instead.\n\nOne-sided inverses and the pseudoinverse\n\nNon-square matrices cannot have two-sided inverses, but they can have one-sided ones. An \\(m\\times n\\) matrix \\(A\\) with \\(m > n\\) and full column rank has a left inverse \\(L\\), an \\(n\\times m\\) matrix with \\(LA = I_n\\). One choice is \\(L = (A^{\\mathsf T}A)^{-1}A^{\\mathsf T}\\), which exists because \\(A^{\\mathsf T}A\\) is then invertible. Similarly, a matrix with full row rank and \\(m < n\\) has a right inverse \\(R\\) with \\(AR = I_m\\), for instance \\(R = A^{\\mathsf T}(AA^{\\mathsf T})^{-1}\\). These one-sided inverses are generally not unique, and a left inverse does not satisfy \\(AL = I\\) in general.\n\nThe Moore-Penrose pseudoinverse \\(A^{+}\\) extends the idea to every matrix over the real or complex numbers. It is the unique matrix satisfying four Penrose conditions: \\(AA^{+}A = A\\), \\(A^{+}AA^{+} = A^{+}\\), and the products \\(AA^{+}\\) and \\(A^{+}A\\) are Hermitian. Using the singular value decomposition \\(A = U\\Sigma V^{*}\\), one has \\(A^{+} = V\\Sigma^{+}U^{*}\\), where \\(\\Sigma^{+}\\) inverts each nonzero singular value and leaves zeros in place. If \\(A\\) is invertible, \\(A^{+} = A^{-1}\\). If \\(A\\) has full rank, \\(A^{+}\\) reduces to one of the one-sided inverses above. For any \\(b\\), the vector \\(x = A^{+}b\\) minimizes \\(\\lVert Ax - b\\rVert_2\\), and among all minimizers it has the smallest norm. This is why the pseudoinverse underlies the solution of least-squares problems. The concept goes back to E. H. Moore in 1920 and was rediscovered and characterized by Roger Penrose in 1955. In floating-point computation, deciding which singular values count as zero requires a tolerance, and the result is sensitive to the condition number of \\(A\\)."
    },
    {
      "heading": "Rank and linear systems",
      "text": "Rank and the equality of row and column rank\n\nThe rank of an \\(m \\times n\\) matrix \\(A\\) over a field \\(F\\) is the dimension of its column space, the subspace of \\(F^m\\) spanned by its columns. The row space, spanned by the rows in \\(F^n\\), has its own dimension, called the row rank. The two dimensions are always equal, so the rank is unambiguous and satisfies \\(\\operatorname{rank}(A) \\le \\min(m,n)\\).\n\nElimination shows why the two numbers agree. Elementary row operations leave the row space unchanged, and they preserve every linear relation among the columns, because each operation is multiplication on the left by an invertible matrix. In a row echelon form, the nonzero rows are linearly independent and their number equals the number of pivots. The pivot columns are independent, and every other column is a combination of them. The row rank and the column rank of the echelon form therefore both equal the number of pivots, and since the original matrix has the same count, the two ranks coincide. An equivalent characterization is the largest size of a square submatrix with nonzero determinant.\n\nGaussian elimination and row echelon form\n\nGaussian elimination reduces a matrix to row echelon form using three operations: swapping two rows, multiplying a row by a nonzero scalar, and adding a multiple of one row to another. In the result, zero rows lie at the bottom, and the leading entry (pivot) of each nonzero row lies strictly to the right of the pivot in the row above. Further reduction to reduced row echelon form, where each pivot equals 1 and the entries above and below it are zero, makes that form unique. The rank is then the number of pivots.\n\nThe same procedure solves a system of linear equations. Applying the operations to the augmented matrix \\([A \\mid b]\\) produces an equivalent system, which is solved by back-substitution. Variables in non-pivot columns are free parameters. Elimination on an \\(n \\times n\\) system takes on the order of \\(\\tfrac{2}{3}n^3\\) arithmetic operations. In floating-point computation, rounding can make a true zero pivot appear tiny but nonzero, so numerical rank is usually determined more reliably by the singular value decomposition than by elimination alone.\n\nThe rank–nullity theorem\n\nFor a linear map \\(T : V \\to W\\) between finite-dimensional spaces, the dimension of the kernel plus the dimension of the image equals the dimension of \\(V\\). Applied to an \\(m \\times n\\) matrix regarded as a map \\(F^n \\to F^m\\), the theorem reads\n\n\\[\\operatorname{rank}(A) + \\dim \\operatorname{null}(A) = n,\\]\n\nwhere \\(\\operatorname{null}(A)\\) is the set of solutions of \\(Ax = 0\\). The theorem constrains solution sets in the following way.\n\nFor a homogeneous system \\(Ax = 0\\), the solution set is the null space, a subspace of dimension \\(n - \\operatorname{rank}(A)\\). Nontrivial solutions exist exactly when \\(\\operatorname{rank}(A) < n\\), which is the same as saying the columns are linearly dependent.\n\nFor an inhomogeneous system \\(Ax = b\\), the system is consistent exactly when \\(b\\) lies in the column space, that is, when \\(\\operatorname{rank}(A) = \\operatorname{rank}([A \\mid b])\\). When a particular solution \\(x_p\\) exists, the full solution set is \\(x_p + \\operatorname{null}(A)\\), a translate of the null space. It is a single point when \\(\\operatorname{rank}(A) = n\\) and otherwise a translate of a subspace of dimension \\(n - \\operatorname{rank}(A)\\).\n\nAs an illustration, take \\(x + 2y + z = 3\\) and \\(2x + 4y + 2z = 6\\). Subtracting twice the first row from the second gives a zero row, so the rank is 1. With \\(n = 3\\), the null space has dimension 2, and the solutions form the plane \\(x = 3 - 2y - z\\) with \\(y\\) and \\(z\\) free. By contrast, \\(x + 2y = 3\\) and \\(2x + 4y = 7\\) reduce to \\(0 = 1\\). The coefficient rank is 1 while the augmented rank is 2, so the system has no solution.\n\nClassification of solutions by rank\n\nLet \\(A\\) be \\(m \\times n\\), let \\(r = \\operatorname{rank}(A)\\), and consider \\(Ax = b\\).\n\n- No solution: \\(\\operatorname{rank}(A) < \\operatorname{rank}([A \\mid b])\\), so \\(b\\) is outside the column space.\n- Exactly one solution: \\(\\operatorname{rank}(A) = \\operatorname{rank}([A \\mid b]) = n\\).\n- Infinitely many solutions: \\(\\operatorname{rank}(A) = \\operatorname{rank}([A \\mid b]) < n\\). Over an infinite field the solution set is infinite; over a finite field with \\(q\\) elements it contains \\(q^{\\,n-r}\\) solutions.\n\nTwo special cases follow directly. If \\(r = m\\) (full row rank), the column space is all of \\(F^m\\), so every \\(b\\) yields a consistent system. If \\(A\\) is square with \\(r = n\\), it is invertible, and every right-hand side gives exactly one solution."
    },
    {
      "heading": "Eigenvalues and diagonalization",
      "text": "Eigenvalues, eigenvectors and eigenspaces\n\nFor a square matrix \\(A\\) of size \\(n\\times n\\), a nonzero vector \\(v\\) is an eigenvector with eigenvalue \\(\\lambda\\) when \\(Av=\\lambda v\\). Rewriting this as \\((A-\\lambda I)v=0\\) shows that \\(\\lambda\\) is an eigenvalue exactly when the matrix \\(A-\\lambda I\\) has a nontrivial kernel, which happens if and only if \\(\\det(A-\\lambda I)=0\\). The function \\(p_A(\\lambda)=\\det(\\lambda I-A)\\) is the characteristic polynomial. It is monic of degree \\(n\\), so over the complex numbers it has \\(n\\) roots counted with multiplicity, and these roots are the eigenvalues. Its coefficients encode invariants of \\(A\\): the constant term is \\(\\pm\\det A\\), and the coefficient of \\(\\lambda^{n-1}\\) is \\(-\\operatorname{tr}A\\), so the sum of the eigenvalues equals the trace and their product equals the determinant.\n\nFor each eigenvalue \\(\\lambda\\), the set of all eigenvectors together with the zero vector forms the null space of \\(A-\\lambda I\\). This subspace is the eigenspace \\(E_\\lambda\\). Its dimension is the geometric multiplicity of \\(\\lambda\\). The algebraic multiplicity is the number of times \\(\\lambda\\) appears as a root of the characteristic polynomial. For every eigenvalue, the geometric multiplicity is at least 1 and does not exceed the algebraic multiplicity. The two numbers can differ. A standard example is the \\(2\\times2\\) matrix with a single repeated eigenvalue 1 and a Jordan block, where the eigenspace is one-dimensional while the algebraic multiplicity is 2.\n\nDiagonalizability\n\nA matrix \\(A\\) is diagonalizable when it is similar to a diagonal matrix, that is, when there exist an invertible matrix \\(P\\) and a diagonal matrix \\(D\\) with \\(A=PDP^{-1}\\). The columns of \\(P\\) are then eigenvectors and the diagonal entries of \\(D\\) are the corresponding eigenvalues. Equivalently, \\(A\\) is diagonalizable if and only if \\(\\mathbb{C}^n\\) (or \\(\\mathbb{R}^n\\), when the eigenvalues are real) has a basis made of eigenvectors of \\(A\\). The criterion in terms of multiplicities is that for every eigenvalue the geometric multiplicity equals the algebraic multiplicity. Two sufficient conditions follow from this. If all \\(n\\) eigenvalues are distinct, eigenvectors belonging to different eigenvalues are linearly independent, so \\(A\\) is diagonalizable. Also, if the characteristic polynomial splits into linear factors and every root has a full set of eigenvectors, the matrix is diagonalizable.\n\nFailure of diagonalizability can come from two sources. Over the reals, a characteristic polynomial may have no real roots: a \\(2\\times2\\) rotation through 90 degrees has none, so it has no real diagonalization, although over \\(\\mathbb{C}\\) it diagonalizes with eigenvalues \\(\\pm i\\). The other source is a deficiency in eigenvectors, as in the Jordan-block example above. Such matrices are handled by the Jordan canonical form, which replaces the diagonal matrix with blocks that are diagonal except for superdiagonal ones.\n\nThe spectral theorem\n\nThe spectral theorem gives a strong guarantee for two important classes. For a real symmetric matrix, all eigenvalues are real, and there exists an orthogonal matrix \\(Q\\) such that \\(Q^{\\mathsf T}AQ=D\\) is diagonal. For a complex Hermitian matrix \\(A=A^*\\), all eigenvalues are real, and there exists a unitary matrix \\(U\\) such that \\(U^*AU=D\\). In both cases the eigenvectors can be chosen to form an orthonormal basis, and eigenvectors belonging to distinct eigenvalues are automatically orthogonal. The real case is sometimes called the principal axis theorem. Each statement can be proved by first triangularizing \\(A\\) with a unitary matrix, as in the Schur decomposition. Hermitian symmetry then forces the triangular factor to be diagonal. Because orthogonal and unitary matrices preserve lengths and inner products, the theorem says that every symmetric or Hermitian linear operator acts on suitable orthogonal coordinates as a pure stretch along mutually perpendicular axes. The spectral theorem holds for the larger class of normal matrices, meaning those commuting with their conjugate transpose, which are exactly the matrices that are unitarily diagonalizable.\n\nApplications: matrix powers and differential equations\n\nDiagonalization makes repeated multiplication easy. If \\(A=PDP^{-1}\\), then \\(A^k=PD^kP^{-1}\\) for every integer \\(k\\ge 0\\), and \\(D^k\\) is obtained by raising each diagonal entry to the \\(k\\)th power. The Fibonacci recurrence is a standard illustration. The matrix \\(\\begin{pmatrix}1&1\\\\1&0\\end{pmatrix}\\) has eigenvalues \\((1\\pm\\sqrt5)/2\\), and its powers produce closed-form expressions for the Fibonacci numbers.\n\nThe same idea solves constant-coefficient linear systems of differential equations \\(y'=Ay\\). The solution with initial value \\(y(0)\\) is \\(y(t)=e^{tA}y(0)\\), where the matrix exponential is defined by a power series. When \\(A\\) is diagonalizable, \\(e^{tA}=Pe^{tD}P^{-1}\\), and \\(e^{tD}\\) is the diagonal matrix with entries \\(e^{\\lambda_i t}\\). Each eigenvalue therefore contributes a basic exponential mode, and the eigenvectors determine how these modes are combined to match the initial condition. For non-diagonalizable matrices the same formula holds, but the computation uses the Jordan form or a finite expansion based on the Cayley–Hamilton theorem, which shows that \\(e^{tA}\\) is a polynomial in \\(A\\) of degree less than \\(n\\)."
    },
    {
      "heading": "Matrix decompositions",
      "text": "A matrix decomposition, or factorization, writes a matrix as a product of matrices with special structure. Problems such as solving linear systems, fitting least-squares models, or computing eigenvalues can then be reduced to simpler steps. Matrix factorization gives the general framing, and the methods below are the ones most used in numerical linear algebra.\n\nLU decomposition\n\nGaussian elimination can be recorded as a factorization \\(A = LU\\), where \\(L\\) is unit lower triangular and \\(U\\) is upper triangular. Once this is available, a system \\(Ax = b\\) is solved in two triangular stages: forward substitution for \\(Ly = b\\), then back substitution for \\(Ux = y\\). Computing the factors costs about \\(\\tfrac{2}{3}n^3\\) floating-point operations, but the cost is paid once and reused for every new right-hand side, which is why this route is preferred over repeating the elimination.\n\nPlain elimination breaks down when a pivot is zero and can be unstable when a pivot is very small. Partial pivoting swaps rows so that the largest available entry in the current column becomes the pivot, giving \\(PA = LU\\) with a permutation matrix \\(P\\). Complete pivoting also swaps columns and bounds element growth more strictly, but it is more expensive, so partial pivoting is the usual default. Pivoting therefore concerns numerical stability as well as existence: an invertible matrix such as \\(\\begin{pmatrix}0&1\\\\1&0\\end{pmatrix}\\) has no LU factorization without row exchanges.\n\nQR decomposition\n\nA QR decomposition writes \\(A = QR\\), where \\(Q\\) has orthonormal columns and \\(R\\) is upper triangular. When \\(A\\) is square, \\(Q\\) is an orthogonal matrix. Classical Gram–Schmidt orthogonalization computes the factors directly but loses orthogonality in floating-point arithmetic. Modified Gram–Schmidt, Householder reflections, and Givens rotations are more robust, and Householder reflections are the standard choice in numerical software.\n\nThe main application is least squares. For a real \\(m \\times n\\) matrix \\(A\\) with \\(m \\ge n\\) and full column rank, the goal is to minimize \\(\\|Ax - b\\|_2\\). The textbook route solves the normal equations \\(A^{\\mathsf T}A x = A^{\\mathsf T} b\\), but this squares the condition number, since \\(\\kappa(A^{\\mathsf T}A) = \\kappa(A)^2\\), and accuracy can be lost quickly. Working from \\(A = QR\\) yields \\(Rx = Q^{\\mathsf T} b\\), which is solved by back substitution and avoids the squaring. The same idea of repeated QR steps underlies the QR algorithm for eigenvalues.\n\nCholesky decomposition\n\nIf \\(A\\) is Hermitian (symmetric in the real case) and positive definite, then \\(A = LL^*\\) for a lower triangular \\(L\\) with positive diagonal entries, and this factor is unique. The cost is about \\(\\tfrac{1}{3}n^3\\) operations, roughly half that of LU. No pivoting is needed, because positive definiteness keeps every pivot positive and the process stable. The algorithm also works as a test in practice: if it attempts to take the square root of a nonpositive number, the matrix is not positive definite. Cholesky factors are used to sample from a multivariate normal distribution, since multiplying a vector of independent standard normal variables by \\(L\\) produces the covariance \\(LL^*\\).\n\nSchur decomposition\n\nEvery complex square matrix admits a Schur decomposition \\(A = QTQ^*\\), with \\(Q\\) unitary and \\(T\\) upper triangular. The eigenvalues appear on the diagonal of \\(T\\) in some order. Issai Schur established this result in 1909. Unlike diagonalization, it always exists, because it does not require a complete set of eigenvectors. When \\(A\\) is normal, \\(T\\) is diagonal, which recovers the spectral theorem. For real matrices, the real Schur form uses a real orthogonal \\(Q\\) and a block triangular \\(T\\) whose \\(2\\times 2\\) blocks hold complex conjugate eigenvalue pairs.\n\nSingular value decomposition\n\nEvery \\(m \\times n\\) complex matrix factors as \\(A = U\\Sigma V^*\\), where \\(U\\) and \\(V\\) are unitary and \\(\\Sigma\\) is diagonal with nonnegative entries \\(\\sigma_1 \\ge \\sigma_2 \\ge \\cdots \\ge 0\\), the singular values. These are the square roots of the eigenvalues of \\(A^*A\\), and the number of nonzero singular values equals the rank. Geometrically, \\(V^*\\) rotates or reflects the input, \\(\\Sigma\\) stretches the coordinate axes by the singular values, and \\(U\\) rotates or reflects the result. The unit sphere is thus carried onto an ellipsoid whose semi-axes have lengths \\(\\sigma_i\\).\n\nKeeping the \\(k\\) largest singular values and discarding the rest gives the best rank-\\(k\\) approximation of \\(A\\) in both the spectral and Frobenius norms, a result known as the Eckart–Young–Mirsky theorem. The spectral-norm error of this truncation equals \\(\\sigma_{k+1}\\). Storing the truncated factors requires \\(k(m+n+1)\\) numbers instead of \\(mn\\), which underlies image compression and the dimension reduction used in principal component analysis. Inverting only the nonzero singular values also yields the pseudoinverse, and the ratio \\(\\sigma_1/\\sigma_r\\) gives the condition number of a full-rank matrix in the spectral norm."
    },
    {
      "heading": "Norms, conditioning, and numerical methods",
      "text": "Norms assign a size to matrices. They make it possible to bound errors, to measure how strongly a matrix distorts vectors, and to quantify how sensitive a computed answer is to rounding and to noise in the input data.\n\nMatrix norms\n\nA matrix norm can be built from a vector norm. For an \\(m\\times n\\) matrix \\(A\\), the induced (operator) norm is\n\n\\[\\|A\\| = \\sup_{x\\neq 0}\\frac{\\|Ax\\|}{\\|x\\|} = \\sup_{\\|x\\|=1}\\|Ax\\|.\\]\n\nA matrix norm of this kind can describe how far the operator can stretch vectors. The induced norm is therefore the largest factor by which \\(A\\) lengthens any unit vector. Because it is defined through the supremum, it satisfies \\(\\|Ax\\|\\le\\|A\\|\\,\\|x\\|\\) and the submultiplicative rule \\(\\|AB\\|\\le\\|A\\|\\,\\|B\\|\\). The first of these inequalities follows directly from the definition of an induced norm.\n\nThe most common cases are the 1-norm, which equals the largest absolute column sum; the \\(\\infty\\)-norm, which equals the largest absolute row sum; and the 2-norm, which equals the largest singular value of \\(A\\). The 2-norm is the one usually meant by \"the operator norm\" for Euclidean vectors.\n\nNot every useful matrix norm is induced. The entrywise norms treat an \\(m\\times n\\) matrix as a vector of length \\(mn\\). The Frobenius norm is the most important of them:\n\n\\[\\|A\\|_F = \\sqrt{\\sum_{i,j}|a_{ij}|^2} = \\sqrt{\\operatorname{tr}(A^*A)}.\\]\n\nThe Frobenius norm is not an induced norm; it belongs instead to the family of Schatten norms. The Schatten norms are computed from the singular values of the matrix. Because the entrywise norms treat the matrix as a vector, they are directly tied to the norms of the vector space. For a column or row vector, the Frobenius norm coincides with the ordinary Euclidean length.\n\nCondition number\n\nFor an invertible square matrix, the condition number is\n\n\\[\\kappa(A) = \\|A\\|\\,\\|A^{-1}\\|.\\]\n\nWith the 2-norm, \\(\\kappa_2(A)=\\sigma_{\\max}/\\sigma_{\\min}\\), the ratio of the largest to the smallest singular value. A large condition number means that the solution of a linear system may be highly sensitive to perturbations or errors in the right-hand side. When the condition number is small, the solution changes relatively little when the data changes.\n\nThe quantity is best understood as a worst-case bound. For a perturbed system \\(A(x+\\delta x)=b+\\delta b\\), one has\n\n\\[\\frac{\\|\\delta x\\|}{\\|x\\|}\\le \\kappa(A)\\,\\frac{\\|\\delta b\\|}{\\|b\\|},\\]\n\nso the relative error in the solution can be amplified by up to \\(\\kappa(A)\\). A condition number therefore records the worst-case sensitivity to small perturbations. Perturbation theory also shows that for least-squares problems the sensitivity of some components can be as large as the square of the condition number. For a least-squares problem, the sensitivity of the components depends on the right-hand side and may be as high as the square of the condition number. This is one reason why forming the normal equations, whose coefficient matrix has condition number \\(\\kappa(A)^2\\), is avoided when \\(A\\) is ill-conditioned. The Hilbert matrix is a standard example of rapid growth: its condition number grows very fast as its size increases.\n\nFinite-precision arithmetic and stability\n\nReal computations use floating-point numbers. In IEEE double precision the unit roundoff is \\(u=2^{-53}\\approx 1.1\\times10^{-16}\\), so each arithmetic operation introduces a relative error of about this size. A very large condition number leads to a substantial loss of significant digits in the computed solution. As a rough rule, the relative error of a computed solution can be of order \\(\\kappa(A)\\,u\\), so about \\(\\log_{10}\\kappa(A)\\) decimal digits may be lost.\n\nFor this reason numerical analysis asks for backward stability. An algorithm is backward stable if the computed \\(\\hat x\\) is the exact solution of a nearby problem, \\((A+\\Delta A)\\hat x=b\\), with \\(\\|\\Delta A\\|/\\|A\\|=O(u)\\). Gaussian elimination with partial pivoting, which underlies LU decomposition, is backward stable in practice. Pivoting keeps the multipliers small and limits the growth of entries, which would otherwise magnify rounding errors. Methods that form \\(A^{*}A\\) or that use explicit inverses are generally less accurate than factorizations applied directly to \\(A\\).\n\nIterative methods for large sparse systems\n\nMany systems from discretized partial differential equations or large optimization problems have very large dimension but only a few nonzero entries per row, which is the setting of sparse matrices. Iterative algorithms are suited to sparse systems that are too large for direct methods such as Cholesky factorization. Factorizations can create fill-in, destroying sparsity and memory efficiency, so iterative solvers are often preferred.\n\nKrylov subspace methods form one major family. They access the matrix only through matrix-vector products and work with the resulting vectors. The method thus can avoid storing matrix factors, and it can exploit sparsity to reduce storage and computation. At step \\(k\\), the iterate is chosen from the Krylov subspace \\(\\mathcal K_k(A,r_0)=\\operatorname{span}\\{r_0,Ar_0,\\dots,A^{k-1}r_0\\}\\), where \\(r_0\\) is the initial residual. At each iteration, the best linear combination of the Krylov basis vectors is chosen to form an improved solution.\n\nThe conjugate gradient method is the classic choice when \\(A\\) is real, symmetric and positive definite. In that case the method enforces that the residual is orthogonal to the Krylov subspace, which yields short recurrences and low memory use. Its error after \\(k\\) steps is bounded in terms of the condition number, roughly\n\n\\[\\|x_k-x^*\\|_A\\le 2\\left(\\frac{\\sqrt{\\kappa}-1}{\\sqrt{\\kappa}+1}\\right)^{k}\\|x_0-x^*\\|_A,\\]\n\nwhere \\(\\|v\\|_A^2=v^{T}Av\\). Here \\(\\kappa=\\kappa_2(A)\\) is the ratio of the largest to the smallest eigenvalue. Convergence is therefore fast when \\(\\kappa\\) is close to 1 and slow when \\(\\kappa\\) is large. This motivates preconditioning, in which the system is transformed into one with a more favorable spectrum. For nonsymmetric matrices, GMRES chooses the iterate so that the residual norm is minimized over the Krylov subspace. BiCGSTAB is applicable to nonsymmetric matrices, and it does not require the transpose of \\(A\\)."
    },
    {
      "heading": "Algebraic structure",
      "text": "For a fixed size \\(n\\) and a field \\(F\\), the set \\(M_n(F)\\) of all \\(n\\times n\\) matrices with entries in \\(F\\) is a ring under entrywise addition and matrix multiplication. Its zero element is the zero matrix and its identity element is the identity matrix \\(I_n\\). Because it is closed under both operations and satisfies the associativity and distributive laws, \\(M_n(F)\\) is a unital associative F-algebra of dimension \\(n^2\\), with the matrix units \\(E_{ij}\\) as a basis. This makes it one of the basic examples in ring theory and in abstract-algebra.\n\nNoncommutativity and zero divisors\n\nFor \\(n=1\\) the ring is just \\(F\\) itself and is commutative. For \\(n\\ge 2\\) multiplication is never commutative in general. Take \\(A=E_{12}\\) and \\(B=E_{21}\\). Then \\(AB=E_{11}\\) and \\(BA=E_{22}\\), which are different. The same example shows that zero divisors exist: \\(E_{11}E_{22}=0\\) although neither factor is zero. Over a field, the left and right zero divisors coincide, and they are exactly the singular matrices, that is, those with determinant zero. Units (two-sided invertible elements) are exactly the matrices with nonzero determinant. Since a nonzero singular matrix exists whenever \\(n\\ge 2\\), the ring is never a domain in that case.\n\nNilpotent elements\n\nA matrix \\(N\\) is nilpotent if \\(N^k=0\\) for some positive integer \\(k\\). For \\(n\\times n\\) matrices, \\(N^n=0\\) whenever \\(N\\) is nilpotent, a consequence of the Cayley–Hamilton theorem. Strictly upper triangular matrices are the standard examples: \\(E_{12}\\) satisfies \\(E_{12}^2=0\\). Every nonzero nilpotent matrix is a zero divisor, since if \\(N^k=0\\) with \\(k\\) minimal, then \\(N\\cdot N^{k-1}=0\\) with both factors nonzero. The nilpotent matrices do not form a subring with identity, and the ring \\(M_n(F)\\) is semisimple, so its Jacobson radical is zero. Nilpotent elements therefore do not contribute to a radical in this ring, although they are central to the study of its non-semisimple subalgebras.\n\nThe general linear group and its subgroups\n\nThe units of \\(M_n(F)\\) form the multiplicative group \\(GL_n(F)\\) of invertible matrices, called the general linear group. Its center consists of the scalar matrices \\(\\lambda I_n\\) with \\(\\lambda\\ne 0\\). The determinant is a group homomorphism \\(\\det: GL_n(F)\\to F^\\times\\), and its kernel is the special linear group \\(SL_n(F)\\) of matrices with determinant one, a normal subgroup. Over the real or complex numbers, the orthogonal group \\(O(n)\\) consists of matrices satisfying \\(A^{\\mathsf T}A=I\\), and the unitary group \\(U(n)\\) consists of matrices satisfying \\(A^{*}A=I\\). Their intersections with the determinant-one condition give \\(SO(n)\\) and \\(SU(n)\\). Other important subgroups include the upper triangular matrices in \\(GL_n(F)\\), which form a solvable subgroup, and the permutation matrices, which form a finite subgroup. Over \\(\\mathbb{R}\\) or \\(\\mathbb{C}\\), these groups are Lie groups, and their tangent spaces at the identity are matrix Lie algebras such as \\(\\mathfrak{gl}_n\\) and \\(\\mathfrak{sl}_n\\).\n\nRepresentations of groups and algebras\n\nA linear representation of a group \\(G\\) of degree \\(n\\) over \\(F\\) is a group homomorphism \\(\\rho: G\\to GL_n(F)\\). An algebra representation of an \\(F\\)-algebra \\(A\\) is an algebra homomorphism \\(A\\to M_n(F)\\). Choosing a basis of an \\(n\\)-dimensional vector space identifies linear operators with matrices, and changing basis replaces \\(\\rho\\) by \\(S\\rho S^{-1}\\) for some invertible \\(S\\). Thus the study of representations reduces to the study of matrix-valued homomorphisms up to this equivalence. This viewpoint underlies representation-theory, where the Artin–Wedderburn theorem describes semisimple algebras as products of matrix rings over division rings, and where matrix groups serve as the basic examples of symmetry groups in physics.\n\nThe trace as a linear functional\n\nThe trace \\(\\operatorname{tr}: M_n(F)\\to F\\), the sum of the diagonal entries, is a linear functional. It satisfies \\(\\operatorname{tr}(AB)=\\operatorname{tr}(BA)\\), and as a consequence it is invariant under similarity: \\(\\operatorname{tr}(S^{-1}AS)=\\operatorname{tr}(A)\\). Over an algebraically closed field, the trace equals the sum of the eigenvalues counted with algebraic multiplicity, which links it to the spectrum of a matrix. The trace is not multiplicative, so it is not a ring homomorphism, but its kernel is a Lie subalgebra \\(\\mathfrak{sl}_n\\) of codimension one, since the commutator of two matrices always has trace zero."
    },
    {
      "heading": "Computational complexity of matrix multiplication",
      "text": "The naive algorithm\n\nComputing \\(C = AB\\) for two \\(n \\times n\\) matrices directly from the definition, where each entry is \\(c_{ij} = \\sum_k a_{ik} b_{kj}\\), needs \\(n^3\\) scalar multiplications and \\(n^3 - n^2\\) additions, or \\(2n^3 - n^2\\) scalar operations in total. The cost therefore grows as \\(O(n^3)\\). For rectangular matrices of sizes \\(m \\times k\\) and \\(k \\times n\\), the count of multiplications is \\(mkn\\). Gaussian elimination, the standard method for solving linear systems and computing determinants, has the same cubic cost, and until the late 1960s the cubic exponent was widely assumed to be the true cost of the problem.\n\nStrassen's algorithm\n\nIn 1969 Volker Strassen showed that the product of two \\(2 \\times 2\\) block matrices can be formed with seven block multiplications instead of eight, at the price of extra block additions. Because the formulas use only ring operations, they remain valid when the blocks are themselves matrices, and they can be applied recursively to matrices whose size is a power of two. Matrices of other sizes are padded with zeros. The recurrence \\(T(n) = 7T(n/2) + O(n^2)\\) yields a cost of \\(O(n^{\\log_2 7}) \\approx O(n^{2.807})\\). The exact scalar operation count is smaller than the naive count only above a crossover size, which is roughly 654 by one published count. Winograd later showed that seven multiplications is optimal for \\(2 \\times 2\\) matrices, although his variant uses fewer additions than Strassen's.\n\nThe exponent ω and later improvements\n\nThe exponent of matrix multiplication, usually written \\(\\omega\\), is the infimum of the exponents \\(c\\) for which \\(n \\times n\\) matrices can be multiplied in \\(O(n^{c+o(1)})\\) arithmetic operations. Strassen's result gave \\(\\omega \\le \\log_2 7\\). Through the late 1970s and 1980s, researchers including Pan, Bini, Schönhage, Romani and Strassen himself lowered the bound step by step, reaching about 2.497 in 1986. In 1990 Coppersmith and Winograd obtained about 2.376 by analysing powers of a particular tensor, and this bound stood for roughly two decades.\n\nFrom 2014 onward the gains came from refinements of the \"laser method\" of Strassen, which analyse powers of the Coppersmith–Winograd tensor and compensate for losses when the pieces are combined. Reported bounds fell to about 2.3729 in 2014 and 2020, to about 2.371866 in 2023 (Duan, Wu and Zhou), to 2.371552 in 2024 (Vassilevska Williams, Xu, Xu and Zhou), and to 2.371339 in a later 2024 paper by Alman and coauthors. A 2026 preprint reports \\(\\omega < 2.371177\\) by extending the same analysis to a deeper recursion level. Over the 35 years after 1990 the bound changed only slightly, which is why the improvements are described as incremental. Most of the constants involved are very large, so these algorithms are not used in practice.\n\nLower bounds and open questions\n\nThe only general lower bound is \\(\\omega \\ge 2\\), which holds simply because the output has \\(n^2\\) entries that must each be written. No larger unconditional lower bound on \\(\\omega\\) is known, and many researchers conjecture that \\(\\omega = 2\\). Several papers show that the laser method applied to the Coppersmith–Winograd tensor cannot prove \\(\\omega < 2.3078\\), and more general barriers suggest that a wide class of known techniques cannot reach \\(\\omega = 2\\). Concrete lower bounds exist for restricted models. For example, computing the product of two \\(n \\times n\\) matrices over the binary field requires at least about \\(2.5n^2\\) multiplications. These bounds concern the number of multiplications in particular models, not the exponent itself. Whether quadratic-time matrix multiplication is achievable therefore remains open.\n\nPractical performance\n\nAsymptotic gains come at a cost. Strassen-type recursion needs extra memory, adds additions that can reduce numerical stability, and performs poorly on small blocks. For this reason, high-performance libraries normally use a blocked cubic algorithm tuned to cache hierarchies and to parallel hardware such as the graphics processing units used in deep-learning. Strassen-type recursion is typically applied only above a cutoff size. Algorithms with exponents below 2.81 are described in the literature as almost never implemented, and when they are compared in practice, Strassen's \\(2 \\times 2\\) scheme often remains the favoured choice.\n\nRelation to other linear algebra tasks\n\nThe cost of matrix multiplication sets the cost of many other operations. Strassen's 1969 work already gave a block formula for inversion whose cost is of the same order as multiplication, and later results showed that the determinant, the matrix inverse, LU decomposition and the solution of linear systems can all be computed in \\(O(n^{\\omega+o(1)})\\) operations. The reverse reductions also hold for many of these tasks, so that they have essentially the same exponent as multiplication. Since \\(\\omega\\) is at most 2.38 for every known method, all these problems are asymptotically faster than the cubic Gaussian elimination. Matrix-based methods such as QR decomposition and singular value decomposition are more involved, and their exact complexity depends on the algorithm and on the required accuracy."
    },
    {
      "heading": "History",
      "text": "Early elimination methods in China\n\nThe earliest systematic procedures for simultaneous linear equations come from ancient China. The Nine Chapters on the Mathematical Art is usually dated to around the first century BCE, and its compilers are anonymous. The chapter on Fangcheng includes 18 practical problems, such as determining yields from mixed bundles of rice or prices of livestock. Chapter 7, \"Excess and Deficit,\" handles two-unknown linear problems by a principle that Western authors later called false position. Each of the 18 problems in the Fangcheng chapter reduces to solving a system of simultaneous linear equations.\n\nThe method was carried out on a counting board. Coefficients and constants were arranged into a rectangular array, with each row representing an equation and the columns corresponding to the variables plus the right-hand side. Elimination then proceeded by manipulating these columns, and the procedure is often compared with the elimination later associated with Gauss. Systems of linear equations were solved by a principle similar to Gaussian elimination. Historians disagree about how much the text advanced beyond existing practice. An older consensus saw little development beyond the basic technique, while more recent re-examinations of the reconstructed text point to refinements inherited from the earlier Book of Computation. The previous consensus of historians of Chinese mathematics suggests that the Nine Chapters showed little development beyond the initial practice of fangcheng, however a closer examination of the extant source outlines comparable developments.\n\nDeterminants and linear systems in Europe\n\nIn Europe, determinants appeared in the late seventeenth century. In a 1693 letter to Guillaume de l'Hôpital, Leibniz stated the compatibility condition for three linear equations in two unknowns, which is a determinant condition. He stressed the usefulness of two indices when writing the coefficients of the equations. He also knew that a determinant could be expanded along any column, a result now called Laplace expansion. He also knew that a determinant could be expanded using any column. Dating his discoveries is itself contested. One account states that this method for solving systems of linear equations based on determinants was found in 1684 by Leibniz, while Gabriel Cramer published his findings in 1750.\n\nDeterminant ideas also arose independently in Japan. Seki Takakazu arrived at the notion of a determinant while solving the problem of finding common roots of algebraic equations. In print, the early European results came from Scottish mathematician Colin Maclaurin. His Treatise of Algebra appeared only in 1748, after his death, and it contains the first published results on determinants, proving Cramer's rule for 2 × 2 and 3 × 3 systems and indicating how the 4 × 4 case would work. Cramer then gave the general rule for n×n systems in his 1750 work on algebraic curves. The rule is named after him, as he introduced it in 1750 in Introduction à l'Analyse des lignes Courbes algébriques.\n\nMatrices as objects in the nineteenth century\n\nThe word \"matrix\" was introduced in the 1850s by James Joseph Sylvester. Sources differ on the exact year, giving 1848, 1850, or 1851. Sylvester defined a matrix as an oblong arrangement of terms, and he regarded it as the source of various determinants taken from square arrays within it. Arthur Cayley then turned arrays of numbers into objects with their own algebra. By 1853 Cayley had published a note giving, for the first time, the inverse of a matrix. His 1858 memoir is the best-known landmark. In that memoir he introduced the term \"matrix\" for a square array of numbers and observed that such arrays could be added and multiplied to form what is now called a linear associative algebra. Cayley also showed that earlier coefficient arrays from quadratic forms and linear transformations were special cases of the general concept.\n\nThe memoir was not an immediate success. Cayley's celebrated memoir went generally unnoticed, especially outside England, until the 1880s. Cayley verified the Cayley–Hamilton theorem for 2 × 2 matrices and stated it for 3 × 3 matrices, and Frobenius later attributed the general result to Cayley, although Frobenius had been the first to prove the general theorem. Frobenius also adopted the term \"matrix\" only after he became aware of Cayley's memoir in 1896. Earlier, Cauchy had shown that real symmetric matrices have real eigenvalues. Cauchy's 1829 memoir provided the first general proof that the eigenvalues of a symmetric matrix are real. German algebraists such as Weierstrass, Kronecker, and Frobenius then developed canonical forms for bilinear forms and matrix pencils.\n\nAxiomatic and abstract linear algebra in the twentieth century\n\nEarly in the twentieth century, linear algebra shifted from concrete arrays toward abstract vector spaces over arbitrary fields. Earlier steps included Hermann Grassmann's Ausdehnungslehre (1844) and Giuseppe Peano's axiomatic definition of vector spaces in 1888. David Hilbert's work on integral equations between about 1904 and 1910 introduced infinite-dimensional spaces, where operators need not be finite matrices. This work was followed by contributions from Erhard Schmidt and Frigyes Riesz. Hilbert's broader commitment to the axiomatic method, shown in his Grundlagen der Geometrie (1899), shaped how these ideas were presented. In the 1920s and early 1930s, John von Neumann supplied the abstract axiomatic definition of the spaces now called Hilbert spaces and used them to formulate quantum mechanics. Stefan Banach's work on normed spaces ran in parallel. Textbooks such as van der Waerden's Moderne Algebra presented vector spaces in an abstract algebraic form, and this viewpoint became the standard approach to linear-algebra and functional-analysis."
    },
    {
      "heading": "Applications in physics",
      "text": "Matrices entered physics in 1925, when Werner Heisenberg, Max Born, and Pascual Jordan reformulated quantum theory in matrix language. Matrix mechanics is a formulation of quantum mechanics created by Werner Heisenberg, Max Born, and Pascual Jordan in 1925. Born and Jordan saw that the quantities Heisenberg had been manipulating followed the multiplication rules of matrix algebra, which made noncommutativity a central feature of the theory. Born, Heisenberg, and Jordan then took Hermitian matrices as the mathematical stand-ins for measurable quantities. The reason is that a Hermitian operator's expectation values are real, so all physical observables are associated with Hermitian operators. The eigenvalues of such an operator are real and are read as possible measurement outcomes, while its eigenvectors describe the corresponding states.\n\nMatrix mechanics and the Schrödinger picture were later shown to be equivalent. In a fixed basis, the state of a system is a column vector of complex amplitudes, the Hamiltonian is a Hermitian matrix, and the time-dependent Schrödinger equation becomes a linear system of first-order differential equations for those amplitudes. Its formal solution is generated by the matrix exponential of the Hamiltonian multiplied by \\(-i t/\\hbar\\). That propagator is unitary, which is why it preserves the norm of the state and therefore total probability. Diagonalizing the Hamiltonian, as described in the eigenvalue section, gives the energy levels and stationary states directly.\n\nThe Pauli matrices are the simplest nontrivial example. They are three \\(2\\times 2\\) complex matrices, \\(\\sigma_x\\), \\(\\sigma_y\\), and \\(\\sigma_z\\), which together with the identity form a basis for the \\(2\\times 2\\) Hermitian matrices. The Pauli matrices are traceless, each of them squares to the identity matrix, and their determinants are −1. Because they square to the identity, their eigenvalues can only be \\(\\pm 1\\). For a spin-½ particle, the spin operator is written as \\(\\mathbf{S}=\\tfrac{\\hbar}{2}\\boldsymbol{\\sigma}\\), so the measurable spin components along each axis take the values \\(\\pm\\hbar/2\\). Rotations of a spin-½ state are generated by the same matrices. The rotation operator \\(\\exp(-i\\theta\\,\\mathbf{n}\\cdot\\boldsymbol{\\sigma}/2)\\) lies in the group SU(2), which double-covers the group of ordinary three-dimensional rotations, SO(3). This is why a spinor returns to its original state only after a \\(720^\\circ\\) turn, a fact noted for spin-½ particles. Ordinary rotations of spatial vectors, by contrast, are represented by \\(3\\times 3\\) orthogonal matrices with determinant one.\n\nThe density matrix generalizes the state vector to mixed states. If a system is in state \\(|\\psi_i\\rangle\\) with probability \\(p_i\\), then \\(\\rho=\\sum_i p_i\\,|\\psi_i\\rangle\\langle\\psi_i|\\). In general, a density matrix is a Hermitian, positive semi-definite, trace-1 matrix. A pure state gives \\(\\operatorname{tr}\\rho^2=1\\), whereas for a mixed state the purity \\(\\operatorname{tr}\\rho^2\\) is strictly less than one, so the purity distinguishes the two cases. Two different ensembles of states can have identical density matrices, and therefore quantum mechanically represent identical states. The maximally mixed state of a \\(d\\)-level system is \\(\\rho=I/d\\). For a qubit, every density matrix can be written as a combination of the identity and the Pauli matrices, and the admissible coordinates fill the unit ball, the Bloch ball, whose surface holds the pure states. In quantum information, density matrices are needed when a subsystem is entangled with another system, or when a system is open and interacts with its environment, which causes decoherence. In those cases the state of the subsystem cannot be described by a single state vector.\n\nGeneral relativity uses matrix-like arrays in a more structured way. In four-dimensional spacetime, the metric tensor \\(g_{\\mu\\nu}\\) has at each point ten independent components, which form a symmetric \\(4\\times 4\\) array. It defines the spacetime interval through \\(ds^2=g_{\\mu\\nu}\\,dx^\\mu dx^\\nu\\), using the Einstein summation convention. In flat spacetime in Cartesian coordinates it reduces to the Minkowski metric \\(\\operatorname{diag}(-1,1,1,1)\\), a Lorentzian signature that defines the light cone. The inverse matrix \\(g^{\\mu\\nu}\\) raises indices, and its determinant enters the invariant volume element \\(\\sqrt{-g}\\,d^4x\\). The Einstein field equations relate the Einstein tensor, built from the metric and its derivatives, to the stress-energy tensor, and both sides are symmetric \\(4\\times 4\\) component arrays. The matrix of components is not itself a geometric object, however. Under a change of coordinates it transforms through the Jacobian matrix of the coordinate map, so the coordinate-independent content lies in the tensor as a whole."
    },
    {
      "heading": "Applications in statistics and data analysis",
      "text": "Multivariate statistics is built on matrices. Each observation is a vector of measurements, and a data set is an array with one row per observation. Several central objects in the field are matrices with specific algebraic properties.\n\nCovariance matrix\n\nFor a random vector \\(X=(X_1,\\dots,X_n)^{\\mathsf T}\\) with mean vector \\(\\mu\\), the covariance matrix is \\(\\Sigma=\\mathbb E[(X-\\mu)(X-\\mu)^{\\mathsf T}]\\). Its \\((i,j)\\) entry is \\(\\operatorname{Cov}(X_i,X_j)\\), so the diagonal holds the variances. The matrix is symmetric, and for any fixed vector \\(a\\) the quadratic form \\(a^{\\mathsf T}\\Sigma a\\) equals \\(\\operatorname{Var}(a^{\\mathsf T}X)\\), which is nonnegative. Hence \\(\\Sigma\\) is positive semidefinite, and it is positive definite when no nonzero linear combination of the components is almost surely constant. An affine transformation \\(Y=AX+b\\) acts on the matrix in a simple way: the covariance of \\(Y\\) is \\(A\\Sigma A^{\\mathsf T}\\). The spectral theorem gives \\(\\Sigma=Q\\Lambda Q^{\\mathsf T}\\) with orthogonal \\(Q\\) and nonnegative diagonal \\(\\Lambda\\), so the eigenvalues are the variances along the principal axes of the distribution. The density of a multivariate normal distribution is written with \\(\\Sigma^{-1}\\) and \\(\\det\\Sigma\\).\n\nFor a data matrix \\(X\\in\\mathbb R^{n\\times p}\\), subtracting each column's mean yields a centered matrix \\(X_c\\), and the sample covariance matrix is \\(S=\\frac{1}{n-1}X_c^{\\mathsf T}X_c\\). Scaling each entry by the product of the corresponding standard deviations produces the correlation matrix, which has ones on its diagonal.\n\nLeast squares in matrix form\n\nA linear model writes the response vector as \\(y=X\\beta+\\varepsilon\\), where \\(X\\in\\mathbb R^{n\\times p}\\) is the design matrix. Ordinary least squares chooses \\(\\beta\\) to minimize \\(\\|y-X\\beta\\|^2\\). Setting the gradient to zero gives the normal equations\n\n\\[X^{\\mathsf T}X\\,\\hat\\beta = X^{\\mathsf T}y.\\]\n\nWhen \\(X\\) has full column rank, \\(X^{\\mathsf T}X\\) is invertible and \\(\\hat\\beta=(X^{\\mathsf T}X)^{-1}X^{\\mathsf T}y\\). The matrix \\(X^{\\mathsf T}X\\) is the Gram matrix of the columns of \\(X\\). The fitted values are \\(\\hat y=Hy\\), where \\(H=X(X^{\\mathsf T}X)^{-1}X^{\\mathsf T}\\) projects orthogonally onto the column space of \\(X\\). If the errors have covariance \\(\\sigma^2 I\\), then \\(\\operatorname{Cov}(\\hat\\beta)=\\sigma^2(X^{\\mathsf T}X)^{-1}\\).\n\nForming \\(X^{\\mathsf T}X\\) explicitly squares the condition number of \\(X\\), so numerical software usually relies on QR decomposition or the singular value decomposition instead of inverting the normal matrix. Ridge regression modifies the system to \\((X^{\\mathsf T}X+\\lambda I)\\beta=X^{\\mathsf T}y\\), which remains invertible for \\(\\lambda>0\\) even when \\(X\\) is rank-deficient.\n\nPrincipal component analysis\n\nPrincipal component analysis finds orthogonal directions along which the centered data have the greatest variance. Eigendecomposing \\(S=V\\Lambda V^{\\mathsf T}\\) gives the principal directions as the columns of \\(V\\). Each eigenvalue \\(\\lambda_k\\) is the variance along its direction, and \\(\\lambda_k/\\sum_j\\lambda_j\\) is the share of total variance it explains. Projecting the data onto the leading \\(k\\) directions gives the scores \\(X_cV_k\\).\n\nThe same result follows from the SVD \\(X_c=U\\Sigma V^{\\mathsf T}\\), where \\(\\lambda_k=\\sigma_k^2/(n-1)\\). This route avoids forming \\(X_c^{\\mathsf T}X_c\\) and is therefore the preferred numerical method. Keeping only the largest singular values gives the best rank-\\(k\\) approximation of \\(X_c\\) in the Frobenius and spectral norms (Eckart–Young theorem), which underlies dimension reduction and data compression.\n\nDesign matrices\n\nA design matrix encodes an experimental or observational setup. Each row corresponds to a run or subject, and each column to a regressor, which may be a continuous covariate, an indicator for a factor level, or an interaction term. In a one-way analysis of variance with three groups, for instance, the columns can be an intercept and two 0/1 indicators. Other coding schemes change the meaning of the coefficients without changing the fitted values. Full column rank is needed for every coefficient to be estimable, and a rank deficiency, such as an intercept together with indicators for all levels, signals aliasing or collinearity.\n\nBecause the covariance of the estimates is proportional to \\((X^{\\mathsf T}X)^{-1}\\), design criteria act on this matrix. D-optimality maximizes \\(\\det(X^{\\mathsf T}X)\\), which minimizes the volume of the confidence ellipsoid for the coefficients. A-optimality minimizes \\(\\operatorname{tr}\\bigl((X^{\\mathsf T}X)^{-1}\\bigr)\\), the sum of the coefficient variances. Orthogonal designs make \\(X^{\\mathsf T}X\\) diagonal, so the estimated coefficients are uncorrelated. In multivariate analysis the model becomes \\(Y=XB+E\\), where \\(Y\\) is an \\(n\\times m\\) response matrix. The same design matrix serves every response column, so \\(\\hat B=(X^{\\mathsf T}X)^{-1}X^{\\mathsf T}Y\\), and the design's structure shapes all outcomes at once, as in multivariate analysis of variance."
    },
    {
      "heading": "Machine learning and neural networks",
      "text": "In a feedforward neural network, the basic computation of a layer is a matrix-vector product followed by a nonlinear activation. If a layer takes an input \\(x\\in\\mathbb{R}^n\\) and produces \\(m\\) outputs, its parameters are a weight matrix \\(W\\in\\mathbb{R}^{m\\times n}\\) and a bias vector \\(b\\in\\mathbb{R}^m\\), and its output is \\(y=\\sigma(Wx+b)\\). The function \\(\\sigma\\), such as ReLU, sigmoid or tanh, acts entrywise. Stacking layers composes these maps. Without the nonlinearity, the composition would collapse into a single affine map, since a product of matrices is again a matrix. The activation is therefore what gives depth its expressive effect.\n\nTraining and inference process many inputs at once. If a batch of \\(B\\) input vectors is stored as the columns of \\(X\\in\\mathbb{R}^{n\\times B}\\), the whole layer becomes one matrix-matrix product, \\(\\sigma(WX+b\\mathbf{1}^{\\mathsf T})\\). Multiplying two \\(n\\times n\\) matrices takes about \\(2n^3\\) floating-point operations but reads and writes only about \\(3n^2\\) numbers, so the ratio of arithmetic to memory traffic grows with size. This regularity suits hardware. Graphics processing units contain thousands of simple cores that run the same operation on different data, and dedicated matrix units, such as NVIDIA's Tensor Cores, multiply small blocks at reduced precision (for example FP16 or BF16). These designs execute large matrix products far faster than sequential processors. As a result, the cost of parallel matrix multiplication strongly shapes model design, including layer widths and batch sizes, which are often chosen to fit hardware-friendly block sizes.\n\nIn transformer models, self-attention relies on several learned matrices. For a sequence of \\(T\\) token vectors stored as the rows of \\(X\\in\\mathbb{R}^{T\\times d}\\), the model forms \\(Q=XW_Q\\), \\(K=XW_K\\) and \\(V=XW_V\\), where \\(W_Q,W_K\\in\\mathbb{R}^{d\\times d_k}\\) and \\(W_V\\in\\mathbb{R}^{d\\times d_v}\\) are trained. It then computes\n\n\\[\\operatorname{Attention}(Q,K,V)=\\operatorname{softmax}\\!\\left(\\frac{QK^{\\mathsf T}}{\\sqrt{d_k}}\\right)V.\\]\n\nThe \\(T\\times T\\) matrix \\(QK^{\\mathsf T}\\) holds pairwise similarity scores between tokens, and the row-wise softmax converts each row into nonnegative weights that sum to one. Multi-head attention runs several such sets of projections in parallel and combines their outputs through a further learned matrix. The input vocabulary is handled by an embedding matrix \\(E\\in\\mathbb{R}^{V\\times d}\\), where \\(V\\) is the vocabulary size and each row is the learned vector for one token. Multiplying a one-hot row vector by \\(E\\) selects a single row, so the lookup is a matrix product in principle, though it is implemented as indexing. Some models reuse this matrix, transposed, as the output projection.\n\nTraining relies on matrix calculus. Consider a layer with \\(z=Wx+b\\), \\(a=\\sigma(z)\\) and a scalar loss \\(L\\), and suppose the gradient \\(\\delta=\\partial L/\\partial z\\) has already been obtained from the layers above by the backpropagation procedure. The chain rule gives \\(\\partial L/\\partial W=\\delta x^{\\mathsf T}\\), an outer product with the same shape as \\(W\\), and \\(\\partial L/\\partial b=\\delta\\). The gradient passed to the previous layer is \\(\\partial L/\\partial x=W^{\\mathsf T}\\delta\\), so the transpose of each weight matrix appears in the backward pass. Here \\(\\delta\\) is computed from the gradient with respect to \\(a\\) by an entrywise product with \\(\\sigma'(z)\\). For a batch, the weight gradient becomes a single product of the matrix of \\(\\delta\\) vectors with \\(X^{\\mathsf T}\\), averaged over the batch.\n\nThe same objects describe the geometry of optimization. For a vector-valued function \\(f:\\mathbb{R}^n\\to\\mathbb{R}^m\\), the Jacobian \\(J\\in\\mathbb{R}^{m\\times n}\\) has entries \\(J_{ij}=\\partial f_i/\\partial x_j\\), and the chain rule for composed layers becomes a product of Jacobians. For a scalar loss \\(f\\), the Hessian \\(H_{ij}=\\partial^2 f/\\partial x_i\\partial x_j\\) is symmetric when the second derivatives are continuous. At a critical point, a positive definite Hessian indicates a local minimum. The spread of its eigenvalues, measured by the condition number, governs how slowly gradient descent converges along poorly scaled directions. A network with \\(n\\) parameters has an \\(n\\times n\\) Hessian, which is too large to form for modern models, so practical methods use diagonal or low-rank approximations, Hessian-vector products, or Krylov-type iterations."
    },
    {
      "heading": "Economics, graph theory, and other fields",
      "text": "A graph with n vertices is commonly encoded as an n×n matrix of zeros and ones. The (i,j) entry of this adjacency matrix is 1 if there is an edge from vertex vᵢ to vertex vⱼ and 0 otherwise. For simple graphs every entry is 0 or 1, and for undirected graphs the matrix is symmetric, while in directed graphs row sums give out-degrees and column sums give in-degrees. The main use of this encoding is that matrix powers count paths. The (u,v) entry of Aⁿ equals the number of walks of length n from u to v. The reason is that each product of entries along a sequence of edges contributes one walk, and matrix multiplication sums these contributions over all intermediate vertices. Two consequences follow directly. The distance between two vertices is the smallest nonnegative integer n for which the (i,j) entry of Aⁿ is positive. Also, for an undirected simple graph, the number of triangles equals the trace of A³ divided by 6, the division correcting for the six orderings in which each triangle can be traversed. An incidence matrix, with vertices as rows and edges as columns, plays a complementary role; its product with its own transpose gives the degree matrix plus the adjacency matrix in the unsigned case.\n\nA Markov chain with finitely many states is described by a transition matrix P whose entries are probabilities. The rows of the matrix represent the current state, while the columns represent the next state. Because each row describes a complete set of outgoing probabilities, each row sums to 1. A stationary distribution is a probability row vector π that is unchanged by one step of the chain, so that π = πP. Equivalently, π is a left eigenvector of P with eigenvalue 1, which is why the computation reduces to linear algebra. Existence is guaranteed for finite chains: every finite Markov chain has at least one stationary distribution, but it may not be unique. Uniqueness holds under stronger hypotheses; any irreducible and aperiodic Markov chain has exactly one stationary distribution. In that case the powers of the transition matrix stabilize, and the matrix Pⁿ converges to a matrix whose rows are all equal to π. In a weather model with sunny, cloudy and rainy states, for example, the long-run frequencies of the three states are the entries of π, regardless of the starting state.\n\nThe Leontief input-output model is an early large-scale application of matrices in economics. Wassily Leontief developed the model in 1941 in the field of econometrics, and in 1973 Leontief earned the Nobel Prize in economics for his work on the input-output model. The economy is divided into sectors, and the technical coefficients matrix A has entries where each entry aᵢⱼ measures the dollars of input from industry i needed to produce one dollar of output in industry j. If x is the vector of total outputs and f is the vector of final demand, the balance condition reads x = Ax + f, which gives x = (I−A)⁻¹f. The matrix (I−A)⁻¹ is the Leontief inverse, and its entries capture both direct and indirect requirements, since each entry gives the total output of industry i required, directly and indirectly, to deliver one dollar of final demand for industry j's product. This makes it possible to ask questions such as how much steel is embedded in a car, or how a tariff on one sector propagates to others. The model comes in an open form, in which some production is consumed internally and the rest goes to external demand, and a closed form, in which the entire production is consumed by industries.\n\nMatrices are also central to information and geometric technologies. In cryptography, the Hill cipher of 1929 encodes blocks of letters as vectors and multiplies them by an invertible key matrix modulo the alphabet size, so decryption requires the key's inverse modulo that size. In coding theory, a linear error-correcting code over a finite field is specified by a generator matrix G, whose rows span the code, and a parity-check matrix H, where a vector c is a codeword exactly when Hcᵀ = 0. The Hamming code of length 7 uses such matrices to detect and correct any single bit error. In computer graphics, rotations and scalings of two- and three-dimensional points are represented by matrices, and sequences of transformations are composed by matrix multiplication. Because matrix multiplication is not commutative, the order of the transformations matters, and translations are usually incorporated through 4×4 homogeneous-coordinate matrices so that all transformations can be combined the same way."
    },
    {
      "heading": "Generalizations",
      "text": "Tensors\n\nA tensor of order \\(k\\) with dimensions \\(n_1,\\ldots,n_k\\) can be modeled as a function from the product of index sets \\([n_1]\\times\\cdots\\times[n_k]\\) into a field \\(\\mathbb{K}\\), so every entry is addressed by a \\(k\\)-tuple of indices. The number of entries of such a tensor is the product of its dimensions. Scalars, vectors, and matrices are the cases of order 0, 1, and 2. In the matrix case the two directions of the array, rows and columns, are called modes, and the number of modes gives the order.\n\nThe natural analogue of matrix multiplication for higher-order arrays is tensor contraction. Two tensors are contracted along one index from each, provided those indices have the same length, and the result sums the product over that shared index. The order of the result of a contraction is \\(m+n-2\\), where \\(m\\) and \\(n\\) are the orders of the inputs. Contraction is therefore a direct generalization of the matrix product: when both operands are matrices, the contraction is the ordinary matrix product. Two broad types are distinguished: an \"external\" contraction between two tensors, which extends the dot product, and an \"internal\" contraction within a single tensor, which extends the trace.\n\nA second product, the tensor product, combines two arrays without summing over indices. Applied to an \\(n_1\\times n_2\\) matrix and an \\(m_1\\times m_2\\) matrix, it produces an \\((n_1m_1)\\times(n_2m_2)\\) block array in which each entry of the first matrix scales a full copy of the second. Tensor contractions and products are central in multilinear algebra, in the study of tensor networks, and in computations with index notation.\n\nInfinite matrices and operators on Hilbert spaces\n\nThe matrix viewpoint extends to infinite index sets. Continuous linear functions on a Hilbert space are described by infinite matrices, in the same way that linear transformations on \\(\\mathbb{C}^n\\) are represented by finite matrices. Once an orthonormal basis is chosen, the operator acts by the infinite analogue of the usual sum, \\(y_i=\\sum_j a_{ij}x_j\\), and the matrix determines the operator uniquely. Boundedness is the decisive condition: an operator between Hilbert spaces is continuous exactly when it is bounded.\n\nConcrete examples show how subtle the infinite case is. The Hilbert matrix, with entries \\(1/(i+j+1)\\), acts as a bounded operator on \\(\\ell^2\\), but it is not a compact operator. Its operator norm on \\(\\ell^p\\) is known in closed form, \\(\\pi/\\sin(\\pi/p)\\) for \\(1<p<\\infty\\). Computing with such matrices is harder than in the finite case, because products and actions involve infinite series that can rarely be evaluated explicitly. Moreover, the conjugate-transpose recipe for the adjoint does not automatically yield a bounded, everywhere defined operator, so the adjoint is usually defined abstractly through the inner product instead.\n\nMatrices over rings and finite fields\n\nMatrices can also be defined with entries from any ring or field. Over a finite field, the situation becomes combinatorial: for a prime power \\(q=p^n\\), there is a unique finite field \\(\\mathbb{F}_q\\) of order \\(q\\), and the invertible \\(n\\times n\\) matrices over it form the general linear group \\(\\mathrm{GL}(n,q)\\), a finite group whose size can be counted explicitly.\n\nThis setting is central to coding theory. A codeword is produced by multiplying a message vector by a generator matrix \\(G\\); the set of all such codewords forms a subspace of the ambient vector space, and when the rows of \\(G\\) are linearly independent, \\(G\\) is called a generator matrix for that code. The quality of the code depends on finer properties of the matrix. A systematic generator matrix of the form \\([I\\mid B]\\) generates a maximum distance separable code precisely when \\(B\\) is full superregular, a condition on all minors that are not trivially zero. This ties determinantal conditions over finite fields to error-correcting performance.\n\nLinear operators in functional analysis and the limits of finite dimension\n\nMost of the theory in this article, including rank, determinants, Gaussian elimination, and the spectral decomposition, relies on finite dimensionality. In functional analysis, vector spaces are infinite-dimensional and operators are typically bounded, unbounded, compact, or of other special kinds. Many finite-dimensional statements survive in modified form; for example, the spectral theory of self-adjoint operators on Hilbert spaces is a substantial extension of the finite Hermitian case, but it must handle continuous spectrum and operators defined only on dense domains. Where a finite matrix can be diagonalized by an orthonormal eigenbasis, an infinite-dimensional operator may have no such basis, so the matrix representation alone does not capture its behavior. The finite-dimensional tools therefore serve as a guide and as a source of intuition rather than as a complete theory of linear operators."
    }
  ],
  "links": [
    "linear-algebra",
    "linear-map",
    "vector-space",
    "system-of-linear-equations",
    "real-number",
    "determinant",
    "matrix-rank",
    "eigenvalues-and-eigenvectors",
    "ring-mathematics",
    "lie-group",
    "abstract-algebra",
    "group-theory",
    "quantum-mechanics",
    "covariance-matrix",
    "principal-component-analysis",
    "artificial-neural-network",
    "field-mathematics",
    "tensor",
    "matrix-diagonalization",
    "identity-matrix",
    "lu-decomposition",
    "gaussian-elimination",
    "hermitian-matrix",
    "spectral-theorem",
    "skew-symmetric-matrix",
    "orthogonal-matrix",
    "unitary-matrix",
    "graph-theory",
    "numerical-linear-algebra",
    "basis-linear-algebra",
    "matrix-similarity",
    "linear-transformation",
    "matrix-trace",
    "kernel-linear-map",
    "null-space",
    "image-linear-map",
    "rank-nullity-theorem",
    "linear-independence",
    "inverse-matrix",
    "jacobian-matrix",
    "singular-value-decomposition",
    "ordinary-least-squares",
    "condition-number",
    "eigenspace",
    "matrix-exponential",
    "matrix-factorization",
    "numerical-stability",
    "floating-point-arithmetic",
    "qr-algorithm",
    "positive-definite-matrix",
    "multivariate-normal-distribution",
    "sparse-matrix",
    "conjugate-gradient-method",
    "integral-domain",
    "representation-theory",
    "graphics-processing-unit",
    "deep-learning",
    "qr-decomposition",
    "hilbert-space",
    "functional-analysis",
    "correlation",
    "gram-matrix",
    "parallel-computing",
    "self-attention",
    "word-embedding",
    "backpropagation",
    "hessian-matrix",
    "gradient-descent",
    "tensor-contraction",
    "tensor-product",
    "einstein-summation-convention"
  ],
  "sources": [
    {
      "title": "Sparse Matrices — GSL 2.8 documentation",
      "url": "https://www.gnu.org/software/gsl/doc/html/spmatrix.html"
    },
    {
      "title": "Optimizing Sparse Matrix Multiplications for Graph Neural Networks",
      "url": "https://arxiv.org/pdf/2111.00352"
    },
    {
      "title": "Optimizing Sparse Matrix-Vector Multiplication on Emerging Many-Core Architectures",
      "url": "https://arxiv.org/pdf/1805.11938"
    },
    {
      "title": "Sparse Matrix Formats — NVPL SPARSE",
      "url": "https://docs.nvidia.com/nvpl/latest/sparse/storage_format/sparse_matrix.html"
    },
    {
      "title": "Sparse Storage Formats",
      "url": "https://www.intel.com/content/www/us/en/docs/onemkl/developer-reference-dpcpp/2025-1/sparse-storage-formats.html"
    },
    {
      "title": "Hermitian matrix",
      "url": "https://en.wikipedia.org/wiki/Hermitian_matrix"
    },
    {
      "title": "Skew-Hermitian matrix",
      "url": "https://en.wikipedia.org/wiki/Skew-Hermitian_matrix"
    },
    {
      "title": "Matrices and determinants - MacTutor History of Mathematics",
      "url": "https://mathshistory.st-andrews.ac.uk/HistTopics/Matrices_and_determinants/"
    },
    {
      "title": "Linear Algebra - Determinants",
      "url": "https://theory.stanford.edu/~blynn/linear/det.html"
    },
    {
      "title": "12 PREFACE CHAPTER I DETERMINANTS",
      "url": "http://publish.illinois.edu/ymb/files/2018/09/prasolov_linear_algebra_determinants.pdf"
    },
    {
      "title": "8 DETERMINANTS.",
      "url": "http://www.sayahna.org/hist-math/hsmmt10tch10.html"
    },
    {
      "title": "Determinanten",
      "url": "https://link.springer.com/chapter/10.1007/978-3-642-92589-4_3"
    },
    {
      "title": "DETERMINANTS 1. Introduction In these notes we discuss ...",
      "url": "https://sites.math.washington.edu/~burke/crs/308/determinants.pdf"
    },
    {
      "title": "Leibniz formula for determinants",
      "url": "https://en.wikipedia.org/wiki/Leibniz_formula_for_determinants"
    },
    {
      "title": "Cofactor Expansions",
      "url": "https://textbooks.math.gatech.edu/ila/determinants-cofactors.html"
    },
    {
      "title": "An Introduction to Algebraic Combinatorics",
      "url": "https://arxiv.org/pdf/2506.00738"
    },
    {
      "title": "Eigenvalue and Eigenvector Calculator",
      "url": "https://www.pearson.com/channels/calculators/eigenvalue-and-eigenvector-calculator"
    },
    {
      "title": "Diagonalization",
      "url": "https://textbooks.math.gatech.edu/ila/diagonalization.html"
    },
    {
      "title": "Matrix Reference Manual: Eigenvalues",
      "url": "http://www.ee.ic.ac.uk/hp/staff/dmb/matrix/eigen.html"
    },
    {
      "title": "5.4: Diagonalization - Mathematics LibreTexts",
      "url": "https://math.libretexts.org/Bookshelves/Linear_Algebra/Interactive_Linear_Algebra_(Margalit_and_Rabinoff)/05:_Eigenvalues_and_Eigenvectors/5.03:_Diagonalization"
    },
    {
      "title": "EIG-0050: Diagonalizable Matrices and Multiplicity - Ximera",
      "url": "https://ximera.osu.edu/la/LinearAlgebra/EIG-M-0050/main"
    },
    {
      "title": "Recitation 8. November 5",
      "url": "https://web.mit.edu/18.06/www/Fall19/08-sol.pdf"
    },
    {
      "title": "The Spectral Theorem",
      "url": "https://sites.millersville.edu/bikenaga/linear-algebra/spectral-theorem/spectral-theorem.html"
    },
    {
      "title": "VII.D. THE SPECTRAL THEOREM 253 VII.D. The spectral theorem",
      "url": "https://www.math.wustl.edu/~matkerr/429/LA7d.pdf"
    },
    {
      "title": "Lecture 3.26. Hermitian, unitary and normal matrices A. Eremenko March 10, 2023",
      "url": "https://www.math.purdue.edu/~eremenko/dvi/lect3.26.pdf"
    },
    {
      "title": "SPECTRAL THEOREM Orthogonal Diagonalizable",
      "url": "https://math.jhu.edu/~bernstein/math201/SPECTRAL.pdf"
    },
    {
      "title": "Lecture 28: The Spectral Theorem 28 The Spectral Theorem 28.1",
      "url": "https://ocw.mit.edu/courses/res-18-011-algebra-i-student-notes-fall-2021/mit18_701f21_lect28.pdf"
    },
    {
      "title": "Math 4571 (Advanced Linear Algebra) Lecture #28",
      "url": "https://web.northeastern.edu/dummit/teaching_sp20_4571/4571_lecture_28_jordan_applications_2.pdf"
    },
    {
      "title": "10.3: Solution by the Matrix Exponential - Mathematics LibreTexts",
      "url": "https://math.libretexts.org/Bookshelves/Differential_Equations/Applied_Linear_Algebra_and_Differential_Equations_(Chasnov)/03:_III._Differential_Equations/10:_Systems_of_Linear_Differential_Equations/10.03:_Solution_by_the_Matrix_Exponential"
    },
    {
      "title": "Matrix exponential",
      "url": "https://en.wikipedia.org/wiki/Matrix_exponential"
    },
    {
      "title": "Spectral Methods in Complex Systems",
      "url": "https://arxiv.org/pdf/2509.05793"
    },
    {
      "title": "Matrix norm",
      "url": "https://en.wikipedia.org/wiki/Matrix_norm"
    },
    {
      "title": "4.2: Matrix Norms - Engineering LibreTexts",
      "url": "https://eng.libretexts.org/Bookshelves/Industrial_and_Systems_Engineering/Book:_Dynamic_Systems_and_Control_(Dahleh_Dahleh_and_Verghese)/04:_Matrix_Norms_and_Singular_Value_Decomposition/4.02:_Matrix_Norms"
    },
    {
      "title": "Lectures on Randomized Numerical Linear Algebra",
      "url": "https://arxiv.org/pdf/1712.08880"
    },
    {
      "title": "Linear Algebra, Part 5: Matrix norms (Mathematica)",
      "url": "https://www.cfm.brown.edu/people/dobrush/cs52/Mathematica/Part5/mnorm.html"
    },
    {
      "title": "CS 3220: The condition number of a matrix Instructor: Anil Damle Disclaimer",
      "url": "https://www.cs.cornell.edu/courses/cs3220/2019fa/ConditionNumber.pdf"
    },
    {
      "title": "NORTH- HOLLAND Condition Numbers and Their Condition Numbers Desmond J. Higham",
      "url": "https://webhomes.maths.ed.ac.uk/~dhigham/Publications/P20.pdf"
    },
    {
      "title": "Perturbation Theory for the Solution of Systems of ... - DTIC",
      "url": "https://apps.dtic.mil/sti/tr/pdf/ADA254994.pdf"
    },
    {
      "title": "MATH 3795 Lecture 6. Sensitivity of the Solution of a Linear System",
      "url": "https://www2.math.uconn.edu/~leykekhman/courses/MATH3795/Lectures/Lecture_6_Linear_system_error.pdf"
    },
    {
      "title": "Condition number for finite element discretisation of nonlocal PDE systems with applications to biology",
      "url": "https://arxiv.org/pdf/2508.09781"
    },
    {
      "title": "Krylov-space-based quasi-newton preconditioner for full-wavefield inversion",
      "url": "https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/10838093"
    },
    {
      "title": "Applications of Conjugate Gradient in Bayesian computation",
      "url": "https://arxiv.org/pdf/2308.14828"
    },
    {
      "title": "Krylov subspace methods and CG: OxRSE Training",
      "url": "https://train.rse.ox.ac.uk/material/HPCu/scientific_computing/sparse_linear_algebra/07-conjugate-gradient-method"
    },
    {
      "title": "Characterization of the equivalence of robustification and regularization in linear and matrix regression",
      "url": "https://arxiv.org/pdf/1411.6160"
    },
    {
      "title": "CONJUGATE GRADIENT METHODS We shall present ...",
      "url": "https://www.math.uci.edu/~chenlong/226/CG.pdf"
    },
    {
      "title": "Krylov subspace methods and preconditioners L. Grigori ALPINES",
      "url": "https://who.rocq.inria.fr/Laura.Grigori/TeachingDocs/UPMC_Master2/Slides_HPC_MN_DA/IterSolvers.pdf"
    },
    {
      "title": "Zero divisor",
      "url": "https://en.wikipedia.org/wiki/Zero_divisor"
    },
    {
      "title": "January 2, 2024 Rings Table of Contents 1. Deﬁnitions and constructions 1",
      "url": "https://people.math.osu.edu/leibman.1/algebra/rings.pdf"
    },
    {
      "title": "graphsearch.epfl.ch",
      "url": "https://graphsearch.epfl.ch/en/concept/487627/concepts?page=1"
    },
    {
      "title": "Strassen's 2x2 matrix multiplication algorithm: A conceptual perspective",
      "url": "https://www.researchgate.net/publication/386672817_Strassen's_2x2_matrix_multiplication_algorithm_A_conceptual_perspective"
    },
    {
      "title": "Strassen Formulas -- from Wolfram MathWorld",
      "url": "https://mathworld.wolfram.com/StrassenFormulas.html"
    },
    {
      "title": "Tiled Algorithms for Matrix Computations on Multicore Architectures",
      "url": "https://arxiv.org/pdf/1303.3182"
    },
    {
      "title": "GEOMETRY AND THE COMPLEXITY OF MATRIX MULTIPLICATION J.M. LANDSBERG",
      "url": "https://people.tamu.edu/~jml/msurvey0407.pdf"
    },
    {
      "title": "arxiv.org",
      "url": "https://arxiv.org/pdf/2507.13510v2"
    },
    {
      "title": "An overview of the recent progress on matrix multiplication",
      "url": "https://people.csail.mit.edu/virgi/sigactcolumn.pdf"
    },
    {
      "title": "New Bounds for Matrix Multiplication: from Alpha to Omega",
      "url": "https://arxiv.org/pdf/2307.07970"
    },
    {
      "title": "par.nsf.gov",
      "url": "https://par.nsf.gov//servlets/purl/10524471"
    },
    {
      "title": "New Breakthrough Brings Matrix Multiplication Closer to Ideal",
      "url": "https://www.quantamagazine.org/new-breakthrough-brings-matrix-multiplication-closer-to-ideal-20240307/"
    },
    {
      "title": "More Asymmetry Yields Faster Matrix Multiplication",
      "url": "https://arxiv.org/pdf/2404.16349"
    },
    {
      "title": "Matrix Multiplication Exponent Improved to 2.371177",
      "url": "https://www.emergentmind.com/papers/2608.16884"
    },
    {
      "title": "Lower Bounds for Conjunctive Query Evaluation",
      "url": "https://arxiv.org/pdf/2506.17702"
    },
    {
      "title": "Tensor Rank and Complexity",
      "url": "https://arxiv.org/pdf/2004.01492"
    },
    {
      "title": "Fangcheng (mathematics) — Grokipedia",
      "url": "https://grokipedia.com/page/fangcheng_mathematics"
    },
    {
      "title": "Fangcheng (mathematics)",
      "url": "https://en.wikipedia.org/wiki/Fangcheng_(mathematics)"
    },
    {
      "title": "The Nine Chapters on the Mathematical Art — Grokipedia",
      "url": "https://grokipedia.com/page/The_Nine_Chapters_on_the_Mathematical_Art"
    },
    {
      "title": "The Nine Chapters on the Mathematical Art",
      "url": "https://en-academic.com/dic.nsf/enwiki/133318"
    },
    {
      "title": "Fangcheng Procedure in the Nine Chapters on the Mathematical Arts Revisited",
      "url": "https://retrospectjournal.com/2021/02/14/fangcheng-procedure-in-the-nine-chapters-on-the-mathematical-arts-revisited/"
    },
    {
      "title": "Gottfried Wilhelm Leibniz",
      "url": "https://en.wikipedia.org/wiki/Gottfried_Leibniz"
    },
    {
      "title": "Using Cramer’s Rule to Solve a System of Two Equations in Two Variables",
      "url": "https://courses.lumenlearning.com/odessa-collegealgebra/chapter/using-cramers-rule-to-solve-a-system-of-two-equations-in-two-variables/"
    },
    {
      "title": "Cayley, Sylvester, and Early Matrix Theory",
      "url": "https://www.researchgate.net/publication/30045978_Cayley_Sylvester_and_Early_Matrix_Theory"
    },
    {
      "title": "Algebraic generality vs arithmetic generality in the controversy between C. Jordan and L. Kronecker (1874)",
      "url": "https://arxiv.org/pdf/0712.2566"
    },
    {
      "title": "Cayley, Sylvester, and Early Matrix Theory Nicholas J. Higham January 2008",
      "url": "https://webhomes.maths.ed.ac.uk/~v1ranick/papers/higham2.pdf"
    },
    {
      "title": "Cayley, Sylvester, and Early Matrix Theory Nick Higham School of Mathematics",
      "url": "https://pdfs.semanticscholar.org/18a6/e863ed83836347278e47dd694e960f903bd2.pdf"
    },
    {
      "title": "A Brief History of Linear Algebra and Matrix Theory",
      "url": "https://convexoptimization.com/TOOLS/Vitulli.pdf"
    },
    {
      "title": "1.2: Matrix Mechanics - Chemistry LibreTexts",
      "url": "https://chem.libretexts.org/Under_Construction/Purgatory/Time_Dependent_Quantum_Mechanics_and_Spectroscopy_2014e_(Tokmakoff)/01%3A_Overview_of_Time-Independent_Quantum_Mechanics/1.02%3A_Matrix_Mechanics"
    },
    {
      "title": "Perturbing a subject's contextualization of a proposition about an item considered in a quantum representation by altering the item",
      "url": "https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9741081"
    },
    {
      "title": "Quantum Information Processing: An Essential Primer",
      "url": "https://arxiv.org/pdf/2006.15979"
    },
    {
      "title": "GENERAL I ARTICLE Heisenberg, Matrix Mechanics, and the Uncertainty Principle",
      "url": "https://www.ias.ac.in/article/fulltext/reso/009/08/0046-0056"
    },
    {
      "title": "From Heisenberg and Schr\\\"odinger to the P vs. NP Problem",
      "url": "https://arxiv.org/pdf/2511.07502"
    },
    {
      "title": "Density matrix",
      "url": "https://en.wikipedia.org/wiki/Density_matrix"
    },
    {
      "title": "Relativistic Quantum Dynamics: A non-traditional perspective on space,   time, particles, fields, and action-at-a-distance",
      "url": "https://arxiv.org/pdf/physics/0504062"
    },
    {
      "title": "Pauli Matrix - an overview",
      "url": "https://www.sciencedirect.com/topics/mathematics/pauli-matrix"
    },
    {
      "title": "9.3: Adjacency Matrices - Engineering LibreTexts",
      "url": "https://eng.libretexts.org/Bookshelves/Computer_Science/Programming_and_Computation_Fundamentals/Mathematics_for_Computer_Science_(Lehman_Leighton_and_Meyer)/02:_Structures/09:_Directed_graphs_and_Partial_Orders/9.03:_Adjacency_Matrices"
    },
    {
      "title": "Algebraic and geometric methods in enumerative combinatorics",
      "url": "https://arxiv.org/pdf/1409.2562"
    },
    {
      "title": "Matrix Powers",
      "url": "https://datafireball.com/2023/07/22/matrix-powers-path-count-and-shortest-distance-count/"
    },
    {
      "title": "What is a Markov Chain? - dida.do",
      "url": "https://dida.do/what-is-a-markov-chain"
    },
    {
      "title": "Notes on Randomized Algorithms",
      "url": "https://arxiv.org/pdf/2003.01902"
    },
    {
      "title": "Stationary Distributions of Markov Chains",
      "url": "https://brilliant.org/wiki/stationary-distributions/"
    },
    {
      "title": "Markov Chain Monte Carlo Methods in Quantum Field Theories: A Modern Primer",
      "url": "https://arxiv.org/pdf/1912.10997"
    },
    {
      "title": "PageRank: Standing on the shoulders of giants",
      "url": "https://arxiv.org/pdf/1002.2858"
    },
    {
      "title": "Input-Output Analysis and Leontief Models",
      "url": "https://maseconomics.com/input-output-analysis-economics-understanding-leontief-models-and-economic-interdependence/"
    },
    {
      "title": "7.2 Application to economics: Leontief Model",
      "url": "https://www.math.ksu.edu/~gerald/leontief.pdf"
    },
    {
      "title": "AI HL Walks and Adjacency Matrices Notes - IB Demystified",
      "url": "https://ibdemystified.com/ai-hl-walks-and-adjacency-matrices-notes/"
    },
    {
      "title": "The arithmetic complexity of tensor contractions",
      "url": "https://arxiv.org/pdf/1209.4865"
    },
    {
      "title": "FLAASH: Flexible Accelerator Architecture for Sparse High-Order Tensor Contraction",
      "url": "https://arxiv.org/pdf/2404.16317"
    },
    {
      "title": "Bounded Linear Operators on Hilbert Spaces",
      "url": "https://link.springer.com/chapter/10.1007/978-3-0348-7980-4_2"
    },
    {
      "title": "The Coding Theory Workbook A companion to EE 567 Version 1.1 Spring 2016",
      "url": "https://community.wvu.edu/~mcvalenti/documents/workbook567.pdf"
    },
    {
      "title": "Tensor Algebra and its Applications to Data Science and Statistics",
      "url": "https://arxiv.org/pdf/2210.16182"
    },
    {
      "title": "Tensor Product - an overview",
      "url": "https://www.sciencedirect.com/topics/engineering/tensor-product"
    },
    {
      "title": "Infinite dimensional Hilbert tensors on spaces of analytic functions",
      "url": "https://arxiv.org/pdf/1611.02357"
    },
    {
      "title": "On the Hilbert matrix operator: a brief survey",
      "url": "https://arxiv.org/html/2411.00187v1"
    },
    {
      "title": "Chapter 5 Operators on Hilbert space Paragraph ex- panded in version of Dec. 18",
      "url": "https://web.math.ku.dk/~solovej/MATFYS/MATFYS07/MatFys5.pdf"
    },
    {
      "title": "Superregular Matrices over Finite Fields",
      "url": "https://www.mdpi.com/2227-7390/13/7/1091"
    },
    {
      "title": "Finite field matrix channels for network coding",
      "url": "https://arxiv.org/pdf/1601.06037"
    }
  ],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}