The orthogonal group is the group of invertible linear transformations that preserve a specified quadratic form. Its most familiar instance, denoted , consists of the transformations of real -dimensional Euclidean space that preserve lengths and angles while fixing the origin. In an orthonormal coordinate system, these transformations are represented by matrices satisfying . Rotations and reflections are the basic geometric examples.
Orthogonal groups occupy a central position in group theory, geometry, and mathematical physics. The real group is both a matrix group and a compact Lie group, so it can be studied through algebraic equations, continuous transformations, and infinitesimal generators. Its determinant-one subgroup, , describes orientation-preserving orthogonal transformations. More general orthogonal groups preserve indefinite forms, complex quadratic forms, or quadratic forms over finite fields; these variants connect the subject to relativity, algebraic groups, and finite simple groups.
Definition and fundamental algebraic properties
Let be a finite-dimensional vector space over a field , equipped with a quadratic form . The orthogonal group of this form is
Here is the group of invertible linear maps on . When the characteristic of is not , the quadratic form determines a symmetric bilinear form
with . Preserving is then equivalent to preserving . This equivalence requires modification in characteristic , where a quadratic form contains information not recoverable from its polar form alone.
For the standard positive-definite form on ,
the orthogonal group is
The notation denotes the transpose, and is the identity matrix. The defining equation says that the columns of , and equivalently its rows, form an orthonormal basis. An orthogonal matrix therefore represents a change between orthonormal coordinate systems. Matrix multiplication corresponds to composition, and
These identities establish closure under multiplication and inversion directly.
Taking the determinant of the defining equation gives
Thus every real orthogonal matrix has determinant or . The special orthogonal group is
For , the determinant is a surjective homomorphism from to , with kernel . Consequently, is a normal subgroup of index two. Geometrically, determinant means preservation of orientation, whereas determinant means reversal of orientation.
The definition is independent of the chosen basis. If a nondegenerate symmetric bilinear form has matrix , its preserving matrices satisfy
Changing basis replaces by and conjugates the corresponding matrix group. In particular, every positive-definite real form gives a group isomorphic to , even if its coordinate equation is not .
Orthogonal transformations preserve the inner product, and hence norms, distances, and orthogonality. They are precisely the linear Euclidean isometries. The qualification “linear” is essential: translations preserve distances but do not fix the origin. The full Euclidean isometry group consists of transformations , combining an orthogonal transformation with a translation.
Rotations, reflections, and canonical forms
The most elementary nonidentity orthogonal transformations are reflections across hyperplanes through the origin. If is a normal vector, the corresponding reflection is
It fixes the hyperplane perpendicular to , sends to , and has determinant . Its matrix is
In numerical linear algebra this is a Householder transformation. The same formula defines a reflection for a nondegenerate symmetric bilinear form over a field of characteristic other than , provided .
The Cartan–Dieudonné theorem states that every isometry of a nondegenerate -dimensional quadratic space over such a field is a product of at most reflections. Over the reals with a positive-definite form, this gives a concrete description of all elements of . The parity of the number of reflections in any such factorization is determined by the determinant: an even number gives an element of , and an odd number gives determinant . Reflection factorizations are generally not unique.
A second description comes from the real canonical form of an orthogonal matrix. There is an orthogonal change of basis under which any becomes block diagonal, with blocks , , and planar rotations
Thus an orthogonal transformation decomposes into independent rotations in mutually perpendicular planes, together with fixed and sign-reversed directions. This follows from the spectral theorem for normal matrices, combined with the pairing of nonreal eigenvalues of a real matrix.
Every complex eigenvalue of a real orthogonal matrix satisfies . Nonreal eigenvalues occur in conjugate pairs , while real eigenvalues can only be or . In odd dimension, every element of has eigenvalue . In dimension three, this produces the familiar rotation axis: every nonidentity proper rotation fixes a line and rotates its perpendicular plane. In even dimensions, a proper rotation need not fix any nonzero vector.
The low-dimensional groups illustrate important distinctions. The group is discrete, while is trivial. The group consists of planar rotations and is isomorphic to the circle group; it is commutative. The full also includes reflections, which conjugate a rotation through to one through . By contrast, is noncommutative: rotations around different axes generally depend on their order. In dimension four, two perpendicular rotation planes can have independent rotation angles, so the single-axis picture from three-dimensional space no longer describes the general case.
Lie group structure and infinitesimal rotations
As a subset of the space of real matrices, is closed because it is defined by the polynomial equations . It is bounded because every column has Euclidean norm one. The Heine–Borel theorem therefore makes it a compact space. Its defining equations also give it a smooth manifold structure compatible with matrix multiplication and inversion, making it a compact Lie group.
The infinitesimal structure is obtained by differentiating the orthogonality condition. If is a differentiable curve in with and , then
Hence the tangent space at the identity is the vector space of skew-symmetric matrices:
Equipped with the commutator
this is the Lie algebra of both and . The two groups have the same infinitesimal structure because they have the same identity component.
A skew-symmetric matrix has zero diagonal and one free entry for each pair of distinct indices. Consequently,
A standard basis consists of matrices , with , where has a single nonzero entry in position . Each basis element generates rotation in one coordinate plane. This dimension count gives one parameter in dimension two, three in dimension three, and six in dimension four.
The matrix exponential connects these infinitesimal generators to finite transformations. If , then
and lies in . In fact, every element of is the exponential of a real skew-symmetric matrix: the rotation-block form provides a logarithm by replacing each planar rotation with its skew-symmetric generator. Such a logarithm is not unique, since rotation angles can be changed by multiples of . No determinant- matrix can be obtained this way.
For , skew-symmetric matrices can be identified with vectors through
where is the cross product. The commutator then corresponds to the cross product of the associated vectors. Exponentiating , with , yields Rodrigues’ formula:
This expresses a rotation directly in terms of its axis and angle. More generally, a maximal connected abelian subgroup of consists of independent rotations in fixed perpendicular planes. Its dimension, , is the rank of the compact Lie group.
Connected components, topology, and spin groups
For , has exactly two connected components, distinguished by determinant. The identity component is . To see its connectedness concretely, write an element in rotation-block form and continuously decrease every rotation angle to zero. Any pairs of blocks in a determinant-one matrix can be treated as rotations through . Multiplication by a fixed reflection maps homeomorphically onto the other component.
The topology of contains information not visible in its Lie algebra. Since is a circle,
For all , however, its fundamental group is
A full rotation represents the nontrivial class, while traversing this loop twice gives a contractible loop. This is the topological distinction behind the familiar belt-trick demonstration of the difference between and rotations.
The spin group gives a connected double covering space of for :
For , this is the universal covering group, and is simply connected. In dimension two, is itself a circle, and its covering map doubles the angular parameter; it is not the universal cover of . Spin groups can be constructed inside a Clifford algebra, where suitable products of unit vectors encode products of reflections.
The three-dimensional case has a particularly explicit model. Unit quaternions form a group isomorphic to . Identifying with the purely imaginary quaternions, a unit quaternion acts by
Both and determine the same rotation. Thus is the quotient of the three-sphere by antipodal identification, making it homeomorphic to real projective three-space. In dimension four, the exceptional identity
reflects a decomposition of its Lie algebra into two three-dimensional ideals.
Orthogonal groups also organize familiar geometric spaces through their group actions. The action of on the unit sphere is transitive, and the stabilizer of one unit vector is , giving
Likewise, the space of ordered orthonormal -frames, called a Stiefel manifold, is
These quotient descriptions connect orthogonal groups to algebraic topology and the geometry of vector bundles. In particular, the corresponding fibrations allow homotopy information in different dimensions to be compared rather than calculated separately.
Indefinite real forms and complex orthogonal groups
Positive definiteness is a special feature of the compact real orthogonal group. For a nondegenerate real quadratic form, Sylvester’s law of inertia gives coordinates in which
The pair is its signature. Writing
the corresponding group is
The positive-definite case is . When both and are positive, the group is noncompact.
The difference can already be seen in . The matrices
preserve and have determinant one, but their entries grow without bound as increases. Unlike Euclidean rotations, they can have real eigenvalues and away from the unit circle. Preservation of an indefinite form therefore does not imply preservation of an ordinary Euclidean norm. Nonzero vectors can also have ; these isotropic vectors form a cone rather than a sphere.
For , has four connected components. Determinant distinguishes two possibilities, while an additional orientation distinction for maximal positive or negative subspaces separates each into two. The determinant-one subgroup consequently has two components; its identity component is commonly denoted . Thus “special orthogonal” does not mean “connected” for indefinite real forms. A maximal compact subgroup of is .
The most prominent physical example is the Lorentz group , or equivalently under the opposite sign convention. It preserves the spacetime quadratic form
Its identity component consists of proper orthochronous Lorentz transformations, preserving spatial orientation and the chosen direction of time. Spatial rotations and Lorentz boosts belong to this component. Translations are not Lorentz transformations; including them produces the Poincaré group.
Over the complex numbers, every nondegenerate quadratic form of a given dimension is equivalent to the standard form. Accordingly,
represents the single nondegenerate complex case up to change of basis. This must not be confused with the unitary group, whose equation is , using the conjugate transpose. Complex orthogonal transformations preserve a complex bilinear form, not a positive-definite Hermitian inner product.
The complex group is noncompact for , even though its compact real form is . Its determinant-one subgroup is connected in the usual complex topology. These groups are also examples of an algebraic group: their multiplication, inversion, and defining relations belong naturally to the framework of algebraic geometry.
Orthogonal groups over finite fields
Over a finite field, an orthogonal group is finite rather than a continuous Lie group. Its structure depends on the field size, the dimension, and the equivalence class of the quadratic form. For a field of odd cardinality, nondegenerate quadratic forms are classified by dimension and discriminant. In even dimension , the notation
distinguishes the split and nonsplit types. Their Witt indices—the largest dimensions of totally isotropic subspaces—are and , respectively.
A subspace is totally isotropic when the quadratic form vanishes on every one of its vectors. In the split even-dimensional case, the space decomposes into hyperbolic planes, each having a quadratic form equivalent to . In the nonsplit case, there are only such planes, together with a two-dimensional anisotropic part. This difference changes both the geometry of the associated isotropic subspaces and the order of the preserving group.
For odd , the group orders are
and
In the second formula, the plus-type group has factor , while the minus-type group has factor . These expressions can be derived by counting suitable bases adapted to the quadratic form. For odd , the determinant-one subgroup has half the order of the full orthogonal group.
In odd dimension over a finite field of odd order, there are two equivalence classes of nondegenerate quadratic forms, but scaling a form by a nonzero scalar leaves its isometry group unchanged. The resulting orthogonal groups are therefore isomorphic, accounting for the single usual notation . In dimension two, the contrast is especially transparent:
The different factors arise from split and nonsplit one-dimensional tori inside the determinant-one groups.
Characteristic requires a separate formulation. The polar form
is alternating, and preserving it need not imply preservation of . In odd dimension its radical also requires special care. Moreover, determinant no longer supplies the same two-valued distinction because in the field. The real or odd-characteristic definition of “special” cannot therefore be transferred without adjustment; characteristic-two orthogonal theory uses additional invariants and subgroup constructions.
Finite orthogonal groups contribute major families to the theory of finite simple groups. Appropriate derived subgroups, usually denoted by variants of , and their projective quotients produce many simple groups, apart from low-dimensional and small-field exceptions. The distinction among , , , and projective versions is essential: the full orthogonal group is generally not itself simple. Their actions on isotropic points and subspaces also connect them to finite incidence geometries and combinatorial constructions.
Representations, invariants, and harmonic analysis
The defining representation of is its action on , but many other representations arise from polynomials, tensors, and functions on spheres. Because is compact, it has a normalized Haar measure, a probability measure invariant under left and right multiplication. Averaging an inner product over the group makes it invariant. Consequently, finite-dimensional real representations admit invariant positive-definite inner products, and complex representations admit invariant Hermitian inner products. Every invariant subspace then has an invariant orthogonal complement, yielding complete reducibility.
A basic invariant-theoretic problem asks which polynomial expressions in vectors remain unchanged under simultaneous orthogonal transformations. For vectors , all pairwise inner products
are invariant. The first fundamental theorem for the orthogonal group states, in the classical real or complex characteristic-zero setting, that these inner products generate the polynomial invariants. Equivalently, the invariant information is encoded by the Gram matrix
When the number of vectors exceeds the dimension, the entries satisfy rank relations, including the vanishing of all minors.
The difference between and is visible in oriented volume. For vectors, the determinant
is invariant under but changes sign under an orthogonal transformation of determinant . Thus orthogonal invariance records lengths and mutual angles but not handedness, whereas special orthogonal invariance can retain orientation. In tensor notation, the Euclidean metric provides invariant pairwise contractions for ; the alternating volume tensor supplies an additional invariant for .
The action on functions on the sphere leads to spherical harmonics. These are restrictions to of homogeneous polynomials annihilated by the Euclidean Laplacian. Harmonic polynomials of degree form a finite-dimensional invariant space. For , its dimension is
with the second term interpreted as zero when . For , this gives , the multiplicity familiar from angular momentum in quantum mechanics.
Finite-dimensional representations of correspond to integer angular momentum. Representations of its double cover also include half-integer angular momentum, but those representations do not descend to ordinary representations of . This distinction is the mathematical basis for separating tensorial and spinorial transformation laws.
The general structure belongs to the representation theory of compact groups and their complexified Lie algebras. The complex Lie algebras and form the classical families of types and , subject to familiar low-rank coincidences. Hermann Weyl’s The Classical Groups (1939) systematized the connection between these groups, their representations, and polynomial invariants.
Numerical methods and scientific applications
Orthogonal matrices are fundamental to numerical linear algebra because they preserve the Euclidean norm:
Their singular values are all one, and their spectral-norm condition number is exactly one. Applying an orthogonal transformation therefore does not amplify a perturbation in Euclidean norm. This exact mathematical property does not eliminate floating-point error, but it helps explain the numerical stability of algorithms built from orthogonal transformations.
In a QR decomposition, a matrix is factored as , where has orthonormal columns and is upper triangular. Householder reflections and planar Givens rotations construct this factorization while controlling roundoff error. Orthogonal similarity transformations also underlie the QR algorithm for eigenvalue computation. For real symmetric matrices, they preserve symmetry and can reduce the matrix to tridiagonal form before iterative diagonalization. The same geometry appears in the singular value decomposition,
where the orthogonal factors describe changes of orthonormal coordinates and contains the nonnegative singular values.
A direct optimization problem on is the orthogonal Procrustes problem. Given real matrices and of the same size with columns, it seeks
Expanding the squared Frobenius norm reduces the task to maximizing
If
then is a minimizer. If a proper rotation is required, the determinant-one constraint is enforced by an appropriate sign correction in a singular-vector direction associated with a smallest singular value. This problem appears in point-set alignment, shape comparison, and registration of coordinate systems.
Orthogonal invariance is equally important in statistics. A standard multivariate normal vector satisfies
for every fixed , because its density depends only on . More generally, orthogonal changes of coordinates transform a covariance matrix by . In principal component analysis, the spectral theorem selects orthogonal axes along which this covariance becomes diagonal. Haar-distributed orthogonal matrices supply uniformly random orthonormal frames; one sampling construction starts with a square matrix of independent standard normal entries and performs QR decomposition with a consistent sign convention on the diagonal of .
In differential geometry, a Riemannian metric selects orthonormal frames in each tangent space, and changes between such frames belong to . An orientation reduces these transition transformations to . In continuum mechanics and robotics, time-dependent rotations describe rigid-body attitude, while skew-symmetric matrices encode angular velocity. Quaternion coordinates exploit the spin covering to represent three-dimensional rotations without the coordinate singularities of Euler angles, with the necessary identification of and . Numerical integration on these spaces often uses exponential updates to preserve the orthogonality constraint throughout the calculation.