A sequence is an ordered collection of mathematical objects, called its terms, in which each term occupies a specified position. Formally, an infinite sequence in a set is a function from the natural numbers to . The notation , or simply , records the term at position . Unlike a set, a sequence retains both order and repetition: and are different sequences even though they have the same distinct entries.
Sequences provide the basic language for describing discrete patterns, successive approximations, and limiting processes. Their terms may be numbers, vectors, functions, random variables, or other objects. In mathematical analysis, their central role is to make convergence precise; in number theory and combinatorics, they encode arithmetic and counting patterns. They also connect finite computation with infinite mathematical structures through recurrence relations, series, iterative algorithms, and probabilistic limit laws.
Definition, indexing, and equality
An infinite sequence with values in is usually defined as a function
The convention for varies: some authors begin with , others with . Consequently, the starting index should be specified whenever it affects a formula. For example, the same ordered list can be written as for , or for . Parentheses distinguish a sequence from its range , which is an ordinary set and forgets order and multiplicity.
A finite sequence of length is a function from into . It may also be viewed as an ordered -tuple, belonging to the Cartesian product . The empty sequence has length zero. Two finite sequences are equal precisely when they have equal lengths and equal terms at every position. Two infinite sequences with the same indexing set are equal when for every index . Agreement after some index is instead called eventual equality; it does not imply equality of the complete sequences.
The adjective “numerical” restricts the terms to numbers, often real numbers or complex numbers. More generally, a sequence of vectors may lie in a vector space, while a sequence of functions may consist of maps sharing a common domain. A sequence of sequences is also legitimate: its th term is itself an indexed collection. This flexibility makes the definition useful well beyond elementary arithmetic.
Several related indexing conventions occur. A doubly infinite sequence is indexed by all integers, allowing both positive and negative positions. An array has two indices and is not an ordinary sequence unless its entries are enumerated using a single natural-number index. A transfinite sequence is indexed by an ordinal number rather than necessarily by . These distinctions matter because the order of indices controls concepts such as “eventually,” “successive,” and “approaching a limit.” A general indexed family need not come with the particular linear order that makes ordinary sequential reasoning possible.
Explicit formulas and elementary patterns
A sequence may be specified by an explicit formula, a recurrence, a verbal rule, or a mathematical characterization. An explicit formula computes directly from , as in . A rule such as “the th prime number” also defines a sequence unambiguously, even though it does not provide an elementary closed expression for its terms. An ellipsis alone is less informative: the list does not determine whether the next term is , , or something else. Infinitely many rules can agree with any prescribed finite initial segment.
An arithmetic progression has a constant difference between consecutive terms:
Starting at , its explicit form is . Such sequences describe equal increments, including evenly spaced sampling points and payments that increase by a fixed amount. A geometric progression instead has the form
When all relevant terms are nonzero, consecutive ratios equal . For real , the sign and magnitude determine distinct behaviors: gives decay, gives growth, and negative produces alternating signs. The case is handled directly by the formula and starting convention rather than by dividing consecutive terms.
Polynomial sequences are generated by evaluating a polynomial at integer arguments. For instance, has first differences and constant second differences . More generally, taking forward differences,
lowers the degree of a nonconstant polynomial sequence by one. A polynomial of degree therefore has constant th differences and zero st differences. This gives both a method for recognizing polynomial behavior under suitable assumptions and a foundation for discrete interpolation.
A periodic sequence satisfies for every relevant , for some positive integer . If this relation begins only after finitely many terms, the sequence is eventually periodic. Examples include the repeating signs and residues arising in modular arithmetic. Periodic sequences need not be constant, whereas a convergent real or complex periodic sequence must be constant. These elementary families often serve as building blocks, but most sequences do not belong to any simple named class. In particular, neither an explicit formula nor regular-looking initial terms guarantee convergence or a simple long-term pattern.
Recurrence relations and discrete dynamics
A recurrence relation defines terms through earlier terms. A first-order recurrence has the form
together with an initial value . A recurrence of order generally requires initial values. These data are essential: the rule describes an entire family of geometric sequences until a starting value is supplied. When the update rule assigns a unique next value, repeated substitution determines the sequence, and mathematical induction can establish properties of all its terms.
The Fibonacci sequence is specified by
Its characteristic equation has roots
leading to . This illustrates a general method for linear recurrences with constant coefficients. For
solutions are built from terms , where runs through the roots of the characteristic polynomial and reflects root multiplicity.
A higher-order recurrence can be rewritten as a first-order vector recurrence. For Fibonacci numbers,
This connects sequence behavior to matrices, their eigenvalues and eigenvectors, and powers of linear maps. Eigenvalues inside the complex unit circle contribute decaying components; those outside it contribute growing components. Repeated eigenvalues may introduce polynomial factors, so eigenvalue magnitude alone does not describe every borderline case.
Nonlinear recurrences can behave very differently. For an autonomous update , a fixed point satisfies . If is continuously differentiable near and , nearby starting values converge to ; if , the fixed point is locally repelling. The logistic recurrence supplies examples of fixed points, periodic orbits, and chaotic dynamics as varies. Recurrences therefore describe not merely lists of numbers but the repeated evolution of discrete systems, including population models, digital filters, and finite-state computations.
Convergence and the algebra of limits
A real sequence converges to if its terms eventually lie within every positive distance of :
The notation is or . This is a precise form of “arbitrarily close,” with the crucial requirement that all sufficiently late terms satisfy the bound. Merely coming close infinitely often is not enough. The sequence , for example, repeatedly equals , but it does not converge to .
The limit of a convergent real or complex sequence is unique. If distinct limits and existed, sufficiently late terms would lie within less than of each. The triangle inequality would then force , a contradiction. Every convergent numerical sequence is bounded, although boundedness does not imply convergence. Altering finitely many terms cannot change a sequence’s limit because the definition concerns only a sufficiently long tail.
Limits respect the familiar arithmetic operations. If and , then
If , then eventually and . These statements reduce complicated expressions to simpler limits, but their hypotheses matter. Expressions such as or the product of a quantity tending to zero with one growing without bound do not determine a limit by themselves. Likewise, convergence of does not imply convergence of either factor.
Comparison provides another major tool. If eventually and , then , a result usually called the squeeze theorem. It proves, for example, that from . A continuous function preserves limits: implies when is continuous at .
The statements and describe divergence to infinity, not convergence to a real number. The first means that for every real threshold , eventually . A sequence can fail to have either a finite or an infinite limit; oscillation is a basic example. Extended-real notation is useful, but it does not make indeterminate expressions such as into valid arithmetic operations.
Order, boundedness, and asymptotic comparison
A real sequence is nondecreasing if and nonincreasing if . “Increasing” sometimes means strictly increasing and sometimes nondecreasing, so explicit inequalities avoid ambiguity. A sequence is bounded above if one real number exceeds every term, bounded below if one lies below every term, and bounded if both conditions hold. These properties concern all terms, while eventual monotonicity or eventual boundedness permits a finite initial exception.
The monotone convergence theorem for real sequences states that every nondecreasing sequence bounded above converges, and every nonincreasing sequence bounded below converges. In the first case the limit is
The defining property of the supremum ensures that some term exceeds ; monotonicity then keeps every later term between and . A nondecreasing sequence that is not bounded above tends to . The theorem depends on the completeness of the real numbers: an increasing bounded sequence of rational numbers may approach an irrational limit absent from the rational number system.
Two sequences can be compared more finely by their growth rates. For an eventually positive sequence , the notation , part of asymptotic notation, means that eventually for some constant . The relation means , while means . For example,
for every fixed . These comparisons record dominant behavior without requiring the sequences themselves to converge.
Standard growth scales distinguish powers, exponentials, and factorials. For fixed and , , and . Such statements underpin estimates of computational cost and the convergence of series. They also show why a fixed initial segment can be misleading: asymptotic dominance may begin only at very large indices.
Rates of convergence are comparisons applied to an error sequence . Bounds such as , with , express geometric decay, while expresses algebraic decay. A smaller error at a few early indices need not imply a better asymptotic rate. Both the constants and the range where an estimate holds matter in practical approximation.
Subsequences and accumulation values
A subsequence of is a sequence obtained using strictly increasing indices
The increasing-index requirement preserves the original order and ensures that the selected positions escape every finite initial segment. Taking every second term is a typical example. A permutation of all terms, by contrast, is a reordering rather than generally a subsequence. A tail is a particularly simple subsequence.
Every subsequence of a convergent sequence converges to the same limit. Consequently, two subsequences with different limits prove divergence of the original sequence. For , the even-indexed terms converge to and the odd-indexed terms converge to . A subsequential limit, also called a cluster value, is a limit of some subsequence. This definition allows a sequence to have many cluster values, even when it has no limit itself.
The Bolzano–Weierstrass theorem states that every bounded real sequence has a convergent subsequence. The result extends to bounded sequences in finite-dimensional Euclidean space. One proof repeatedly bisects a bounded interval, retaining a closed half containing infinitely many terms, and then chooses terms with increasing indices from the resulting nested intervals. Their lengths tend to zero, forcing the selected terms to converge. Boundedness is indispensable, and in infinite-dimensional normed spaces it is not enough: bounded sequences need not possess norm-convergent subsequences.
The limit superior and limit inferior summarize the extreme long-term behavior of a real sequence:
These quantities always exist in the extended real numbers because the tail suprema decrease and the tail infima increase. For a bounded sequence, they are respectively its largest and smallest cluster values. A finite limit exists precisely when the two are equal to the same finite number.
Cluster values should be distinguished from accumulation points of the range considered merely as a set. A constant sequence has its constant value as a subsequential limit, although its one-element range has no accumulation point under the convention requiring other nearby points. This distinction illustrates why sequence terminology tracks repeated occurrences and indices rather than only the geometry of distinct values.
Cauchy sequences and completeness
A Cauchy sequence is one whose sufficiently late terms are arbitrarily close to one another. In a metric space , this means
Unlike convergence, the definition does not mention a proposed limit. It therefore gives an intrinsic test for whether the terms are settling together, even when the limiting object has not yet been constructed.
Every convergent sequence is Cauchy, by the triangle inequality. The converse depends on the ambient space. A complete metric space is one in which every Cauchy sequence converges to a point of the space. The real and complex numbers are complete under their usual distances. The rational numbers are not: finite decimal truncations of form a rational Cauchy sequence, but no rational number is its limit. Completeness thus concerns the availability of limits inside a space, not merely the numerical behavior of a list.
A common source of error is to replace the Cauchy condition by . This weaker statement is necessary but not sufficient. If
then , yet the sequence is unbounded. Small successive increments may accumulate over many steps. A stronger condition does suffice: if
then the triangle inequality bounds distances between arbitrary late terms by tails of a convergent nonnegative series, proving that is Cauchy.
Completeness also has a constructive interpretation. The real numbers can be built from equivalence classes of rational Cauchy sequences, where two sequences are equivalent when their difference tends to zero. More generally, metric completion embeds any metric space into a complete one in which the original space is dense. This makes precise the idea of adding missing limits without adding unnecessary points.
A Cauchy sequence in a metric space is bounded, and if it has even one convergent subsequence, then the whole sequence converges to that subsequence’s limit. These facts frequently simplify existence proofs. Completeness and total boundedness together characterize compactness for metric spaces; ordinary boundedness alone is weaker than total boundedness outside familiar finite-dimensional settings.
Partial sums, infinite series, and generating functions
An infinite series is defined through a sequence of partial sums. Given terms , let
The series converges to precisely when . A sequence and a series are therefore different objects: the sequence lists terms, while the series asks about the accumulated effect of adding them. The necessary condition follows from , but it is not sufficient, as the harmonic series demonstrates.
For a geometric series, finite summation gives
when . Thus the infinite series converges to exactly when . More generally, absolute convergence, meaning convergence of , guarantees convergence over the real or complex numbers. It also permits arbitrary rearrangement without changing the sum. Conditional convergence is more delicate: rearrangements of a conditionally convergent real series can change its sum or destroy convergence.
A generating function packages a sequence into an algebraic object:
When treated as a formal power series, this expression does not require a numerical value of or any convergence assumption. Equality means coefficientwise equality. Addition of generating functions adds sequences term by term, while multiplication produces the convolution
Because each coefficient uses only finitely many terms, formal multiplication is well defined.
Recurrences often become algebraic equations for generating functions. For the Fibonacci sequence,
satisfies
The denominator encodes the recurrence, while its roots govern the exponential behavior of the coefficients. This relationship connects counting problems with algebraic and analytic methods.
When is interpreted numerically, a generating function becomes a power series with a radius of convergence. Analytic properties then provide information about coefficient growth. Other transforms emphasize different structures: an exponential generating function uses , often appropriate for counting labeled objects. The same sequence can therefore be examined through its individual terms, its partial sums, or a function whose coefficients retain the entire list.
Sequences of functions and interchange of limits
For a sequence of functions , pointwise convergence to means that for each fixed . The index after which the approximation is accurate may depend on the point . By contrast, uniform convergence requires one index to work across the entire domain:
Equivalently, when the suprema are finite, .
The functions on illustrate the distinction. For , , while . The pointwise limit is therefore discontinuous at , even though every is continuous. Convergence is not uniform on , but it is uniform on every interval with , because . A uniform limit of continuous functions is continuous, so uniform convergence supplies a preservation principle absent from pointwise convergence.
Integration and differentiation require their own hypotheses. On a compact interval, uniform convergence of continuous functions permits interchange of limit and the integral:
For measurable functions, the dominated convergence theorem gives a different route: pointwise convergence almost everywhere together with domination by one integrable function. These conditions control behavior that pointwise convergence alone leaves unrestricted, such as narrowing peaks whose heights grow while their integrals remain substantial.
Uniform convergence of does not by itself imply convergence of their derivatives. For example,
converges uniformly to zero on the real line, but for every , whereas the derivative of the limit is zero. A standard differentiation theorem instead assumes uniform convergence of the derivatives on an interval, together with convergence of the function values at one point, to recover convergence to a differentiable limit.
These distinctions are essential in Fourier series, differential equations, and approximation theory. A sequence of approximations may converge in one sense but fail in another, and the permitted operations depend on the mode of convergence rather than merely on the existence of a pointwise formula for the limit.
Sequences in topology
In a topological space , a sequence converges to if every neighborhood of contains all sufficiently late terms. For metric spaces this agrees with the distance-based definition. The topological formulation shows that convergence concerns the structure of neighborhoods, not necessarily a numerical measure of distance. In a Hausdorff space, distinct points possess disjoint neighborhoods, which guarantees uniqueness of sequential limits.
A compact space is defined by the finite-subcover property for open covers, whereas sequential compactness means that every sequence has a convergent subsequence with limit in the space. These notions coincide for metric spaces. In particular, the Heine–Borel theorem identifies compact subsets of finite-dimensional Euclidean space as exactly the closed bounded sets. In general topological spaces, however, compactness and sequential compactness are not equivalent. Replacing an open-cover argument by a subsequence argument therefore requires justification.
Sequences characterize many familiar topological properties in metric spaces. A subset is closed exactly when it contains the limits of all convergent sequences of its points. A function between metric spaces is continuous exactly when it preserves limits of sequences. Similar statements hold for domains that are first-countable, meaning that every point has a countable neighborhood base. Without such hypotheses, sequential tests may miss parts of the topology.
A concrete example uses the product topology on , where is uncountable. Let consist of points having only finitely many coordinates equal to . The point with every coordinate equal to lies in the closure of : a basic neighborhood restricts only finitely many coordinates, and an element of can match all those restrictions. Yet no sequence in converges to that point. The union of the finite supports of countably many terms is countable, leaving some coordinate identically zero throughout the sequence.
This limitation motivates a net, a generalization indexed by a directed set rather than by the natural numbers. Nets characterize closure and continuity in arbitrary topological spaces. Ordinary sequences remain sufficient in most elementary analysis because the spaces involved are metrizable or first-countable, but their convenience should not be mistaken for universal adequacy. The distinction is structural: a countable chain of observations cannot always explore a neighborhood system with essentially uncountable complexity.
Sequence spaces and functional analysis
A sequence space is a space whose elements are themselves sequences, usually equipped with algebraic operations and a topology or norm. For real or complex sequences, addition and scalar multiplication are defined coordinatewise:
The collection of all scalar sequences is a vector space, but analysis typically restricts attention to subspaces satisfying boundedness, convergence, or summability conditions. Different choices capture different notions of size and approximation.
For , the space consists of sequences satisfying
The space consists of bounded sequences with norm . These are discrete instances of spaces, using counting measure on the natural numbers, and all are Banach spaces. The space is additionally a Hilbert space, with inner product
The Cauchy–Schwarz inequality ensures that this sum is well defined.
The space consists of sequences converging to zero, while consists of all convergent scalar sequences. Both are closed subspaces of under the supremum norm. For finite , membership in implies membership in , but the reverse implication fails. The sequence , for example, tends to zero and belongs to for , but not to . Summability therefore imposes a stronger condition than termwise decay.
Convergence of a sequence of points in a sequence space must be distinguished from convergence along the coordinates of one point. Let have value in coordinate and elsewhere. For each fixed coordinate , as . Nevertheless, , so these vectors do not converge to zero in norm. In , they do converge weakly to zero: their inner products with every fixed vector tend to zero.
Sequence spaces provide concrete models for functional analysis. Coordinates in an orthonormal basis turn vectors into square-summable coefficient sequences, and linear operators can often be studied through their action on these coefficients. This connects abstract infinite-dimensional geometry with Fourier coefficients, signal representations, and infinite systems of equations.
Random sequences and probabilistic convergence
A sequence of random variables assigns a random value to each index. Defined on a common probability space, it is a discrete-time stochastic process. For a fixed outcome , the values form an ordinary sequence, called a sample path. Probabilistic convergence can concern these paths, the probability of large errors, average error size, or only the distributions of the terms. These are distinct questions.
Almost-sure convergence means that outside a set of probability zero. Convergence in probability means
for every . Almost-sure convergence implies convergence in probability, but the converse does not generally hold. Nevertheless, every sequence converging in probability has a subsequence that converges almost surely to the same limit. This subsequence principle is useful when pathwise arguments are easier than direct probabilistic estimates.
Convergence in , for , means
It implies convergence in probability by Markov’s inequality. It need not follow from almost-sure convergence: on with uniform probability, tends to zero at every fixed , but . Increasingly rare events can carry enough magnitude to prevent mean convergence. Integrability conditions are therefore necessary when passing from pathwise limits to limits of expectations.
Convergence in distribution is weaker still. For real random variables it means that their distribution functions converge at every continuity point of the limiting distribution function. The variables need not even be defined on the same probability space. Convergence in probability implies convergence in distribution, but distributional convergence alone does not specify pathwise proximity to a particular random variable.
The law of large numbers and central limit theorem illustrate different uses of random sequences. For independent identically distributed variables with finite absolute mean , the sample averages converge almost surely to . Under finite positive variance , the normalized deviations
converge in distribution to the standard normal law. One theorem describes stabilization of averages; the other describes the distribution of their fluctuations at a shrinking scale. Dependence, tail behavior, and normalization determine which analogues remain valid for more general random sequences.
Numerical iteration and computability
Many numerical methods produce a sequence intended to approach a solution. For solving , Newton’s method uses
when the denominator is nonzero. Near a simple root , suitable smoothness and a sufficiently close starting point yield quadratic convergence:
for all sufficiently large . This is a local statement, not a guarantee for every initial value. Iterates can encounter zero derivatives, enter cycles, or move away from the desired root.
A broadly applicable convergence mechanism is the Banach fixed-point theorem. If a map on a nonempty complete metric space satisfies
then converges to a unique fixed point . It also gives the computable estimate
The estimate converts qualitative convergence into an explicit bound on how many steps are sufficient for a desired accuracy.
Stopping criteria require comparable justification. A small difference does not alone prove proximity to the answer. A small residual may also be misleading if the equation is poorly conditioned. Error bounds depend on the structure of the problem, not merely on the appearance of the latest terms. In numerical analysis, convergence of the ideal mathematical sequence is therefore distinguished from numerical stability of its implementation under floating-point arithmetic.
There is also a logical distinction between a well-defined sequence and a computable one. An integer sequence is computable when an algorithm can return its th term for every input . A sequence of rational approximations may be computable term by term yet lack a computable rate of convergence. A modulus of convergence is a function guaranteeing an error below, for example, after index . Such a modulus provides the effective control needed to turn convergence into an approximation procedure.
Not every real number or infinite binary sequence is computable: algorithms have finite descriptions and form a countable collection, whereas infinite binary sequences form an uncountable set. Consequently, mathematical existence of a sequence does not imply the existence of a finite procedure for generating its terms. This boundary connects sequence theory with computation, constructive analysis, and the foundations of effective approximation.
Historical development
Sequence-like reasoning long predates the modern definition of a function on the natural numbers. Ancient work on figurate numbers studied arrangements corresponding to square, triangular, and other numerical patterns. In Greek mathematics, proportions and repeated constructions supplied tools for investigating indefinitely continuing processes without the modern symbolism of indexed terms. Euclid’s *Elements* includes results on numbers in continued proportion, while Archimedes used successive geometric approximations in determining areas and estimating the ratio of a circle’s circumference to its diameter.
Medieval and early modern arithmetic developed recurring numerical patterns in practical and theoretical settings. Leonardo of Pisa, known as Fibonacci, presented the rabbit problem associated with the Fibonacci numbers in the Liber abaci of 1202; a revised version appeared in 1228. Related recurrences had already arisen in Indian work on poetic meters. The significance of the example lies not in the biological realism of the rabbit model but in the transparent generation of each term from two preceding terms, a structure later connected with algebraic formulas and counting problems.
During the seventeenth and eighteenth centuries, sequences and infinite series became central to the development of calculus. Infinite expansions supported calculations with trigonometric, logarithmic, and exponential functions. Leonhard Euler used series and generating-function methods extensively in the eighteenth century, including in number theory and the study of partitions. Formal manipulation was extraordinarily productive, but questions about when an infinite operation preserved equality increasingly required systematic treatment.
Nineteenth-century analysis made convergence an explicit foundation rather than an informal expectation. In his Cours d’analyse of 1821, Augustin-Louis Cauchy developed a systematic account of limits, infinitesimals, continuity, and series, including the criterion now associated with Cauchy sequences. Karl Weierstrass and other analysts contributed to the precise inequality-based treatment of limiting processes. The construction of the real numbers and the study of completeness clarified why some Cauchy sequences have limits within a number system and others do not.
The late nineteenth and twentieth centuries broadened the objects carried by sequences. Georg Cantor used infinite listings and diagonal arguments in the study of countability and real numbers. The development of metric spaces, topology, and functional analysis separated convergence from any particular numerical formula and exposed the limits of purely sequential descriptions in general spaces. Probability added several inequivalent modes of convergence, while computing made iteration and effective error bounds central practical concerns. The resulting subject retains the elementary image of terms in order while supporting theories of infinite-dimensional spaces, random behavior, and algorithmic approximation.