In probability theory, the characteristic function of a real-valued random variable is the function , defined for every real number , where . It encodes the entire probability distribution of , always exists, and turns sums of independent random variables into products. As a version of the Fourier transform of a probability measure, it connects probability with harmonic analysis and provides a central tool for studying distributions and their limits.
Definition and conventions
Let have distribution on . Its characteristic function is
Here denotes expectation. By Euler’s formula,
Thus its real and imaginary parts describe the average cosine and sine components of the distribution at frequency .
If has a probability density function , then
If has a discrete distribution supported on values , then
The measure-based definition also covers distributions that are neither discrete nor described by a density.
Fourier-transform conventions differ in the sign of the exponent and in factors of . The standard probability convention used here has in the forward transform and in the inverse transform.
In other areas of mathematics, “characteristic function” can instead mean an indicator function of a set. That usage is distinct from the probability-theoretic meaning.
Existence and elementary properties
Because
the defining expectation exists for every probability distribution and every real . No finite mean, variance, or higher moment is required.
Every characteristic function satisfies:
- Normalization: .
- Boundedness: .
- Conjugate symmetry: .
- Uniform continuity: is uniformly continuous on .
For example, uniform continuity follows from
The right-hand side is independent of and tends to zero as , by the dominated convergence theorem.
If is symmetric about zero, its characteristic function is real-valued and even. Conversely, a real-valued characteristic function represents a distribution symmetric about zero.
For real constants and ,
Translation therefore adds a phase factor, while scaling changes the frequency argument.
Independent sums and convolution
If and are independent, then
More generally, for mutually independent random variables ,
The distribution of an independent sum is the convolution of the individual distributions. Characteristic functions replace this operation, which may involve complicated integrals or sums, with ordinary multiplication.
For independent and identically distributed random variables,
This identity is fundamental in the study of repeated sums, random walks, and limit theorems. Without independence, the factorization generally fails.
Examples
Constant random variable
If with probability one, then
In particular, a point mass at zero has characteristic function identically equal to .
Bernoulli distribution
For a Bernoulli distribution with and ,
Consequently, a binomial distribution with parameters and , obtained by summing independent Bernoulli variables, has characteristic function
Normal distribution
For a normal distribution with mean and variance ,
Multiplication of these functions shows directly that a sum of independent normal random variables is normal, with means and variances added.
Poisson distribution
For a Poisson distribution with parameter ,
The product formula immediately establishes that independent Poisson variables have a Poisson sum whose parameter is the sum of their parameters.
Cauchy distribution
For a Cauchy distribution with location and scale ,
The Cauchy distribution has neither a finite mean nor a finite variance, yet its characteristic function is well defined. Its lack of differentiability at zero illustrates the connection between smoothness of a characteristic function and existence of moments.
Uniqueness and inversion
Uniqueness theorem
Characteristic functions determine distributions uniquely:
Equality in distribution does not mean that and are equal as random variables on a shared probability space. It means that they assign the same probabilities to measurable subsets of .
Uniqueness makes characteristic functions useful for identifying distributions without calculating densities or distribution functions directly.
Recovering a density
If the characteristic function is absolutely integrable,
then the distribution has a bounded continuous density given by
Absolute integrability is a sufficient condition for this form of inversion, not a necessary condition for a distribution to possess a density.
Recovering interval probabilities
A more general inversion formula applies without assuming a density. If are continuity points of the cumulative distribution function , then
At , the quotient is interpreted by its continuous extension. When endpoints carry positive probability, the corresponding general formula gives half weight to the endpoint masses.
Moments and derivatives
If , differentiation under the expectation gives
At zero,
In particular,
whenever the corresponding absolute moments are finite. The variance is therefore
The converse requires care. Existence of an even-order derivative at zero implies finiteness of the corresponding even-order moment, but existence of an odd-order derivative alone need not imply finiteness of that absolute moment.
Even when all moments exist, the formal series
need not converge to the characteristic function. Smoothness does not by itself imply analyticity, and distinct distributions can have identical moments despite having different characteristic functions.
Relation to other transforms
The moment-generating function is
wherever this expectation is finite. Unlike characteristic functions, moment-generating functions need not be finite in any neighborhood of zero.
Both can be viewed as restrictions of a complex exponential transform when that transform is defined on an appropriate domain. The informal identity requires such a complex extension; it is not automatically justified merely by defining for real arguments.
For a nonnegative random variable, the Laplace transform of its distribution is
Each transform emphasizes different analytic properties. Characteristic functions have the particular advantage of existing for every probability distribution.
Convergence and limit theorems
The Lévy continuity theorem connects characteristic functions with convergence in distribution.
If converges in distribution to , then
for every real .
Conversely, if converges pointwise to a function that is continuous at zero, then is a characteristic function and the corresponding distributions converge to its distribution. Continuity at zero is essential: a pointwise limit without this property need not represent any probability distribution.
Central limit theorem
Characteristic functions give a standard proof of the central limit theorem. Let be independent and identically distributed with mean and finite, positive variance . Set
Finite second moment gives the local expansion
For the standardized sum
independence yields
The limit is the characteristic function of the standard normal distribution. The continuity theorem then establishes convergence in distribution.
Which functions are characteristic functions?
Normalization, boundedness, and continuity are not sufficient by themselves to characterize characteristic functions.
A function is positive definite if, for every finite selection and ,
For a characteristic function, this follows from
Bochner’s theorem states that a continuous positive-definite function on with is the characteristic function of a probability measure. This provides an intrinsic characterization without first specifying a random variable.
Multivariate characteristic functions
For a random vector , the characteristic function is
It uniquely determines the joint distribution. Every scalar projection has characteristic function
Consequently, the distributions of all scalar projections determine the joint distribution.
The components are mutually independent exactly when
for all .
For a multivariate normal distribution with mean vector and covariance matrix ,
This formula remains valid when is singular.
Statistical and computational uses
Given independent observations from a common distribution, the empirical characteristic function is
For each fixed , it is an unbiased estimator of and converges almost surely to it by the law of large numbers. It is also itself a characteristic function: that of the empirical distribution placing mass at each observation.
Empirical characteristic functions are used in parameter estimation, goodness-of-fit testing, and tests of independence. They are particularly useful when a model has a simple characteristic function but a difficult or unavailable density.
Numerical Fourier inversion can recover approximate densities or probabilities, sometimes using the fast Fourier transform. Practical limitations include truncation of the frequency range, discretization error, oscillatory integrals, and possible aliasing. Although a characteristic function uniquely specifies a distribution mathematically, recovering that distribution accurately from finitely many noisy transform values can be difficult.