A conditional distribution is the probability distribution of a random variable when the value of another variable, the occurrence of an event, or some collection of information is specified. Whereas an unconditional distribution describes variation across an entire population or experiment, a conditional distribution describes variation within the circumstances selected by the conditioning information. For example, the distribution of daily electricity demand conditional on temperature can differ substantially from its distribution across all days.
Conditional distributions connect joint distributions with prediction, statistical inference, and the mathematical description of evolving random systems. For discrete variables they are obtained by dividing joint probabilities by marginal probabilities. For variables with densities, an analogous ratio applies where the conditioning density is positive. A more general formulation uses probability kernels and conditional expectation, allowing conditioning on continuously distributed observations and treating distributions that have no density. These formulations underpin regression, Bayesian updating, stochastic processes, and probabilistic computation, while also clarifying why conditioning on an observation is not generally equivalent to changing it by intervention.
Elementary definition and discrete distributions
The elementary definition begins with conditional probability. If is an event with , the conditional distribution of a real-valued random variable given assigns to each Borel set the probability
As a function of , this is a probability measure: it is nonnegative, assigns probability one to the whole real line, and is countably additive. Conditioning therefore produces a complete probability distribution, not merely a single revised probability. All its usual features—means, variances, quantiles, and event probabilities—can be examined.
For discrete random variables and , conditioning on gives the conditional probability mass function
where
Thus a joint probability table can be converted into conditional distributions by normalizing each relevant row or column. The notation is a conventional way to describe a variable with this conditional law; it does not denote division of random variables.
For example, roll two independent fair six-sided dice, let be the first result, and let be their sum. Given , the possible ordered outcomes are
Each has conditional probability , so the conditional distribution of is uniform on . Its unconditional distribution is uniform on . Specifying the sum changes both the support and the probabilities of the first die, although neither die has been physically altered.
A different example illustrates conditioning as restriction rather than replacement of an experiment. Suppose has a Poisson distribution with mean . Conditional on at least one occurrence,
This is a zero-truncated Poisson distribution. Such laws arise when a sampling procedure can record only units with positive counts. The conditional mean is , not , because zero outcomes have been excluded.
Conditional distributions also recover the original distribution by averaging over the conditioning variable:
This identity expresses the unconditional law as a mixture of conditional laws. Conversely, specifying a marginal distribution for and a conditional distribution for given each possible specifies their joint distribution. The direction matters: and generally differ because they normalize different parts of the same joint table.
Continuous, mixed, and singular conditional laws
When has a joint probability density function with respect to two-dimensional Lebesgue measure, the marginal density of is
For , a conditional density is
Conditional probabilities then follow by integration:
The formula resembles the discrete ratio, but its interpretation is different. Typically , so it is not obtained by dividing the probabilities of the events and .
Under suitable continuity assumptions, the density formula agrees with a limit of conditioning on small intervals:
Such limits are useful interpretations, but they are not a universally valid definition at every point. More generally, differentiation results can establish interval-limit statements for almost every conditioning value. The exact conditioning scheme must also be specified: different families of shrinking events need not encode the same information.
Consider a point chosen uniformly from the triangle
Its joint density is on that triangle and zero elsewhere. Since
the conditional density is
Thus has a uniform distribution on . Although each exact value of has probability zero, the conditional law has a natural and explicit form.
Not every joint distribution admits a density, and not every conditional law is continuous. If , then, given , the variable equals with probability one. Its conditional law is the point mass . Even when has a continuous marginal density, the joint distribution of is concentrated on the diagonal and has no two-dimensional density. Applying a joint-density ratio in this example would be inappropriate.
Mixed laws require similar care. A model for precipitation may assign positive conditional probability to zero rainfall and use a continuous density for positive rainfall:
where is supported on positive values. A conditional cumulative distribution function,
accommodates discrete, continuous, and mixed cases without assuming a density. Its jumps represent conditional point masses, while continuous portions describe the remaining probability.
Measure-theoretic formulation and existence
The modern general formulation rests on measure theory. On a probability space , a sub-sigma-algebra represents available information. For each measurable set in the state space of , a conditional probability is the conditional expectation
where is an indicator function. This object is a -measurable random variable, defined up to equality almost surely.
To assemble these conditional probabilities into a conditional distribution, their versions must be chosen consistently across sets . A regular conditional distribution is a mapping such that is a probability measure for every , while is -measurable for every . It must also satisfy
This identity is the defining compatibility condition between the conditional law and the original probability model.
When conditioning on a random variable , it is often preferable to write the kernel as . A probability kernel is measurable in its conditioning argument and a probability measure in its set argument. The required identity becomes
It says that integrating conditional laws against the marginal distribution of reconstructs the joint law. This decomposition is an instance of disintegration.
Existence is assured in the usual statistical setting where and take values in standard Borel spaces. These include finite or countable sets, Euclidean spaces with their Borel sigma-algebras, and many function spaces used for random paths. More generally, a standard Borel state space for ensures existence of a regular conditional law given a sub-sigma-algebra. Without suitable structural assumptions, conditional expectations of individual indicators can exist even though no compatible regular conditional distribution exists.
Uniqueness is an almost-everywhere statement. In the standard Borel setting, two conditional kernels agree as probability measures outside a set of conditioning values having -measure zero. Their values at a particular exceptional point need not be determined by the joint law. A model may select a continuous or otherwise regular version that gives a convenient value there, but that additional regularity is distinct from the basic definition. The distinction follows naturally from the measure-theoretic approach to probability systematized by Andrey Kolmogorov in 1933: probability identities determine objects up to null sets, rather than necessarily point by point.
Conditional moments, independence, and information
A conditional distribution determines expectations of functions, not only probabilities of events. If is integrable and is a conditional law, then
for almost every . Taking gives the conditional mean, while gives a conditional second moment. The conditional variance is
The full distribution contains more information than these moments: two conditional laws may have identical means and variances while differing in skewness, tail probabilities, or the number of modes.
The law of total expectation follows by averaging conditional means:
For square-integrable , the law of total variance states
The first term measures variation remaining within groups defined by ; the second measures variation between their conditional means. More generally, if , the tower property gives
This expresses consistency when information is first used in detail and then reduced.
The law of total variance does not say that every observed value of lowers the conditional variance. Let be equally likely to be or , and suppose
Then , but . The observation reveals that a more variable component generated . Additional information reduces average optimal squared prediction error, not necessarily uncertainty according to every criterion at every realized observation.
Statistical independence has a direct conditional characterization. The variables and are independent if and only if the conditional law of given equals its marginal law almost surely. Equality of conditional means alone is weaker. In the preceding variance-mixture example, for both values of , yet and are dependent because their conditional variances differ. Likewise, zero correlation does not generally imply equality of conditional and marginal distributions.
Conditional independence of and given means that, once is known, learning does not further change the conditional law of . In suitable versions,
For discrete variables, conditional entropy averages the entropy of the conditional laws. When the quantities are finite, the reduction
is mutual information. It measures average distributional information, rather than only improvements in predicting a mean.
Important distributional families
Several classical families have particularly useful conditional laws. If and are jointly multivariate normal, with mean vector and covariance matrix
and is invertible, then
The conditional mean is affine in , and the conditional covariance does not depend on . The latter property is special: many non-Gaussian models have conditional spread that changes with the observed value.
For standardized scalar normal variables with correlation , the formula reduces to
If , the conditional distribution equals the marginal distribution, reflecting the fact that uncorrelated jointly Gaussian variables are independent. If , the joint law is singular and the conditional distribution becomes a point mass. Joint normality is essential: normal marginal distributions by themselves do not justify either the conditional formula or the independence conclusion. In computation, the displayed inverse is usually implemented by solving linear systems rather than explicitly forming an inverse matrix.
Count distributions provide another fundamental example. Suppose and are independent Poisson variables with means and , both positive. Conditional on their total,
Indeed, dividing
by yields the binomial mass function. The total describes how many events occurred, while the conditional distribution describes their allocation between two categories. With more independent Poisson counts, conditioning on their sum produces a multinomial distribution.
Sampling without replacement produces a different allocation law. In a population of objects containing marked objects, the number of marked objects in a uniformly chosen sample of size satisfies
for feasible . If is fixed by design, this is simply the sampling distribution indexed by ; if is random, it is literally a conditional law. This distinction separates a parameterized family from a probabilistic model for the parameter itself.
Conditional families also need not match their marginals. If is Poisson and has a gamma distribution, integrating out produces a negative-binomial marginal distribution. Conditional Poisson variation can therefore coexist with marginal variance exceeding the marginal mean. Such mixture constructions make clear why a distributional assumption must specify whether it concerns an unconditional population, a subgroup, or a latent-variable condition.
Statistical inference and predictive distributions
In statistics, a model often specifies the conditional distribution of observed data given a parameter . If the parameter is treated as fixed, this is a family of sampling distributions indexed by . The same expression, viewed as a function of for fixed observed data, is the likelihood function. A likelihood need not integrate to one over parameter values, so it is not automatically a conditional distribution of the parameter.
In Bayesian inference, a prior distribution makes the parameter part of a joint probability model. Bayes’ theorem then gives a posterior distribution
when the denominator is positive and finite. The denominator is the marginal likelihood of the observation. This formula is a conditional-density calculation with the roles of parameter and data reversed; its interpretation depends on the joint model supplied by the prior and sampling law.
For a concrete example, let be binomial with trials and success probability , and let have a beta distribution with parameters . After observing ,
For a further Bernoulli outcome , conditionally independent of given ,
The predictive probability is obtained by averaging the success probability over the posterior, not by treating an estimated parameter as known without uncertainty.
More generally, the posterior predictive distribution is
If future and observed data are conditionally independent given , the first factor simplifies to . For several future outcomes, integrating over a shared uncertain parameter can create predictive dependence even when those outcomes are conditionally independent given that parameter. This is one reason a full predictive distribution differs from a list of separate point predictions.
Conditional distributions also connect prediction to decision theory. Under squared-error loss, the optimal prediction is the conditional mean. Under absolute-error loss, any conditional median is optimal. Minimizing the asymmetric loss
produces a conditional quantile. A regression model for therefore specifies only one functional of the conditional law. To calculate prediction intervals, threshold exceedance probabilities, or asymmetric decision risks, additional distributional information is required. A prediction interval concerns a future outcome, whereas a confidence interval concerns a parameter under repeated sampling; the two are not interchangeable.
Stochastic processes and graphical factorization
For a stochastic process , conditional distributions describe how the system evolves as observations accumulate. A filtration represents information available through time . The law of given is a one-step predictive law. In a general process it can depend on the entire observed past, not only the most recent state.
The Markov property states that the present state contains the information from the past needed to predict the future. For a discrete-time Markov chain,
A time-homogeneous transition kernel specifies this conditional distribution without explicit dependence on . In a finite state space, its values form a transition matrix. Repeated prediction follows kernel composition:
an instance of the Chapman–Kolmogorov equations.
In a hidden Markov model, states are unobserved and measurements provide partial information about them. If is the transition kernel, is an observation density, and is the conditional law of the previous state given past observations, prediction gives
The observation then updates this law:
Filtering is thus an alternating sequence of conditional prediction and conditioning on new evidence. In linear Gaussian models, the Kalman filter implements these operations using means and covariance matrices.
Conditional laws also organize multivariable models without a time ordering. The probability chain rule factors a joint density or mass function as
A Bayesian network uses a directed acyclic graph to replace each full predecessor set with a smaller parent set:
The local conditional laws encode restrictions on dependence, and graph structure can support efficient inference.
Local conditional specifications nevertheless require care. A complete collection of full conditionals, each describing one component given all the others, is not automatically compatible with a common joint distribution. When compatibility holds, these conditionals can support Gibbs sampling, a form of Markov chain Monte Carlo. Each update draws one component from its conditional law given the current values of the others. The intended joint law is invariant under such updates, but convergence from a chosen starting point requires additional conditions. Narrow, strongly dependent conditional laws can also make the chain explore the joint distribution slowly.
Estimation, conditioning choices, and causal interpretation
In applications, the joint law is usually unknown, so a conditional distribution must be estimated. Parametric methods specify a family and estimate , often by maximum likelihood. Generalized linear models specify conditional distributions through an exponential-family structure and a link between predictors and the conditional mean. Other methods estimate conditional quantiles or an entire conditional density. These are different statistical targets: accurately estimating a mean does not ensure accurate tail probabilities.
Nonparametric estimation can approximate conditioning by assigning greater weight to observations with predictor values near . For scalar observations , a conditional-density estimator can take the form
where and are nonnegative kernel densities with bandwidths and . The denominator normalizes the local weights. Where few observations are near , the estimate is unstable or poorly determined. With many conditioning variables, the curse of dimensionality makes local estimation increasingly data-intensive, motivating structural assumptions, dimension reduction, or regularization.
Conditioning also depends on precisely what information has been specified. A familiar zero-probability difficulty, often called the Borel paradox, arises when an informal phrase such as “a point lies on this curve” leaves the observation mechanism unspecified. For a point distributed uniformly on a sphere, shrinking bands of different geometric shapes around a great circle can induce different limiting distributions along that circle. There is no contradiction once the conditioning variable or shrinking-event procedure is fixed. The ambiguity lies in trying to infer a unique conditional law from the limiting set alone.
Most importantly, observational conditioning is not generally causal intervention. The distribution
describes outcomes among cases in which is observed. An intervention that externally sets to changes the mechanism generating , and its outcome distribution need not match that observed subgroup. Causal inference therefore requires assumptions about causal structure or experimental assignment in addition to the observational joint distribution. A predictive conditional model, however accurate, does not by itself identify the effect of changing its predictor.
Conditioning can even create associations. If independent fair coin indicators and are conditioned on , then : within that selected group they are perfectly negatively associated. In graphical terms, conditioning on a shared effect can induce dependence between otherwise independent causes. This mechanism underlies some forms of selection bias. Relatedly, group-specific conditional relationships can differ from a marginal relationship because the groups receive different mixture weights. Interpreting a conditional distribution therefore requires identifying the conditioning variables, the population selected by them, and the process by which observations enter the data.