{
  "id": "conditional-distribution",
  "title": "Conditional Distribution",
  "lang": "en",
  "source_lang": "en",
  "summary": "A conditional distribution describes the probabilities of a random quantity after another quantity or body of information is specified.",
  "category": "mathematics",
  "subcategory": "probability-statistics",
  "type": "concept",
  "aliases": [
    "Conditional probability distribution",
    "Conditional law"
  ],
  "generated_at": "2026-11-03",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/conditional-distribution/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/conditional-distribution/",
      "json": "https://aiwiki.page/zh/conditional-distribution.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "A conditional distribution is the probability distribution of a random variable when the value of another variable, the occurrence of an event, or some collection of information is specified. Whereas an unconditional distribution describes variation across an entire population or experiment, a conditional distribution describes variation within the circumstances selected by the conditioning information. For example, the distribution of daily electricity demand conditional on temperature can differ substantially from its distribution across all days.\n\nConditional distributions connect joint distributions with prediction, statistical inference, and the mathematical description of evolving random systems. For discrete variables they are obtained by dividing joint probabilities by marginal probabilities. For variables with densities, an analogous ratio applies where the conditioning density is positive. A more general formulation uses probability kernels and conditional expectation, allowing conditioning on continuously distributed observations and treating distributions that have no density. These formulations underpin regression, Bayesian updating, stochastic processes, and probabilistic computation, while also clarifying why conditioning on an observation is not generally equivalent to changing it by intervention."
    },
    {
      "heading": "Elementary definition and discrete distributions",
      "text": "The elementary definition begins with conditional probability. If \\(B\\) is an event with \\(P(B)>0\\), the conditional distribution of a real-valued random variable \\(X\\) given \\(B\\) assigns to each Borel set \\(A\\) the probability\n\n\\[P(X\\in A\\mid B) = \\frac{P(\\{X\\in A\\}\\cap B)}{P(B)}.\\]\n\nAs a function of \\(A\\), this is a probability measure: it is nonnegative, assigns probability one to the whole real line, and is countably additive. Conditioning therefore produces a complete probability distribution, not merely a single revised probability. All its usual features—means, variances, quantiles, and event probabilities—can be examined.\n\nFor discrete random variables \\(X\\) and \\(Y\\), conditioning on \\(Y=y\\) gives the conditional probability mass function\n\n\\[p_{X\\mid Y}(x\\mid y) = \\frac{p_{X,Y}(x,y)}{p_Y(y)}, \\qquad p_Y(y)>0,\\]\n\nwhere\n\n\\[p_Y(y)=\\sum_x p_{X,Y}(x,y).\\]\n\nThus a joint probability table can be converted into conditional distributions by normalizing each relevant row or column. The notation \\(X\\mid Y=y\\) is a conventional way to describe a variable with this conditional law; it does not denote division of random variables.\n\nFor example, roll two independent fair six-sided dice, let \\(X\\) be the first result, and let \\(S\\) be their sum. Given \\(S=8\\), the possible ordered outcomes are\n\n\\[(2,6),(3,5),(4,4),(5,3),(6,2).\\]\n\nEach has conditional probability \\(1/5\\), so the conditional distribution of \\(X\\) is uniform on \\(\\{2,3,4,5,6\\}\\). Its unconditional distribution is uniform on \\(\\{1,\\ldots,6\\}\\). Specifying the sum changes both the support and the probabilities of the first die, although neither die has been physically altered.\n\nA different example illustrates conditioning as restriction rather than replacement of an experiment. Suppose \\(N\\) has a Poisson distribution with mean \\(\\lambda>0\\). Conditional on at least one occurrence,\n\n\\[P(N=n\\mid N>0) = \\frac{e^{-\\lambda}\\lambda^n/n!}{1-e^{-\\lambda}}, \\qquad n=1,2,\\ldots.\\]\n\nThis is a zero-truncated Poisson distribution. Such laws arise when a sampling procedure can record only units with positive counts. The conditional mean is \\(\\lambda/(1-e^{-\\lambda})\\), not \\(\\lambda\\), because zero outcomes have been excluded.\n\nConditional distributions also recover the original distribution by averaging over the conditioning variable:\n\n\\[P(X\\in A) = \\sum_y P(X\\in A\\mid Y=y)P(Y=y).\\]\n\nThis identity expresses the unconditional law as a mixture of conditional laws. Conversely, specifying a marginal distribution for \\(Y\\) and a conditional distribution for \\(X\\) given each possible \\(y\\) specifies their joint distribution. The direction matters: \\(p_{X\\mid Y}(x\\mid y)\\) and \\(p_{Y\\mid X}(y\\mid x)\\) generally differ because they normalize different parts of the same joint table."
    },
    {
      "heading": "Continuous, mixed, and singular conditional laws",
      "text": "When \\((X,Y)\\) has a joint probability density function with respect to two-dimensional Lebesgue measure, the marginal density of \\(Y\\) is\n\n\\[f_Y(y)=\\int_{\\mathbb R}f_{X,Y}(x,y)\\,dx.\\]\n\nFor \\(f_Y(y)>0\\), a conditional density is\n\n\\[f_{X\\mid Y}(x\\mid y) = \\frac{f_{X,Y}(x,y)}{f_Y(y)}.\\]\n\nConditional probabilities then follow by integration:\n\n\\[P(X\\in A\\mid Y=y) = \\int_A f_{X\\mid Y}(x\\mid y)\\,dx.\\]\n\nThe formula resembles the discrete ratio, but its interpretation is different. Typically \\(P(Y=y)=0\\), so it is not obtained by dividing the probabilities of the events \\(\\{X\\in A,Y=y\\}\\) and \\(\\{Y=y\\}\\).\n\nUnder suitable continuity assumptions, the density formula agrees with a limit of conditioning on small intervals:\n\n\\[P(X\\in A\\mid Y=y) = \\lim_{\\varepsilon\\downarrow0} P(X\\in A\\mid |Y-y|<\\varepsilon).\\]\n\nSuch limits are useful interpretations, but they are not a universally valid definition at every point. More generally, differentiation results can establish interval-limit statements for almost every conditioning value. The exact conditioning scheme must also be specified: different families of shrinking events need not encode the same information.\n\nConsider a point chosen uniformly from the triangle\n\n\\[0<x<y<1.\\]\n\nIts joint density is \\(2\\) on that triangle and zero elsewhere. Since\n\n\\[f_Y(y)=2y,\\qquad 0<y<1,\\]\n\nthe conditional density is\n\n\\[f_{X\\mid Y}(x\\mid y) = \\frac1y,\\qquad 0<x<y.\\]\n\nThus \\(X\\mid Y=y\\) has a uniform distribution on \\((0,y)\\). Although each exact value of \\(Y\\) has probability zero, the conditional law has a natural and explicit form.\n\nNot every joint distribution admits a density, and not every conditional law is continuous. If \\(Y=X\\), then, given \\(Y=y\\), the variable \\(X\\) equals \\(y\\) with probability one. Its conditional law is the point mass \\(\\delta_y\\). Even when \\(X\\) has a continuous marginal density, the joint distribution of \\((X,Y)\\) is concentrated on the diagonal and has no two-dimensional density. Applying a joint-density ratio in this example would be inappropriate.\n\nMixed laws require similar care. A model for precipitation may assign positive conditional probability to zero rainfall and use a continuous density for positive rainfall:\n\n\\[\\mathcal L(X\\mid Y=y) = \\pi(y)\\delta_0+ [1-\\pi(y)]G_y,\\]\n\nwhere \\(G_y\\) is supported on positive values. A conditional cumulative distribution function,\n\n\\[F_{X\\mid Y}(x\\mid y)=P(X\\le x\\mid Y=y),\\]\n\naccommodates discrete, continuous, and mixed cases without assuming a density. Its jumps represent conditional point masses, while continuous portions describe the remaining probability."
    },
    {
      "heading": "Measure-theoretic formulation and existence",
      "text": "The modern general formulation rests on measure theory. On a probability space \\((\\Omega,\\mathcal F,P)\\), a sub-sigma-algebra \\(\\mathcal G\\subseteq\\mathcal F\\) represents available information. For each measurable set \\(A\\) in the state space of \\(X\\), a conditional probability is the conditional expectation\n\n\\[P(X\\in A\\mid\\mathcal G) = E[\\mathbf 1_{\\{X\\in A\\}}\\mid\\mathcal G],\\]\n\nwhere \\(\\mathbf 1_{\\{X\\in A\\}}\\) is an indicator function. This object is a \\(\\mathcal G\\)-measurable random variable, defined up to equality almost surely.\n\nTo assemble these conditional probabilities into a conditional distribution, their versions must be chosen consistently across sets \\(A\\). A regular conditional distribution is a mapping \\(K(\\omega,A)\\) such that \\(A\\mapsto K(\\omega,A)\\) is a probability measure for every \\(\\omega\\), while \\(\\omega\\mapsto K(\\omega,A)\\) is \\(\\mathcal G\\)-measurable for every \\(A\\). It must also satisfy\n\n\\[\\int_G K(\\omega,A)\\,P(d\\omega) = P(G\\cap\\{X\\in A\\}), \\qquad G\\in\\mathcal G.\\]\n\nThis identity is the defining compatibility condition between the conditional law and the original probability model.\n\nWhen conditioning on a random variable \\(Y\\), it is often preferable to write the kernel as \\(K(y,A)\\). A probability kernel is measurable in its conditioning argument and a probability measure in its set argument. The required identity becomes\n\n\\[P(X\\in A,Y\\in B) = \\int_B K(y,A)\\,P_Y(dy).\\]\n\nIt says that integrating conditional laws against the marginal distribution of \\(Y\\) reconstructs the joint law. This decomposition is an instance of disintegration.\n\nExistence is assured in the usual statistical setting where \\(X\\) and \\(Y\\) take values in standard Borel spaces. These include finite or countable sets, Euclidean spaces with their Borel sigma-algebras, and many function spaces used for random paths. More generally, a standard Borel state space for \\(X\\) ensures existence of a regular conditional law given a sub-sigma-algebra. Without suitable structural assumptions, conditional expectations of individual indicators can exist even though no compatible regular conditional distribution exists.\n\nUniqueness is an almost-everywhere statement. In the standard Borel setting, two conditional kernels agree as probability measures outside a set of conditioning values having \\(P_Y\\)-measure zero. Their values at a particular exceptional point need not be determined by the joint law. A model may select a continuous or otherwise regular version that gives a convenient value there, but that additional regularity is distinct from the basic definition. The distinction follows naturally from the measure-theoretic approach to probability systematized by Andrey Kolmogorov in 1933: probability identities determine objects up to null sets, rather than necessarily point by point."
    },
    {
      "heading": "Conditional moments, independence, and information",
      "text": "A conditional distribution determines expectations of functions, not only probabilities of events. If \\(g(X)\\) is integrable and \\(K(y,dx)\\) is a conditional law, then\n\n\\[E[g(X)\\mid Y=y] = \\int g(x)\\,K(y,dx)\\]\n\nfor almost every \\(y\\). Taking \\(g(x)=x\\) gives the conditional mean, while \\(g(x)=x^2\\) gives a conditional second moment. The conditional variance is\n\n\\[\\operatorname{Var}(X\\mid Y) = E[X^2\\mid Y]-E[X\\mid Y]^2.\\]\n\nThe full distribution contains more information than these moments: two conditional laws may have identical means and variances while differing in skewness, tail probabilities, or the number of modes.\n\nThe law of total expectation follows by averaging conditional means:\n\n\\[E[X]=E[E[X\\mid Y]].\\]\n\nFor square-integrable \\(X\\), the law of total variance states\n\n\\[\\operatorname{Var}(X) = E[\\operatorname{Var}(X\\mid Y)] + \\operatorname{Var}(E[X\\mid Y]).\\]\n\nThe first term measures variation remaining within groups defined by \\(Y\\); the second measures variation between their conditional means. More generally, if \\(\\mathcal H\\subseteq\\mathcal G\\), the tower property gives\n\n\\[E[E[X\\mid\\mathcal G]\\mid\\mathcal H] = E[X\\mid\\mathcal H].\\]\n\nThis expresses consistency when information is first used in detail and then reduced.\n\nThe law of total variance does not say that every observed value of \\(Y\\) lowers the conditional variance. Let \\(Y\\) be equally likely to be \\(0\\) or \\(1\\), and suppose\n\n\\[X\\mid Y=0\\sim N(0,1), \\qquad X\\mid Y=1\\sim N(0,9).\\]\n\nThen \\(\\operatorname{Var}(X)=5\\), but \\(\\operatorname{Var}(X\\mid Y=1)=9\\). The observation \\(Y=1\\) reveals that a more variable component generated \\(X\\). Additional information reduces average optimal squared prediction error, not necessarily uncertainty according to every criterion at every realized observation.\n\nStatistical independence has a direct conditional characterization. The variables \\(X\\) and \\(Y\\) are independent if and only if the conditional law of \\(X\\) given \\(Y\\) equals its marginal law almost surely. Equality of conditional means alone is weaker. In the preceding variance-mixture example, \\(E[X\\mid Y]=0\\) for both values of \\(Y\\), yet \\(X\\) and \\(Y\\) are dependent because their conditional variances differ. Likewise, zero correlation does not generally imply equality of conditional and marginal distributions.\n\nConditional independence of \\(X\\) and \\(Z\\) given \\(Y\\) means that, once \\(Y\\) is known, learning \\(Z\\) does not further change the conditional law of \\(X\\). In suitable versions,\n\n\\[\\mathcal L(X\\mid Y,Z)=\\mathcal L(X\\mid Y).\\]\n\nFor discrete variables, conditional entropy averages the entropy of the conditional laws. When the quantities are finite, the reduction\n\n\\[H(X)-H(X\\mid Y)=I(X;Y)\\]\n\nis mutual information. It measures average distributional information, rather than only improvements in predicting a mean."
    },
    {
      "heading": "Important distributional families",
      "text": "Several classical families have particularly useful conditional laws. If \\(X\\) and \\(Y\\) are jointly multivariate normal, with mean vector and covariance matrix\n\n\\[\\begin{pmatrix}\\mu_X\\\\\\mu_Y\\end{pmatrix}, \\qquad \\begin{pmatrix} \\Sigma_{XX}&\\Sigma_{XY}\\\\ \\Sigma_{YX}&\\Sigma_{YY} \\end{pmatrix},\\]\n\nand \\(\\Sigma_{YY}\\) is invertible, then\n\n\\[X\\mid Y=y\\sim N\\!\\left( \\mu_X+\\Sigma_{XY}\\Sigma_{YY}^{-1}(y-\\mu_Y), \\Sigma_{XX}-\\Sigma_{XY}\\Sigma_{YY}^{-1}\\Sigma_{YX} \\right).\\]\n\nThe conditional mean is affine in \\(y\\), and the conditional covariance does not depend on \\(y\\). The latter property is special: many non-Gaussian models have conditional spread that changes with the observed value.\n\nFor standardized scalar normal variables with correlation \\(\\rho\\), the formula reduces to\n\n\\[X\\mid Y=y\\sim N(\\rho y,1-\\rho^2).\\]\n\nIf \\(\\rho=0\\), the conditional distribution equals the marginal distribution, reflecting the fact that uncorrelated jointly Gaussian variables are independent. If \\(|\\rho|=1\\), the joint law is singular and the conditional distribution becomes a point mass. Joint normality is essential: normal marginal distributions by themselves do not justify either the conditional formula or the independence conclusion. In computation, the displayed inverse is usually implemented by solving linear systems rather than explicitly forming an inverse matrix.\n\nCount distributions provide another fundamental example. Suppose \\(X\\) and \\(Y\\) are independent Poisson variables with means \\(\\lambda\\) and \\(\\mu\\), both positive. Conditional on their total,\n\n\\[X\\mid X+Y=n \\sim \\operatorname{Binomial} \\left(n,\\frac{\\lambda}{\\lambda+\\mu}\\right).\\]\n\nIndeed, dividing\n\n\\[P(X=k,Y=n-k) = e^{-(\\lambda+\\mu)} \\frac{\\lambda^k\\mu^{n-k}}{k!(n-k)!}\\]\n\nby \\(P(X+Y=n)\\) yields the binomial mass function. The total describes how many events occurred, while the conditional distribution describes their allocation between two categories. With more independent Poisson counts, conditioning on their sum produces a multinomial distribution.\n\nSampling without replacement produces a different allocation law. In a population of \\(N\\) objects containing \\(K\\) marked objects, the number \\(X\\) of marked objects in a uniformly chosen sample of size \\(n\\) satisfies\n\n\\[P(X=k\\mid K) = \\frac{\\binom Kk\\binom{N-K}{n-k}}{\\binom Nn},\\]\n\nfor feasible \\(k\\). If \\(K\\) is fixed by design, this is simply the sampling distribution indexed by \\(K\\); if \\(K\\) is random, it is literally a conditional law. This distinction separates a parameterized family from a probabilistic model for the parameter itself.\n\nConditional families also need not match their marginals. If \\(X\\mid\\Lambda=\\lambda\\) is Poisson and \\(\\Lambda\\) has a gamma distribution, integrating out \\(\\Lambda\\) produces a negative-binomial marginal distribution. Conditional Poisson variation can therefore coexist with marginal variance exceeding the marginal mean. Such mixture constructions make clear why a distributional assumption must specify whether it concerns an unconditional population, a subgroup, or a latent-variable condition."
    },
    {
      "heading": "Statistical inference and predictive distributions",
      "text": "In statistics, a model often specifies the conditional distribution of observed data \\(D\\) given a parameter \\(\\theta\\). If the parameter is treated as fixed, this is a family of sampling distributions indexed by \\(\\theta\\). The same expression, viewed as a function of \\(\\theta\\) for fixed observed data, is the likelihood function. A likelihood need not integrate to one over parameter values, so it is not automatically a conditional distribution of the parameter.\n\nIn Bayesian inference, a prior distribution makes the parameter part of a joint probability model. Bayes’ theorem then gives a posterior distribution\n\n\\[\\pi(\\theta\\mid d) = \\frac{p(d\\mid\\theta)\\pi(\\theta)} {\\int p(d\\mid u)\\pi(u)\\,du},\\]\n\nwhen the denominator is positive and finite. The denominator is the marginal likelihood of the observation. This formula is a conditional-density calculation with the roles of parameter and data reversed; its interpretation depends on the joint model supplied by the prior and sampling law.\n\nFor a concrete example, let \\(X\\mid\\theta\\) be binomial with \\(n\\) trials and success probability \\(\\theta\\), and let \\(\\theta\\) have a beta distribution with parameters \\(a,b>0\\). After observing \\(X=x\\),\n\n\\[\\theta\\mid X=x \\sim \\operatorname{Beta}(a+x,b+n-x).\\]\n\nFor a further Bernoulli outcome \\(Z\\), conditionally independent of \\(X\\) given \\(\\theta\\),\n\n\\[P(Z=1\\mid X=x)=\\frac{a+x}{a+b+n}.\\]\n\nThe predictive probability is obtained by averaging the success probability over the posterior, not by treating an estimated parameter as known without uncertainty.\n\nMore generally, the posterior predictive distribution is\n\n\\[p(\\widetilde x\\mid d) = \\int p(\\widetilde x\\mid\\theta,d)\\pi(\\theta\\mid d)\\,d\\theta.\\]\n\nIf future and observed data are conditionally independent given \\(\\theta\\), the first factor simplifies to \\(p(\\widetilde x\\mid\\theta)\\). For several future outcomes, integrating over a shared uncertain parameter can create predictive dependence even when those outcomes are conditionally independent given that parameter. This is one reason a full predictive distribution differs from a list of separate point predictions.\n\nConditional distributions also connect prediction to decision theory. Under squared-error loss, the optimal prediction is the conditional mean. Under absolute-error loss, any conditional median is optimal. Minimizing the asymmetric loss\n\n\\[\\rho_\\tau(u)=u\\bigl(\\tau-\\mathbf1_{\\{u<0\\}}\\bigr), \\qquad 0<\\tau<1,\\]\n\nproduces a conditional quantile. A regression model for \\(E[X\\mid Y]\\) therefore specifies only one functional of the conditional law. To calculate prediction intervals, threshold exceedance probabilities, or asymmetric decision risks, additional distributional information is required. A prediction interval concerns a future outcome, whereas a confidence interval concerns a parameter under repeated sampling; the two are not interchangeable."
    },
    {
      "heading": "Stochastic processes and graphical factorization",
      "text": "For a stochastic process \\((X_t)\\), conditional distributions describe how the system evolves as observations accumulate. A filtration \\((\\mathcal F_t)\\) represents information available through time \\(t\\). The law of \\(X_{t+1}\\) given \\(\\mathcal F_t\\) is a one-step predictive law. In a general process it can depend on the entire observed past, not only the most recent state.\n\nThe Markov property states that the present state contains the information from the past needed to predict the future. For a discrete-time Markov chain,\n\n\\[P(X_{t+1}\\in A\\mid X_0,\\ldots,X_t) = P(X_{t+1}\\in A\\mid X_t).\\]\n\nA time-homogeneous transition kernel \\(K(x,A)\\) specifies this conditional distribution without explicit dependence on \\(t\\). In a finite state space, its values form a transition matrix. Repeated prediction follows kernel composition:\n\n\\[K^{n+m}(x,A) = \\int K^m(z,A)\\,K^n(x,dz),\\]\n\nan instance of the Chapman–Kolmogorov equations.\n\nIn a hidden Markov model, states are unobserved and measurements provide partial information about them. If \\(K\\) is the transition kernel, \\(g(y_t\\mid x_t)\\) is an observation density, and \\(\\pi_{t-1}\\) is the conditional law of the previous state given past observations, prediction gives\n\n\\[\\pi_{t\\mid t-1}(dx_t) = \\int K(x_{t-1},dx_t)\\,\\pi_{t-1}(dx_{t-1}).\\]\n\nThe observation then updates this law:\n\n\\[\\pi_t(dx_t) = \\frac{g(y_t\\mid x_t)\\pi_{t\\mid t-1}(dx_t)} {\\int g(y_t\\mid u)\\pi_{t\\mid t-1}(du)}.\\]\n\nFiltering is thus an alternating sequence of conditional prediction and conditioning on new evidence. In linear Gaussian models, the Kalman filter implements these operations using means and covariance matrices.\n\nConditional laws also organize multivariable models without a time ordering. The probability chain rule factors a joint density or mass function as\n\n\\[p(x_1,\\ldots,x_n) = p(x_1)\\prod_{i=2}^n p(x_i\\mid x_1,\\ldots,x_{i-1}).\\]\n\nA Bayesian network uses a directed acyclic graph to replace each full predecessor set with a smaller parent set:\n\n\\[p(x_1,\\ldots,x_n) = \\prod_i p(x_i\\mid x_{\\mathrm{pa}(i)}).\\]\n\nThe local conditional laws encode restrictions on dependence, and graph structure can support efficient inference.\n\nLocal conditional specifications nevertheless require care. A complete collection of full conditionals, each describing one component given all the others, is not automatically compatible with a common joint distribution. When compatibility holds, these conditionals can support Gibbs sampling, a form of Markov chain Monte Carlo. Each update draws one component from its conditional law given the current values of the others. The intended joint law is invariant under such updates, but convergence from a chosen starting point requires additional conditions. Narrow, strongly dependent conditional laws can also make the chain explore the joint distribution slowly."
    },
    {
      "heading": "Estimation, conditioning choices, and causal interpretation",
      "text": "In applications, the joint law is usually unknown, so a conditional distribution must be estimated. Parametric methods specify a family \\(p_\\theta(x\\mid y)\\) and estimate \\(\\theta\\), often by maximum likelihood. Generalized linear models specify conditional distributions through an exponential-family structure and a link between predictors and the conditional mean. Other methods estimate conditional quantiles or an entire conditional density. These are different statistical targets: accurately estimating a mean does not ensure accurate tail probabilities.\n\nNonparametric estimation can approximate conditioning by assigning greater weight to observations with predictor values near \\(y\\). For scalar observations \\((X_i,Y_i)\\), a conditional-density estimator can take the form\n\n\\[\\widehat f(x\\mid y) = \\frac{ \\sum_{i=1}^n K_h(x-X_i)L_b(y-Y_i) }{ \\sum_{i=1}^n L_b(y-Y_i) },\\]\n\nwhere \\(K_h\\) and \\(L_b\\) are nonnegative kernel densities with bandwidths \\(h\\) and \\(b\\). The denominator normalizes the local weights. Where few observations are near \\(y\\), the estimate is unstable or poorly determined. With many conditioning variables, the curse of dimensionality makes local estimation increasingly data-intensive, motivating structural assumptions, dimension reduction, or regularization.\n\nConditioning also depends on precisely what information has been specified. A familiar zero-probability difficulty, often called the Borel paradox, arises when an informal phrase such as “a point lies on this curve” leaves the observation mechanism unspecified. For a point distributed uniformly on a sphere, shrinking bands of different geometric shapes around a great circle can induce different limiting distributions along that circle. There is no contradiction once the conditioning variable or shrinking-event procedure is fixed. The ambiguity lies in trying to infer a unique conditional law from the limiting set alone.\n\nMost importantly, observational conditioning is not generally causal intervention. The distribution\n\n\\[P(Y\\in A\\mid X=x)\\]\n\ndescribes outcomes among cases in which \\(X=x\\) is observed. An intervention that externally sets \\(X\\) to \\(x\\) changes the mechanism generating \\(X\\), and its outcome distribution need not match that observed subgroup. Causal inference therefore requires assumptions about causal structure or experimental assignment in addition to the observational joint distribution. A predictive conditional model, however accurate, does not by itself identify the effect of changing its predictor.\n\nConditioning can even create associations. If independent fair coin indicators \\(X\\) and \\(Y\\) are conditioned on \\(X+Y=1\\), then \\(Y=1-X\\): within that selected group they are perfectly negatively associated. In graphical terms, conditioning on a shared effect can induce dependence between otherwise independent causes. This mechanism underlies some forms of selection bias. Relatedly, group-specific conditional relationships can differ from a marginal relationship because the groups receive different mixture weights. Interpreting a conditional distribution therefore requires identifying the conditioning variables, the population selected by them, and the process by which observations enter the data."
    }
  ],
  "links": [
    "probability-distribution",
    "random-variable",
    "joint-probability-distribution",
    "conditional-probability",
    "probability-mass-function",
    "poisson-distribution",
    "probability-density-function",
    "lebesgue-measure",
    "uniform-distribution",
    "cumulative-distribution-function",
    "measure-theory",
    "probability-space",
    "sigma-algebra",
    "conditional-expectation",
    "indicator-function",
    "borel-sigma-algebra",
    "andrey-kolmogorov",
    "expected-value",
    "variance",
    "statistical-independence",
    "correlation",
    "conditional-independence",
    "conditional-entropy",
    "mutual-information",
    "multivariate-normal-distribution",
    "covariance-matrix",
    "inverse-matrix",
    "binomial-distribution",
    "statistics",
    "likelihood-function",
    "bayesian-inference",
    "prior-distribution",
    "bayes-theorem",
    "posterior-distribution",
    "marginal-likelihood",
    "beta-distribution",
    "posterior-predictive-distribution",
    "decision-theory",
    "loss-function",
    "median",
    "quantile",
    "prediction-interval",
    "stochastic-process",
    "filtration-probability",
    "markov-property",
    "markov-chain",
    "transition-matrix",
    "chapman-kolmogorov-equations",
    "hidden-markov-model",
    "kalman-filter",
    "bayesian-network",
    "markov-chain-monte-carlo",
    "maximum-likelihood-estimation",
    "generalized-linear-model",
    "curse-of-dimensionality",
    "causal-inference",
    "selection-bias"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}