The F distribution is a continuous probability distribution obtained by dividing two independent chi-squared random variables, each normalized by its degrees of freedom. It is a fundamental sampling distribution in statistics, especially for comparing variances, conducting analysis of variance, and testing restrictions in linear regression. The ordinary F distribution is also called the central F distribution, distinguishing it from the noncentral F distribution that arises under many alternative hypotheses.
Definition
Let and be random variables such that
with statistical independence between them. Then
has an F distribution with numerator degrees of freedom and denominator degrees of freedom , written
Both parameters may be any positive real numbers, although they are usually positive integers in elementary applications.
An F-distributed variable is positive with probability one. The order of its parameters matters: and are generally different distributions. Independence is essential; a ratio of dependent scaled chi-squared variables need not have an F distribution.
Density and distribution function
For , the probability density function is
where denotes the gamma function. The density is zero for .
The cumulative distribution function can be expressed through the regularized incomplete beta function:
where
This representation connects the F distribution to beta-distribution calculations and is important for numerical evaluation of probabilities and critical values.
Shape and moments
The F distribution is generally right-skewed. Its shape depends on both degrees-of-freedom parameters:
- If , the density diverges as approaches zero from above.
- If , the density approaches a finite, positive value at zero and decreases thereafter.
- If , the density rises to an interior mode and then decreases.
For , the mode is
The mean exists only when , in which case
In particular, the mean is not generally one, even though the distribution is constructed from a ratio of two variables whose normalized means are each one.
The variance exists only when , and is
More generally, for real ,
provided
The denominator degrees of freedom determine the existence of positive moments. For large , the density is proportional asymptotically to ; small denominator degrees of freedom therefore produce particularly heavy right tails.
Relationships with other distributions
Reciprocal identity
Reversing the numerator and denominator gives
If denotes the -quantile of , then
This identity is useful for converting lower-tail critical values into upper-tail critical values.
Beta distribution
If , then
Conversely, if has this beta distribution, then
has the corresponding F distribution.
Student's t distribution
If has Student's t distribution with degrees of freedom, then
Consequently, in the classical normal linear model, a two-sided t-test of a single coefficient is equivalent to the corresponding F-test with one numerator degree of freedom.
Limiting distributions
For fixed , as tends to infinity,
For fixed , as tends to infinity,
When both degrees of freedom tend to infinity, the distribution concentrates around one.
Statistical applications
An F-test is a hypothesis test whose test statistic follows an F distribution under the null hypothesis, either exactly under specified assumptions or approximately. Different F-tests use different statistics and assumptions; the name does not identify a single testing procedure.
Comparing two population variances
Consider two independent samples of sizes and from normal populations with variances and . Let and be the sample variances calculated using denominators and . Then
Under the hypothesis ,
A two-sided test uses both tails because either unusually large or unusually small ratios can contradict equality.
The same relationship yields an exact confidence interval for the variance ratio. Write , and let denote the -quantile of . An equal-tailed interval with confidence level is
Analysis of variance
In a one-way analysis of variance with independent groups and total observations, the classical statistic is
Here measures variation among group sample means, weighted by group size, and measures variation around the respective group means.
Under equal population means, independent normally distributed errors, and a common error variance,
Large values provide evidence against equality of all group means. Rejection establishes that the means are not all equal; it does not identify which groups differ. Follow-up comparisons constitute additional inference and may involve multiple-testing considerations.
Nested regression models
For two nested linear regression models fitted to the same observations by ordinary least squares, let:
- be the restricted model's residual sum of squares;
- be the unrestricted model's residual sum of squares;
- be the number of independent restrictions;
- be the number of freely estimated regression coefficients in the unrestricted model.
The statistic
has an distribution under the restrictions, provided the classical normal, independent, constant-variance error assumptions hold and the model matrices have the required ranks.
This formulation includes tests of whether several regression coefficients are jointly zero and the overall significance test for a regression with an intercept.
Tail probabilities
For an upper-tail F-test with observed value , the p-value is
The rejection threshold at significance level is . Two-sided variance tests require a specified two-tail procedure rather than automatic use of this upper-tail rule.
Noncentral F distribution
The noncentral F distribution extends the construction by allowing the numerator to have a noncentral chi-squared distribution:
where and are independent and is the noncentrality parameter. It is commonly written . Setting gives the central F distribution.
The noncentral distribution describes many F-statistics when an alternative hypothesis is true. It is used to calculate statistical power and determine sample sizes for specified alternatives.
For example, in a fixed-effects one-way normal model with common variance ,
Here and are the size and population mean of group . The parameter combines the separation of group means, their sample sizes, and the error variance.
Assumptions and limitations
The exact F laws used in classical procedures arise from independent chi-squared quantities with appropriate scale factors. In many applications, this structure follows from a normal model and an orthogonal decomposition of sums of squares.
Important limitations include:
- Sensitivity of variance-ratio tests to nonnormality. The classical two-sample variance test can have substantially incorrect rejection rates for nonnormal populations.
- Unequal error variances. Classical analysis-of-variance and regression F-tests need not retain their stated null distributions when errors have unequal variances.
- Dependent observations. Repeated measurements, clustered data, or serially correlated errors generally invalidate the simplest independent-error formulas.
- Exact versus approximate reference distributions. Some procedures use F approximations with adjusted, noninteger degrees of freedom. Their calibration is distinct from the exact chi-squared-ratio derivation.
A statistically significant F-test concerns the particular joint hypothesis being tested. It does not, by itself, measure practical importance or establish causation.
Historical background
The distribution is closely associated with Ronald A. Fisher and the development of variance-based statistical inference in the early twentieth century. George W. Snedecor introduced the designation F in Fisher's honor and helped establish its practical use through statistical tables and agricultural applications. The alternative name Fisher–Snedecor distribution reflects these contributions.