The generalized method of moments (GMM) is a framework for estimating parameters from restrictions on the expected values of functions of observed data. Rather than requiring a complete specification of the data’s probability distribution, GMM uses moment conditions that should hold at the true parameter values and selects estimates that make their sample counterparts as close to zero as possible. It generalizes the method of moments by allowing more moment conditions than unknown parameters and by weighting those conditions according to their statistical precision and dependence. GMM is widely used in econometrics, especially for instrumental-variable models, dynamic models, and economic models defined by equilibrium or optimality conditions.
Moment conditions and the estimator
Let denote the observed data for observation , let be the true parameter vector, and let be a vector of known functions. The model supplies the population restrictions
The components of are called moment functions. Although the term “moment” often refers to expectations of powers, such as means and second moments, GMM also accommodates expectations of much more general functions.
For a sample of size , define
The GMM estimator is
where is a symmetric positive-definite weighting matrix. The transpose symbol converts the vector of sample moments into a scalar quadratic form.
The criterion measures a weighted distance between the sample moments and zero. Its minimization is a problem in mathematical optimization. Depending on the moment functions, it may admit a closed-form solution or require numerical methods.
Identification
Moment conditions identify a parameter when they distinguish it from other possible parameter values. A standard global identification requirement is
For regular local identification, the derivative matrix
must have full column rank . This condition requires at least as many moment conditions as parameters, although counting conditions alone does not establish identification.
- Exactly identified: . If the sample moment equations have a unique solution, that solution minimizes the criterion at zero regardless of the positive-definite weighting matrix.
- Overidentified: . The sample moment equations generally cannot all be satisfied exactly, so the weighting matrix determines how their discrepancies are balanced.
- Underidentified in the regular rank sense: . The derivative matrix cannot have full column rank, and the usual regular GMM theory does not apply.
Nonlinear models can have identification features not captured by simple equation counting. Global uniqueness and local rank therefore serve distinct purposes.
Relationship to other estimation methods
Ordinary method of moments
The ordinary method of moments commonly estimates parameters by equating theoretical moments to their sample analogues. For example, a distribution with unknown mean and variance may be estimated using the first two sample moments.
GMM permits additional valid restrictions. Rather than choosing an arbitrary subset of them, it combines all selected moments through a weighted criterion. Ordinary method-of-moments estimation is therefore a special case.
Least squares and instrumental variables
For a linear regression model
suppose is a vector of instruments satisfying
The moment function is
These are the orthogonality conditions underlying instrumental-variable estimation. Instruments are useful when regressors are correlated with the disturbance, a form of endogeneity that invalidates the usual least-squares moment conditions.
With , the sample equations become
which are the normal equations for ordinary least squares, provided the regressor matrix has full column rank.
More generally, let be the regressor matrix, the instrument matrix, and the outcome vector. For a fixed weighting matrix, linear GMM gives
when the required inverse exists. Choosing proportional to produces two-stage least squares. Other weights can improve asymptotic efficiency when the disturbances have nonconstant variance or dependence.
Maximum likelihood
Maximum likelihood estimation uses a specified probability model and its likelihood. GMM generally requires only selected expectation restrictions.
Under regularity conditions, the likelihood score has expectation zero at the true parameter. Score equations can therefore be treated as moment equations, and a unique interior maximum-likelihood solution may be represented as an exactly identified GMM solution.
This connection does not imply that an arbitrary GMM estimator is as efficient as maximum likelihood. A correctly specified likelihood may contain information not captured by the selected moments. Conversely, correctly specified moment restrictions can remain valid when some other aspects of a proposed likelihood are incorrect.
Weighting and asymptotic efficiency
The weighting matrix controls how GMM combines the moments. Equal weighting is simple but need not be statistically efficient: moment conditions may have very different variances and may be strongly correlated.
Suppose
where is the limiting covariance matrix of the scaled sample moments. If converges in probability to a positive-definite matrix , regularity conditions yield
with
This result follows from a local expansion of the sample moments and a suitable central limit theorem. Consistency additionally requires identification, appropriate convergence of the sample criterion, and conditions ensuring that the minimizer behaves regularly.
For a fixed set of valid moment conditions, the asymptotically efficient choice is
giving
Efficiency here is relative to regular GMM estimators using the specified moments. It does not automatically establish efficiency relative to every estimator that could use the data.
Independent and dependent observations
For independent, identically distributed observations,
because the moment vector has mean zero.
For time-series data, dependence across observations must also be accounted for. Under suitable stationarity and dependence conditions,
This is a long-run covariance matrix. Estimation commonly uses a heteroskedasticity- and autocorrelation-consistent covariance estimator. With clustered data, the covariance calculation instead accommodates dependence within clusters under an appropriate cluster asymptotic framework.
A covariance estimator must match the dependence structure. Accounting for unequal variances alone does not address serial correlation or clustering.
Practical estimation procedures
One-step and two-step GMM
One-step GMM uses a prespecified weighting matrix, such as the identity matrix or another convenient positive-definite choice. With valid identification and suitable regularity conditions, it can be a consistent estimator even when its weighting is inefficient.
Two-step GMM proceeds as follows:
- Obtain a preliminary consistent estimate .
- Estimate using moment functions evaluated at .
- Re-estimate the parameters using .
The second-stage estimator is asymptotically efficient for the chosen moment set if consistently estimates .
Iterated GMM repeats covariance estimation and parameter estimation until a stopping rule is satisfied. It shares the same first-order asymptotic distribution as efficient two-step GMM under standard conditions, although its finite-sample behavior can differ.
Continuously updated GMM
The continuously updated estimator allows the covariance estimate to vary with the candidate parameter:
Unlike two-step GMM, it does not hold the estimated weighting matrix fixed during the final minimization. This can change higher-order and finite-sample properties, but it also makes the optimization more demanding. It is not uniformly superior across models and sample sizes.
Numerical considerations
Poorly scaled moments, nearly redundant restrictions, and an ill-conditioned covariance estimate can impair numerical stability. Nonlinear criteria may also have multiple local minima or flat regions.
Analytic derivatives, automatic differentiation, suitable parameterizations, and checks using multiple starting values can help evaluate numerical solutions. A small objective value alone does not establish identification or substantive model validity.
Statistical inference and specification testing
Estimated asymptotic covariance matrices support standard errors, confidence intervals, and parameter tests. If estimates the covariance of , the approximate covariance of is .
The Hansen J test
In an overidentified model, efficient GMM also provides a test of whether all selected moment restrictions are jointly compatible with the data. The statistic is
Under correct specification and the usual regularity and rank conditions,
The reference chi-squared distribution has degrees of freedom, representing the restrictions remaining after parameter estimation.
The test concerns the joint validity of the moment restrictions and the maintained model structure. Rejection does not identify which instrument or assumption is responsible. Non-rejection does not establish that every instrument is valid: the test may have low power, particularly with weak identification or many instruments. In an exactly identified model with a sample moment solution, there are no overidentifying restrictions to test.
Applications
GMM is particularly useful when theory specifies expectations more naturally than complete probability distributions.
Instrumental-variable models: Orthogonality restrictions connect instruments to structural disturbances.
Dynamic panel models: Lagged observations can supply instruments for equations containing lagged dependent variables, subject to specific assumptions about disturbances and initial conditions.
Asset pricing: Pricing equations imply restrictions such as
where is a stochastic discount factor and is a gross return.
Structural economic models: First-order conditions and equilibrium restrictions generate moments without requiring a complete likelihood.
Conditional moment models: Restrictions of the form
imply unconditional moments
for suitable instrument functions . This construction uses properties of conditional expectation.
A finite collection of unconditional moments generally captures only part of a conditional restriction. Choosing instrument functions therefore affects both information content and estimator performance.
Limitations and qualifications
Weak identification. When moments change only slightly with the parameters, the derivative matrix may be nearly rank-deficient. Conventional normal approximations and parameter tests can then be unreliable, even in fairly large samples.
Many moments or instruments. Adding valid moments can improve population efficiency, but estimating a large covariance matrix introduces sampling noise. Numerous instruments can increase finite-sample bias and weaken the usefulness of specification tests. Standard fixed-dimension asymptotic formulas need not remain valid when the number of moments grows with sample size.
Invalid moments. GMM does not correct incorrect identifying assumptions. If no parameter satisfies all population restrictions, the estimator generally converges to a criterion-minimizing pseudo-true value. That value can depend on the weighting scheme, and conventional correctly specified covariance formulas may fail.
Finite-sample uncertainty. Asymptotic efficiency does not guarantee small finite-sample error. In particular, conventional two-step standard errors can understate uncertainty in some dynamic panel applications; specialized finite-sample corrections have been developed for such settings.
Distributional robustness is limited. Avoiding a fully specified likelihood does not make GMM insensitive to outliers, heavy tails, or dependence. Required expectations may fail to exist, and the laws of large numbers or central limit theorems needed for conventional inference may not apply.
Historical development
The method of moments predates GMM, as do least-squares and instrumental-variable methods that can be represented within its framework. The modern general formulation is associated with Lars Peter Hansen’s 1982 paper, Large Sample Properties of Generalized Method of Moments Estimators. It established a unified large-sample theory for estimation from moment restrictions, including dependent observations, optimal weighting, and tests of overidentifying restrictions.
Later developments extended the framework to dynamic panels, simulated moments, conditional restrictions, alternative updating schemes, and settings with weak or numerous instruments. These extensions differ principally in how they construct moments, estimate their covariance, and handle departures from conventional fixed-dimensional asymptotic assumptions.