Exponential smoothing is a family of methods for analyzing and forecasting a time series by recursively updating estimates of its underlying components. In its simplest form, each new observation is combined with the previous estimate of the series’ level, producing weights that decrease geometrically with the age of the observations. Extensions incorporate trend, seasonality, and damped trend. The methods are widely used for demand, sales, inventory, and operational forecasting because they require relatively little computation and can adapt as new data arrive.
Simple exponential smoothing
Simple exponential smoothing is appropriate for a series whose level may change over time but which has no substantial trend or seasonal pattern. Let be the observation at time , and let be the estimated level after observing . The updating equation is
where is the smoothing parameter and is an initial level.
This recurrence relation can also be written as an error-correction equation:
The new level is therefore the previous level plus a fraction of the latest one-step forecast error.
Repeated substitution gives
The observation weights follow a geometric sequence. For , they can also be expressed using an exponential function:
This exponential decay gives the method its name. It does not imply that the observations themselves follow an exponential growth curve.
Responsiveness and memory
A larger gives more weight to recent observations, allowing faster adaptation but also transmitting more short-term variation. A smaller produces a smoother estimate with a longer memory, but responds more slowly to changes.
At the endpoints:
- makes the level equal to the latest observation.
- leaves the initial level unchanged.
For , the half-life of an observation’s weight, measured in observation intervals, is
For example, with , an observation’s relative weight halves approximately every 3.1 intervals.
Unlike a fixed-window moving average, exponential smoothing does not discard an observation abruptly when it reaches a particular age. Its influence decreases continuously. A recursive implementation needs only the previous level, rather than a stored window of past observations.
Forecasts
The forecast made at time for periods ahead is
Thus, simple exponential smoothing produces a flat forecast path. The level can change when new observations arrive, but a forecast made at a fixed time contains neither an extrapolated trend nor a seasonal cycle.
For example, if , , and , then
All future point forecasts made at that time are 102. This does not imply that future observations will be constant; their uncertainty generally increases with the forecast horizon.
Trend methods
Holt’s linear method
Holt’s method extends simple exponential smoothing by maintaining both a level and a trend :
Here, estimates the change per observation interval, and controls how quickly the trend estimate adjusts. The forecast is
The method allows both level and trend to evolve, rather than fitting one fixed straight line to the entire history as in a basic linear regression model.
“Double exponential smoothing” is sometimes used for Holt’s method, but it also refers to Brown’s method, which derives level and trend estimates by smoothing a series twice. These constructions are related but are not interchangeable.
Damped trend
A linear trend extrapolated indefinitely can produce implausibly large increases or decreases. Damped-trend exponential smoothing introduces a damping parameter , conventionally with :
The forecast becomes
The trend contribution increases with the horizon but approaches a finite limit:
When , the equations reduce to Holt’s undamped method. Damping changes the extrapolation of trend; it is distinct from the smoothing parameters that govern adaptation to observations.
Seasonal methods
Holt–Winters methods add a seasonal component with a known period , such as for annual seasonality in monthly data. Their usual forms distinguish additive from multiplicative seasonality.
Additive seasonality
Additive seasonality is appropriate when seasonal fluctuations have roughly constant magnitude in the units of the observations. One common formulation is
Here, controls seasonal updating. Define the index of the most recently estimated seasonal state for the forecasted position as
Then
Seasonal effects are usually normalized to sum to zero over a cycle so that they can be distinguished from the level.
Multiplicative seasonality
Multiplicative seasonality describes fluctuations whose magnitude is approximately proportional to the series’ level. A common formulation is
with forecast
Seasonal factors are commonly normalized to average one. These equations require suitable nonzero denominators and are ordinarily used for strictly positive series.
Alternative Holt–Winters parameterizations use different seasonal updating equations. Consequently, parameter values from different implementations need not be directly comparable. Seasonal methods can also be combined with damped trend or used without a trend component.
Statistical state-space formulation
The updating equations alone specify point forecasts but do not completely specify the distribution of future observations. A state-space model adds an explicit probabilistic description of observations and evolving latent states.
For example, simple exponential smoothing with additive errors can be written as
where is a zero-mean innovation. A common specification assumes independent innovations with a normal distribution and constant variance . The same innovation enters both the observation and state equations.
This framework underlies the ETS classification, whose three positions describe:
- Error: additive or multiplicative.
- Trend: none, additive, or a supported damped or multiplicative form.
- Seasonality: none, additive, or multiplicative.
Thus ETS(A,N,N) denotes additive errors with no trend or seasonality, while ETS(A,Ad,A) denotes additive errors, damped additive trend, and additive seasonality. Not every conceivable combination is statistically or numerically suitable.
The error specification is separate from the seasonal specification. Multiplicative errors describe uncertainty relative to the predicted level; multiplicative seasonality describes how the seasonal pattern scales with level. Different error models can give the same point-forecast equations but different likelihoods and uncertainty intervals.
Prediction intervals
A prediction interval describes uncertainty about a future observation, rather than uncertainty about an estimated mean alone.
For the additive simple exponential smoothing model above, conditional on known parameters and the state at time ,
Under Gaussian innovations, this gives the interval
where is a standard-normal quantile and is the nominal coverage probability. This expression does not include uncertainty from estimating the parameters or current state.
More complicated ETS models may require recursive calculations or simulation. Their intervals depend on the selected model, including whether uncertainty is additive or multiplicative.
Estimation and model selection
Smoothing parameters and initial states may be fixed in advance or estimated jointly through mathematical optimization. For additive-error models, a common objective is to minimize the sum of squared one-step forecast errors:
Under independent Gaussian innovations with constant variance, minimizing this objective is closely connected to maximum likelihood estimation. Models with multiplicative errors generally require a likelihood that accounts for scale-dependent uncertainty.
Initialization matters, especially for short series or small smoothing parameters. Possible approaches include:
- Using an early observation or an average of early observations for the initial level.
- Estimating an initial trend from differences or a regression.
- Estimating seasonal states from several complete cycles.
- Optimizing initial states jointly with smoothing parameters.
Seasonal normalization constraints prevent the level and seasonal components from representing the same variation redundantly. Parameter restrictions may also be needed to ensure stable, admissible model behavior; conventional componentwise bounds do not by themselves describe every statistical admissibility condition.
Models can be compared using likelihood-based criteria and out-of-sample forecast performance. Time-series cross-validation preserves temporal order, repeatedly fitting to past data and forecasting subsequent observations. Randomly shuffling observations can leak future information into model fitting.
A model with small one-step errors is not necessarily best for a longer forecast horizon. Evaluation therefore depends on both the horizon and the chosen loss function. Measures such as mean squared error emphasize large errors, while percentage measures can behave poorly when observations are zero or near zero.
Relationships to other methods
ARIMA models
Some linear exponential smoothing methods have equivalent ARIMA representations. For simple exponential smoothing,
which is an ARIMA(0,1,1) representation under the displayed sign convention. The corresponding forecasts agree when initialization and parameterization are aligned.
Holt’s linear method also has an ARIMA representation under suitable conditions. However, the families are not identical: their usual parameter restrictions differ, and nonlinear ETS models do not generally reduce to linear ARIMA models.
Kalman filtering
The Kalman filter updates latent-state estimates using forecast errors multiplied by a gain. This resembles the error-correction form of exponential smoothing. For suitable linear state-space models, exponential smoothing can be interpreted as a constant-gain update, while a Kalman filter may use a gain that changes over time and can approach a steady value.
Smoothing versus forecasting
Despite its name, exponential smoothing ordinarily uses only observations available up to the current time. It is therefore a causal filter and forecasting method. It differs from retrospective smoothers that use both earlier and later observations to estimate a historical state.
Applications and limitations
Exponential smoothing is used in inventory control, sales forecasting, production planning, staffing, and other settings involving many regularly observed series. Simple and nonseasonal methods require only a small number of stored states; seasonal methods additionally retain seasonal states. This makes sequential updating computationally inexpensive.
Its principal limitations follow from its structure:
- Limited explanatory information. Basic methods use a series’ own history and do not directly represent prices, promotions, weather, or other external predictors.
- Adaptation lag. Abrupt changes can produce repeated forecast errors before the estimated components adjust.
- Sensitivity to unusual observations. Large errors can shift the estimated level, trend, or seasonal pattern.
- Restricted seasonality. Standard Holt–Winters methods represent one fixed seasonal period, not several interacting or changing periods.
- Difficult data regimes. Intermittent demand, long runs of zeros, irregular observation times, and changing seasonal calendars can require specialized models.
- Extrapolation constraints. Additive forecasts can become negative, and undamped trends can become implausible at long horizons.
Standard formulas presume equally spaced observations. Applying the same smoothing parameter to observations separated by different time gaps does not preserve a constant rate of forgetting in calendar time.
Historical development
Exponential smoothing emerged as a practical forecasting approach in the 1950s. Robert G. Brown developed methods associated with inventory and demand forecasting, while Charles C. Holt developed extensions for evolving trends. Peter R. Winters’ 1960 work helped establish the seasonal method now known as Holt–Winters.
Later developments included damped-trend forecasting, systematic statistical state-space formulations, likelihood-based estimation, automatic model selection, and model-based prediction intervals. These developments connected simple recursive forecasting procedures with a broader theory of probabilistic time-series models.