Univariate Stochastic ARIMA Model Estimation
estimation of ARMA parameters in practice is not straightforward.
Though many computer algorithms and computer programs exist for ARMA
estimation, care should be taken with respect to some important
aspects. Since it is not our intention to go to far into the details
of estimation algorithms, only some important pitfalls and problems
are considered. These problems are especially interesting
(important) for those who seek to apply the methodology in practice.
consider the formulation of the likelihood function. An ARIMA model
contains three different kinds of parameters:
the variance of the error term.
amount to a total of p + q + 1 parameters to be estimated (see also remark).
These parameters are always estimated on using the stationary time
series (c.q. a time series which is stationary with respect to
itís variance and mean): sometimes
it is necessary to introduce an additional parameter m (a constant
term) to be estimated such that the total amount of parameters to be
estimated is p + q + 2.
function holds true.
so-called log-likelihood function is
SSR is the Sum
of Squared Residuals
and Jenkins (1976) showed that the exact
log-likelihood of an ARIMA model can be written as
the following definitions
using (V.I.2-4), it follows that
backforecasting procedure is identical to the forecasting algorithm,
except that the stationary time series is used in reversed order. Q'
is identified by some criteria which ensure that the backforecasts
have converged. This means that the backforecast should not be
significantly different from the (zero) mean of e(t).
backforecasting is not used (c.q. if the conditional likelihood
criterion is used) the parameter estimates may deviate severely from
the true parameters. Especially if the model contains MA parameters,
exact likelihood estimation is necessary (see also the
that the variance-covariance matrix of the estimated parameters is given by
the inverse of the information matrix
is derived from the likelihood function. Hence, not only the
parameter estimation, but also the variances of the parameters are
dependent on the use of the backforecasting procedure.
large sample variance can
be shown to be
that, Box and Jenkins prove that
uncorrelated (for large samples). In fact, almost all estimation
properties in time series analysis are large sample properties. The
MLE estimates for ARIMA parameters are consistent,
normally distributed, and asymptotically
is possible that an estimation algorithm yields parameter values for
an MA-process which lie outside the invertibility region. In such a
case it is possible to find a SSR which is smaller than the true
estimation process can be adequately performed by Marquardt's
algorithm for nonlinear least squares as described in many
references (BOX and JENKINS 1976), (MELARD 1984), (GARDNER, HARVEY,
and PHILLIPS), etc...
that it is assumed that there is no seasonality involved in the
ARIMA process. In the case of seasonality, there would be p + P + q
+ Q + 1 parameters (P and Q being the seasonal counterparts of p and
q respectively). Furthermore it is assumed that no constant term is
required in the ARIMA process.