2
$\begingroup$

I am reading the section about moving average models in Hyndman & Athanasopoulos Forecasting: principles and practice. I am trying to understand the MA(q) model in words.

What is white noise? Is this a differenced series which is normally distributed with mean zero? Is it the difference between an observation and the mean of all observations? I do not know what the book is talking about when it says "white noise".

I can understand what a differenced series is. I can understand what sum of square error means. But what is this "white noise" and where did it come from? What is an error term? What does it mean? Who made this up? Can I see an actual example that I can work out in Excel?

When forecasting with an MA(q) model, do you add the moving average series to the mean to get a forecast? How does it actually work? An Excel document or an example involving actual numbers would really help.

I am having a lot of difficulty understanding what is actually going on in the formula (reproduced below). Some examples with actual numbers would be great. $$ y_t=c+e_t+θ_1e_{t−1}+θ_2e_{t−2}+⋯+θ_qe_{t−q} $$

$\endgroup$

closed as too broad by gung, Nick Stauner, Scortchi, Peter Flom Jun 6 '14 at 10:43

Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.

  • $\begingroup$ Colors of noise: en.wikipedia.org/wiki/Colors_of_noise $\endgroup$ – Alexis Jun 5 '14 at 22:50
  • 4
    $\begingroup$ There is an awful lot here, can you focus your question somewhat? What is "the formula" you are referring to? Can you list it? What is "the book" you are referring to? We'd be happy to help you, but I'm not sure this is answerable at the moment. $\endgroup$ – gung Jun 5 '14 at 22:57
  • 5
    $\begingroup$ The text you cite defines white noise earlier: otexts.org/fpp/2/2 You just need to search in the same document. $\endgroup$ – Nick Cox Jun 5 '14 at 23:12
  • 1
    $\begingroup$ There is an excellent reference book called Applied Time Series Analysis for the Social Sciences by McCleary and Hay or Forecasting with Univariate Box - Jenkins Models: Concepts and Cases by Pankratz that you can consult to learn more about what MA means. $\endgroup$ – forecaster Jun 6 '14 at 0:47
  • 1
    $\begingroup$ I'd suggest if you're looking for intuition, first begin by trying to understand an MA(1). $\endgroup$ – Glen_b Jun 6 '14 at 2:38
3
$\begingroup$

It sounds like you are reading about statistical models. Such models include:

  1. A deterministic part (i.e. something that looks like an algebraic relationship; e.g. a line like $y = a + bx$ is a deterministic relationship where $y$ is determined by a linear function of $x$); and

  2. A random part (i.e. something, like noise, that is more or less unknowable... or only knowable in an aggregate sense, like a normal distribution, or some other distribution.). The random part may be called 'noise' or 'error' or something else, depending on the conventions of talking about statistics in a particular discipline. The difference between an observation and the mean of all observations (e.g. $X_{i} - \bar{X}$) is often termed error.

In a moving average($q$) model—e.g. $y_{t} = \mu + \varepsilon_{t} + \theta_{1}\varepsilon_{t-1} + \theta_{2}\varepsilon_{t-2} + \dots + \theta_{q}\varepsilon_{t-q}$—you are explaining $y$ as determined by some mean $\mu$ plus some amount of noise (i.e. a random quantity), plus some amount ($\theta_{1}$) of noise ($\varepsilon_{t-1}$) from last time ($t-1$), plus some (possibly different) amounts of noises to $t-q$ times ago.

I do not know the history of who made the MA(q) model up. Some jerk? Some awesome person? No idea.

I am not gonna post an excel spreadsheet, but it's not too hard to apply. Suppose the contribution of noise at time $t$ is inversely proportional to how long ago the noise happened. Then $\theta_{1} = 1$, $\theta_{2} = 1/2$, $\dots$, and $\theta_{q} = 1/q$, and the MA(q=3) is:

$y_{t} = \mu + \varepsilon_{t} + \varepsilon_{t-1} + \frac{1}{2}\varepsilon_{t-2} + \frac{1}{3}\varepsilon_{t-3}$

Estimating this model is trickier than with a straight up least squares regression... but that's the basic idea of it.

$\endgroup$
  • $\begingroup$ Does this mean that et = yt - u ? Does et need to come from a differenced series ? Or a stationary series ? is this talking about the change in yt or the actual value of yt ? If I make up a pretend series that follows a perfectly predictable pattern of 2,3,4,2,3,4,2,3,4 and use an order one model, should this method predict the series to continue ? Apologies because this is probably confusing and not using the right terminology I'm just trying to understand the basics a bit better. Thanks. $\endgroup$ – user3528592 Jun 6 '14 at 2:39
  • 1
    $\begingroup$ But what is the εt ? If I need calculate y, I need know εt , what is the value of εt?? $\endgroup$ – Mithril Oct 25 '18 at 6:56
  • $\begingroup$ @Mithril Ask this question, but not as a comment. $\endgroup$ – Alexis Oct 25 '18 at 16:09

Not the answer you're looking for? Browse other questions tagged or ask your own question.